TU Darmstadt / ULB / TUbiblio

A Spatial Consistent CRF for Semantic Image Segmentation

Dann, Christoph (2011)
A Spatial Consistent CRF for Semantic Image Segmentation.
Technische Universität Darmstadt
Bachelorarbeit, Bibliographie

Kurzbeschreibung (Abstract)

The goal of semantic image segmentation is to separate an image into parts of different semantic content, i.e. with respect to high level object classes such as "cars" or "persons". A new approach for this task based on a probabilistic graphical model formulation is proposed in this thesis. Key elements of the method are a set of proposal segments. Each proposal segment is generated by existing algorithms to partition an object from the rest of the image. The presented method follows the idea of segmentation by classifying super-pixels (small clusters of neighboring pixels), which are determined by intersecting all proposal segments. A conditional random field (CRF) consisting of a two layer spatial hierarchy is formulated. While the bottom layer represents the class assignments of super-pixels, the top level contains assignments for the proposal segments. This results in two super-pixels being connected by segments that contain both. Many latent random variables are present in the proposed CRF, which renders standard Machine Learning approaches for parameter learning computationally infeasible. Therefore, two alternative learning schemes motivated by the spatial object class distribution in the image, are presented and evaluated in this thesis. The segmentation performance of the proposed method is compared different baseline methods in the state-of-the-art setting on the dataset of the VOC Segmentation Challenge 2011. Based on the experimental results extractions of image information in segments are identified as the component that limit model performance most. Finally, several promising approaches are suggested for future research to overcome current model limitations.

Typ des Eintrags: Bachelorarbeit
Erschienen: 2011
Autor(en): Dann, Christoph
Art des Eintrags: Bibliographie
Titel: A Spatial Consistent CRF for Semantic Image Segmentation
Sprache: Englisch
Publikationsjahr: 2011
Kurzbeschreibung (Abstract):

The goal of semantic image segmentation is to separate an image into parts of different semantic content, i.e. with respect to high level object classes such as "cars" or "persons". A new approach for this task based on a probabilistic graphical model formulation is proposed in this thesis. Key elements of the method are a set of proposal segments. Each proposal segment is generated by existing algorithms to partition an object from the rest of the image. The presented method follows the idea of segmentation by classifying super-pixels (small clusters of neighboring pixels), which are determined by intersecting all proposal segments. A conditional random field (CRF) consisting of a two layer spatial hierarchy is formulated. While the bottom layer represents the class assignments of super-pixels, the top level contains assignments for the proposal segments. This results in two super-pixels being connected by segments that contain both. Many latent random variables are present in the proposed CRF, which renders standard Machine Learning approaches for parameter learning computationally infeasible. Therefore, two alternative learning schemes motivated by the spatial object class distribution in the image, are presented and evaluated in this thesis. The segmentation performance of the proposed method is compared different baseline methods in the state-of-the-art setting on the dataset of the VOC Segmentation Challenge 2011. Based on the experimental results extractions of image information in segments are identified as the component that limit model performance most. Finally, several promising approaches are suggested for future research to overcome current model limitations.

Freie Schlagworte: Image segmentation, Semantics, Markov random fields (MRF)
Zusätzliche Informationen:

48 p.

Fachbereich(e)/-gebiet(e): 20 Fachbereich Informatik
20 Fachbereich Informatik > Graphisch-Interaktive Systeme
Hinterlegungsdatum: 12 Nov 2018 11:16
Letzte Änderung: 12 Nov 2018 11:16
PPN:
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen