TU Darmstadt / ULB / TUbiblio

Cityscapes 3D: Dataset and Benchmark for 9 DoF Vehicle Detection

Gählert, Nils ; Jourdan, Nicolas ; Cordts, Marius ; Franke, Uwe ; Denzler, Joachim (2020)
Cityscapes 3D: Dataset and Benchmark for 9 DoF Vehicle Detection.
Scalability in Autonomous Driving : CVPR Workshop. (18th November 2020)
Konferenzveröffentlichung, Bibliographie

Kurzbeschreibung (Abstract)

Detecting vehicles and representing their position and orientation in the three dimensional space is a key technology for autonomous driving. Recently, methods for 3D vehicle detection solely based on monocular RGB images gained popularity. In order to facilitate this task as well as to compare and drive state-of-the-art methods, several new datasets and benchmarks have been published. Ground truth annotations of vehicles are usually obtained using lidar point clouds, which often induces errors due to imperfect calibration or synchronization between both sensors. To this end, we propose Cityscapes 3D, extending the original Cityscapes dataset with 3D bounding box annotations for all types of vehicles. In contrast to existing datasets, our 3D annotations were labeled using stereo RGB images only and capture all nine degrees of freedom. This leads to a pixel-accurate reprojection in the RGB image and a higher range of annotations compared to lidar-based approaches. In order to ease multitask learning, we provide a pairing of 2D instance segments with 3D bounding boxes. In addition, we complement the Cityscapes benchmark suite with 3D vehicle detection based on the new annotations as well as metrics presented in this work. Dataset and benchmark are available online.

Typ des Eintrags: Konferenzveröffentlichung
Erschienen: 2020
Autor(en): Gählert, Nils ; Jourdan, Nicolas ; Cordts, Marius ; Franke, Uwe ; Denzler, Joachim
Art des Eintrags: Bibliographie
Titel: Cityscapes 3D: Dataset and Benchmark for 9 DoF Vehicle Detection
Sprache: Englisch
Publikationsjahr: 18 November 2020
Veranstaltungstitel: Scalability in Autonomous Driving : CVPR Workshop
Veranstaltungsdatum: 18th November 2020
URL / URN: http://arxiv.org/pdf/2006.07864v1
Kurzbeschreibung (Abstract):

Detecting vehicles and representing their position and orientation in the three dimensional space is a key technology for autonomous driving. Recently, methods for 3D vehicle detection solely based on monocular RGB images gained popularity. In order to facilitate this task as well as to compare and drive state-of-the-art methods, several new datasets and benchmarks have been published. Ground truth annotations of vehicles are usually obtained using lidar point clouds, which often induces errors due to imperfect calibration or synchronization between both sensors. To this end, we propose Cityscapes 3D, extending the original Cityscapes dataset with 3D bounding box annotations for all types of vehicles. In contrast to existing datasets, our 3D annotations were labeled using stereo RGB images only and capture all nine degrees of freedom. This leads to a pixel-accurate reprojection in the RGB image and a higher range of annotations compared to lidar-based approaches. In order to ease multitask learning, we provide a pairing of 2D instance segments with 3D bounding boxes. In addition, we complement the Cityscapes benchmark suite with 3D vehicle detection based on the new annotations as well as metrics presented in this work. Dataset and benchmark are available online.

Zusätzliche Informationen:

Virtual workshop

Fachbereich(e)/-gebiet(e): 16 Fachbereich Maschinenbau
16 Fachbereich Maschinenbau > Institut für Produktionsmanagement und Werkzeugmaschinen (PTW)
16 Fachbereich Maschinenbau > Institut für Produktionsmanagement und Werkzeugmaschinen (PTW) > CiP Center für industrielle Produktivität
Hinterlegungsdatum: 12 Jan 2022 10:01
Letzte Änderung: 12 Jan 2022 10:01
PPN:
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen