TU Darmstadt / ULB / TUbiblio

Single-Shot 3D Detection of Vehicles from Monocular RGB Images via Geometrically Constrained Keypoints in Real-Time

Gahlert, Nils ; Wan, Jun-Jun ; Jourdan, Nicolas ; Finkbeiner, Jan ; Franke, Uwe ; Denzler, Joachim (2020)
Single-Shot 3D Detection of Vehicles from Monocular RGB Images via Geometrically Constrained Keypoints in Real-Time.
doi: 10.1109/IV47402.2020.9304847
Konferenzveröffentlichung, Bibliographie

Kurzbeschreibung (Abstract)

In this paper we propose a novel 3D single-shot object detection method for detecting vehicles in monocular RGB images. Our approach lifts 2D detections to 3D space by predicting additional regression and classification parameters and hence keeping the runtime close to pure 2D object detection. The additional parameters are transformed to 3D bounding box keypoints within the network under geometric constraints. Our proposed method features a full 3D description including all three angles of rotation without supervision by any labeled ground truth data for the object's orientation, as it focuses on certain keypoints within the image plane. While our approach can be combined with any modern object detection framework with only little computational overhead, we exemplify the extension of SSD for the prediction of 3D bounding boxes. We test our approach on different datasets for autonomous driving and evaluate it using the challenging KITTI 3D Object Detection as well as the novel nuScenes Object Detection benchmarks. While we achieve competitive results on both benchmarks we outperform current state-of-the-art methods in terms of speed with more than 20 FPS for all tested datasets and image resolutions.

Typ des Eintrags: Konferenzveröffentlichung
Erschienen: 2020
Autor(en): Gahlert, Nils ; Wan, Jun-Jun ; Jourdan, Nicolas ; Finkbeiner, Jan ; Franke, Uwe ; Denzler, Joachim
Art des Eintrags: Bibliographie
Titel: Single-Shot 3D Detection of Vehicles from Monocular RGB Images via Geometrically Constrained Keypoints in Real-Time
Sprache: Englisch
Publikationsjahr: 2020
Ort: Las Vegas, NV, USA
Verlag: IEEE
Buchtitel: 2020 IEEE Intelligent Vehicles Symposium (IV) : 19 Oct.-13 Nov. 2020
DOI: 10.1109/IV47402.2020.9304847
Kurzbeschreibung (Abstract):

In this paper we propose a novel 3D single-shot object detection method for detecting vehicles in monocular RGB images. Our approach lifts 2D detections to 3D space by predicting additional regression and classification parameters and hence keeping the runtime close to pure 2D object detection. The additional parameters are transformed to 3D bounding box keypoints within the network under geometric constraints. Our proposed method features a full 3D description including all three angles of rotation without supervision by any labeled ground truth data for the object's orientation, as it focuses on certain keypoints within the image plane. While our approach can be combined with any modern object detection framework with only little computational overhead, we exemplify the extension of SSD for the prediction of 3D bounding boxes. We test our approach on different datasets for autonomous driving and evaluate it using the challenging KITTI 3D Object Detection as well as the novel nuScenes Object Detection benchmarks. While we achieve competitive results on both benchmarks we outperform current state-of-the-art methods in terms of speed with more than 20 FPS for all tested datasets and image resolutions.

Fachbereich(e)/-gebiet(e): 16 Fachbereich Maschinenbau
16 Fachbereich Maschinenbau > Institut für Produktionsmanagement und Werkzeugmaschinen (PTW)
16 Fachbereich Maschinenbau > Institut für Produktionsmanagement und Werkzeugmaschinen (PTW) > CiP Center für industrielle Produktivität
Hinterlegungsdatum: 19 Okt 2021 05:46
Letzte Änderung: 04 Jan 2022 10:00
PPN:
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen