TU Darmstadt / ULB / TUbiblio

SHARD : safety and human performance analysis for requirements in detection

Mori, Ken T. ; Peters, Steven (2023)
SHARD : safety and human performance analysis for requirements in detection.
In: IEEE Transactions on Intelligent Vehicles
doi: 10.1109/TIV.2023.3320395
Artikel, Bibliographie

Kurzbeschreibung (Abstract)

Automated driving requires reliable perception of the environment to ensure the safety of the driving task. One common perception task is 3D object detection, which aims at perceiving location and attributes of dynamic objects. This task is typically evaluated on different benchmark datasets, which each propose different metrics. However, these different metrics generally lack consistency and bear no relation to safety. Most notably, there is a lack of consistent definitions of pass/fail criteria for any given detection metric. In this work, the issue is addressed by systematically considering safety and human performance across different aspects of the object detection task. This approach yields interpretable detection metrics as well as thresholds for pass/fail criteria. Furthermore, a validation approach leveraging a prediction network is introduced and successfully applied to the requirements. A comparison of existing detectors shows that current perception algorithms exhibit failures for a majority of objects on the nuScenes dataset. Therefore, the results indicate the necessity of explicit safety consideration in the development of perception algorithms for the automated driving task.

Typ des Eintrags: Artikel
Erschienen: 2023
Autor(en): Mori, Ken T. ; Peters, Steven
Art des Eintrags: Bibliographie
Titel: SHARD : safety and human performance analysis for requirements in detection
Sprache: Englisch
Publikationsjahr: 9 November 2023
Verlag: IEEE
Titel der Zeitschrift, Zeitung oder Schriftenreihe: IEEE Transactions on Intelligent Vehicles
Kollation: 12 Seiten
DOI: 10.1109/TIV.2023.3320395
Kurzbeschreibung (Abstract):

Automated driving requires reliable perception of the environment to ensure the safety of the driving task. One common perception task is 3D object detection, which aims at perceiving location and attributes of dynamic objects. This task is typically evaluated on different benchmark datasets, which each propose different metrics. However, these different metrics generally lack consistency and bear no relation to safety. Most notably, there is a lack of consistent definitions of pass/fail criteria for any given detection metric. In this work, the issue is addressed by systematically considering safety and human performance across different aspects of the object detection task. This approach yields interpretable detection metrics as well as thresholds for pass/fail criteria. Furthermore, a validation approach leveraging a prediction network is introduced and successfully applied to the requirements. A comparison of existing detectors shows that current perception algorithms exhibit failures for a majority of objects on the nuScenes dataset. Therefore, the results indicate the necessity of explicit safety consideration in the development of perception algorithms for the automated driving task.

Fachbereich(e)/-gebiet(e): 16 Fachbereich Maschinenbau
16 Fachbereich Maschinenbau > Fachgebiet Fahrzeugtechnik (FZD)
Hinterlegungsdatum: 09 Nov 2023 12:51
Letzte Änderung: 09 Nov 2023 13:01
PPN: 513045597
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen