TU Darmstadt / ULB / TUbiblio

Towards a Generally Accepted Validation Methodology for Sensor Models - Challenges, Metrics, and First Results

Rosenberger, Philipp ; Wendler, Jan Timo ; Holder, Martin Friedrich ; Linnhoff, Clemens ; Berghöfer, Moritz ; Winner, Hermann ; Maurer, Markus (2019)
Towards a Generally Accepted Validation Methodology for Sensor Models - Challenges, Metrics, and First Results.
Grazer Symposium Virtuelles Fahrzeug. Graz, Austria (07.-08.05.2019)
Konferenzveröffentlichung, Erstveröffentlichung

Kurzbeschreibung (Abstract)

In order to significantly reduce the testing effort of autonomous vehicles, simulation-based testing in combination with a scenario-based approach is a major part of the overall test concept. But, for sophisticated simulations, all applied models have to be validated beforehand, which is the focus of this paper. The presented validation methodology for sensor system simulation is based on a state-of-the-art analysis and the derived necessary improvements. The lack of experience in formulating requirements and providing adequate metrics for their usage in sensor model validation, in contrast to e.g. vehicle dynamics simulation, is addressed. Additionally, the importance of valid measurement and reference data is pointed out and especially the challenges of repeatability and reproducibility of trajectories and measurements of perception sensors in dynamic multi-object scenarios are shown. The process to find relevant scenarios and the resulting parameter space to be examined is described. At the example of lidar point clouds, the derivation of metrics with respect to the requirements is explained and exemplary evaluation results are summarized. Based on this, extensions to the state-of-the-art model validation method are provided.

Typ des Eintrags: Konferenzveröffentlichung
Erschienen: 2019
Autor(en): Rosenberger, Philipp ; Wendler, Jan Timo ; Holder, Martin Friedrich ; Linnhoff, Clemens ; Berghöfer, Moritz ; Winner, Hermann ; Maurer, Markus
Art des Eintrags: Erstveröffentlichung
Titel: Towards a Generally Accepted Validation Methodology for Sensor Models - Challenges, Metrics, and First Results
Sprache: Englisch
Publikationsjahr: 7 Mai 2019
Veranstaltungstitel: Grazer Symposium Virtuelles Fahrzeug
Veranstaltungsort: Graz, Austria
Veranstaltungsdatum: 07.-08.05.2019
URL / URN: https://tuprints.ulb.tu-darmstadt.de/8653
Kurzbeschreibung (Abstract):

In order to significantly reduce the testing effort of autonomous vehicles, simulation-based testing in combination with a scenario-based approach is a major part of the overall test concept. But, for sophisticated simulations, all applied models have to be validated beforehand, which is the focus of this paper. The presented validation methodology for sensor system simulation is based on a state-of-the-art analysis and the derived necessary improvements. The lack of experience in formulating requirements and providing adequate metrics for their usage in sensor model validation, in contrast to e.g. vehicle dynamics simulation, is addressed. Additionally, the importance of valid measurement and reference data is pointed out and especially the challenges of repeatability and reproducibility of trajectories and measurements of perception sensors in dynamic multi-object scenarios are shown. The process to find relevant scenarios and the resulting parameter space to be examined is described. At the example of lidar point clouds, the derivation of metrics with respect to the requirements is explained and exemplary evaluation results are summarized. Based on this, extensions to the state-of-the-art model validation method are provided.

URN: urn:nbn:de:tuda-tuprints-86536
Sachgruppe der Dewey Dezimalklassifikatin (DDC): 600 Technik, Medizin, angewandte Wissenschaften > 620 Ingenieurwissenschaften und Maschinenbau
Fachbereich(e)/-gebiet(e): 16 Fachbereich Maschinenbau
16 Fachbereich Maschinenbau > Fachgebiet Fahrzeugtechnik (FZD)
16 Fachbereich Maschinenbau > Fachgebiet Fahrzeugtechnik (FZD) > Fahrerassistenzssysteme
16 Fachbereich Maschinenbau > Fachgebiet Fahrzeugtechnik (FZD) > Sicherheit
16 Fachbereich Maschinenbau > Fachgebiet Fahrzeugtechnik (FZD) > Testverfahren
Hinterlegungsdatum: 09 Jun 2019 19:55
Letzte Änderung: 24 Nov 2022 11:56
PPN:
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen