Ellenrieder, Sara ; Ellenrieder, Nils ; Hendriks, Patrick ; Mehler, Maren F. (2024)
Pilots and Pixels: A Comparative Analysis of Machine Learning Error Effects on Aviation Decision Making.
32nd European Conference on Information Systems (ECIS). Paphos, Zypern (13.-19.06.2024)
Konferenzveröffentlichung, Bibliographie
Kurzbeschreibung (Abstract)
Despite immense improvements in machine learning (ML)-based decision support systems (DSSs), these systems are still prone to errors. For use in high-risk environments such as aviation it is critical, to find out what costs the different types of ML error cause for decision makers. Thus, we provide pilots holding a valid flight license with explainable and non-explainable ML-based DSSs that output different types of ML errors while supporting the visual detection of other aircraft in the vicinity in 222 recorded scenes of flight simulations. The study reveals that both false positives (FPs) and false negatives (FNs) detrimentally affect pilot trust and performance, with a more pronounced effect observed for FNs. While explainable ML output design mitigates some negative effects, it significantly increases the mental workload for pilots when dealing with FPs. These findings inform the development of ML-based DSSs aligned with Error Management Theory to enhance applications in high-stakes environments.
| Typ des Eintrags: | Konferenzveröffentlichung |
|---|---|
| Erschienen: | 2024 |
| Autor(en): | Ellenrieder, Sara ; Ellenrieder, Nils ; Hendriks, Patrick ; Mehler, Maren F. |
| Art des Eintrags: | Bibliographie |
| Titel: | Pilots and Pixels: A Comparative Analysis of Machine Learning Error Effects on Aviation Decision Making |
| Sprache: | Englisch |
| Publikationsjahr: | 2024 |
| Ort: | Paphos, Zypern |
| Veranstaltungstitel: | 32nd European Conference on Information Systems (ECIS) |
| Veranstaltungsort: | Paphos, Zypern |
| Veranstaltungsdatum: | 13.-19.06.2024 |
| URL / URN: | https://aisel.aisnet.org/ecis2024/track06_humanaicollab/trac... |
| Kurzbeschreibung (Abstract): | Despite immense improvements in machine learning (ML)-based decision support systems (DSSs), these systems are still prone to errors. For use in high-risk environments such as aviation it is critical, to find out what costs the different types of ML error cause for decision makers. Thus, we provide pilots holding a valid flight license with explainable and non-explainable ML-based DSSs that output different types of ML errors while supporting the visual detection of other aircraft in the vicinity in 222 recorded scenes of flight simulations. The study reveals that both false positives (FPs) and false negatives (FNs) detrimentally affect pilot trust and performance, with a more pronounced effect observed for FNs. While explainable ML output design mitigates some negative effects, it significantly increases the mental workload for pilots when dealing with FPs. These findings inform the development of ML-based DSSs aligned with Error Management Theory to enhance applications in high-stakes environments. |
| Fachbereich(e)/-gebiet(e): | 01 Fachbereich Rechts- und Wirtschaftswissenschaften 01 Fachbereich Rechts- und Wirtschaftswissenschaften > Betriebswirtschaftliche Fachgebiete 01 Fachbereich Rechts- und Wirtschaftswissenschaften > Betriebswirtschaftliche Fachgebiete > Wirtschaftsinformatik 01 Fachbereich Rechts- und Wirtschaftswissenschaften > Betriebswirtschaftliche Fachgebiete > Fachgebiet Software Business & Information Management |
| Hinterlegungsdatum: | 23 Jul 2024 11:03 |
| Letzte Änderung: | 23 Jul 2024 11:03 |
| PPN: | |
| Export: | |
| Suche nach Titel in: | TUfind oder in Google |
 |
Frage zum Eintrag |
Optionen (nur für Redakteure)
 |
Redaktionelle Details anzeigen |
Drucken
Impressum