Nachtigall, Marcus ; Schlichtig, Michael ; Bodden, Eric (2023)
Evaluation of Usability Criteria Addressed by Static Analysis Tools on a Large Scale.
Software Engineering 2023 - Fachtagung des GI-Fachbereichs Softwaretechnik. Paderborn, Germany (20.02.2023 – 24.02.2023)
Konferenzveröffentlichung, Bibliographie
Kurzbeschreibung (Abstract)
Static analysis tools support developers in detecting potential coding issues, such as bugs or vulnerabilities. Research emphasizes technical challenges of such tools but also mentions severe usability shortcomings. These shortcomings hinder the adoption of static analysis tools, and user dissatisfaction may even lead to tool abandonment. To comprehensively assess the state of the art, we present the first systematic usability evaluation of a wide range of static analysis tools. We derived a set of 36 relevant criteria from the literature and used them to evaluate a total of 46 static analysis tools complying with our inclusion and exclusion criteria - a representative set of mainly non-proprietary tools. The evaluation against the usability criteria in a multiple-raters approach shows that two thirds of the considered tools off er poor warning messages, while about three-quarters provide hardly any fix support. Furthermore, the integration of user knowledge is strongly neglected, which could be used for instance, to improve handling of false positives. Finally, issues regarding workflow integration and specialized user interfaces are revealed. These findings should prove useful in guiding and focusing further research and development in user experience for static code analyses.
| Typ des Eintrags: | Konferenzveröffentlichung |
|---|---|
| Erschienen: | 2023 |
| Autor(en): | Nachtigall, Marcus ; Schlichtig, Michael ; Bodden, Eric |
| Art des Eintrags: | Bibliographie |
| Titel: | Evaluation of Usability Criteria Addressed by Static Analysis Tools on a Large Scale |
| Sprache: | Englisch |
| Publikationsjahr: | 25 Februar 2023 |
| Verlag: | Gesellschaft für Informatik e.V. |
| Buchtitel: | Software Engineering 2023 |
| Reihe: | GI Editions : Lecture Notes in Informatics |
| Band einer Reihe: | P332 |
| Veranstaltungstitel: | Software Engineering 2023 - Fachtagung des GI-Fachbereichs Softwaretechnik |
| Veranstaltungsort: | Paderborn, Germany |
| Veranstaltungsdatum: | 20.02.2023 – 24.02.2023 |
| URL / URN: | https://dl.gi.de/items/5afe477f-2f6a-4b3d-b391-f024baf0b7a5 |
| Kurzbeschreibung (Abstract): | Static analysis tools support developers in detecting potential coding issues, such as bugs or vulnerabilities. Research emphasizes technical challenges of such tools but also mentions severe usability shortcomings. These shortcomings hinder the adoption of static analysis tools, and user dissatisfaction may even lead to tool abandonment. To comprehensively assess the state of the art, we present the first systematic usability evaluation of a wide range of static analysis tools. We derived a set of 36 relevant criteria from the literature and used them to evaluate a total of 46 static analysis tools complying with our inclusion and exclusion criteria - a representative set of mainly non-proprietary tools. The evaluation against the usability criteria in a multiple-raters approach shows that two thirds of the considered tools off er poor warning messages, while about three-quarters provide hardly any fix support. Furthermore, the integration of user knowledge is strongly neglected, which could be used for instance, to improve handling of false positives. Finally, issues regarding workflow integration and specialized user interfaces are revealed. These findings should prove useful in guiding and focusing further research and development in user experience for static code analyses. |
| Freie Schlagworte: | Automated static analysis, Software usability, E1 |
| Fachbereich(e)/-gebiet(e): | 20 Fachbereich Informatik DFG-Sonderforschungsbereiche (inkl. Transregio) DFG-Sonderforschungsbereiche (inkl. Transregio) > Sonderforschungsbereiche DFG-Graduiertenkollegs DFG-Graduiertenkollegs > Graduiertenkolleg 2050 Privacy and Trust for Mobile Users 20 Fachbereich Informatik > EC SPRIDE 20 Fachbereich Informatik > EC SPRIDE > Secure Software Engineering DFG-Sonderforschungsbereiche (inkl. Transregio) > Sonderforschungsbereiche > SFB 1119: CROSSING – Kryptographiebasierte Sicherheitslösungen als Grundlage für Vertrauen in heutigen und zukünftigen IT-Systemen |
| Hinterlegungsdatum: | 25 Okt 2024 13:56 |
| Letzte Änderung: | 25 Okt 2024 13:56 |
| PPN: | |
| Export: | |
| Suche nach Titel in: | TUfind oder in Google |
 |
Frage zum Eintrag |
Optionen (nur für Redakteure)
 |
Redaktionelle Details anzeigen |
Drucken
Impressum