Proksch, Sebastian ; Amann, Sven ; Mezini, Mira (2014)
Towards Standardized Evaluation of Developer-Assistance Tools.
doi: 10.1145/2593822.2593827
Konferenzveröffentlichung, Bibliographie
Kurzbeschreibung (Abstract)
Over the last years, researchers proposed a variety of assistance tools to support developers in their development environments. Many of the respective publications introduce new evaluation strategies or use custom datasets. Size and quality of the performed evaluations differ. Additionally, the strategies often use metrics that are tailored to the respective tools. As a result, comparing different assistance tools is very difficult.
In this work, we present a framework for the standardized evaluation of assistance tools, on the example of code recommenders. The framework combines different ideas and demands from previous work. Furthermore, we discuss how the community could jointly realize the framework.
| Typ des Eintrags: | Konferenzveröffentlichung |
|---|---|
| Erschienen: | 2014 |
| Autor(en): | Proksch, Sebastian ; Amann, Sven ; Mezini, Mira |
| Art des Eintrags: | Bibliographie |
| Titel: | Towards Standardized Evaluation of Developer-Assistance Tools |
| Sprache: | Englisch |
| Publikationsjahr: | 3 Juni 2014 |
| Buchtitel: | Proceedings of the 4th International Workshop on Recommendation Systems for Software Engineering - RSSE 2014 |
| DOI: | 10.1145/2593822.2593827 |
| Zugehörige Links: | |
| Kurzbeschreibung (Abstract): | Over the last years, researchers proposed a variety of assistance tools to support developers in their development environments. Many of the respective publications introduce new evaluation strategies or use custom datasets. Size and quality of the performed evaluations differ. Additionally, the strategies often use metrics that are tailored to the respective tools. As a result, comparing different assistance tools is very difficult. In this work, we present a framework for the standardized evaluation of assistance tools, on the example of code recommenders. The framework combines different ideas and demands from previous work. Furthermore, we discuss how the community could jointly realize the framework. |
| Freie Schlagworte: | Documentation, Experimentation, Standardization, Integrated Development Environment, Content Assistance, Tools, Evaluation, Repository |
| Fachbereich(e)/-gebiet(e): | 20 Fachbereich Informatik > Softwaretechnik 20 Fachbereich Informatik |
| Hinterlegungsdatum: | 13 Jun 2014 13:30 |
| Letzte Änderung: | 13 Jun 2014 13:30 |
| PPN: | |
| Export: | |
| Suche nach Titel in: | TUfind oder in Google |
 |
Frage zum Eintrag |
Optionen (nur für Redakteure)
 |
Redaktionelle Details anzeigen |
Drucken
Impressum