Eckart de Castilho, Richard ; Gurevych, Iryna
Hrsg.: Agosti, Maristella ; Ferro, Nicola ; Thanos, Costantino (2011)
A Lightweight Framework for Reproducible Parameter Sweeping in Information Retrieval.
Glasgow, Scotland, UK
doi: 10.1145/2064227.2064248
Konferenzveröffentlichung, Bibliographie
Kurzbeschreibung (Abstract)
Information retrieval experiments consist of multiple tasks, such as preprocessing and evaluation, each subject to various parameters affecting their results. Dependencies between tasks exist such that one task may have to use the output of another. Many scientific workflow systems come with sophisticated graphical authoring tools but do not integrate well with integrated development environments used for programming. The framework for dataflow-based parameter sweeping experiments introduced in this paper is lightweight, provides support for declaratively setting up experiments, and integrates seamlessly with Java-based development environments. To reduce the computational effort of running an experiment with many different parameter settings, the framework uses dataflow dependency information to maintain and reuse intermediate results.
Typ des Eintrags: | Konferenzveröffentlichung |
---|---|
Erschienen: | 2011 |
Herausgeber: | Agosti, Maristella ; Ferro, Nicola ; Thanos, Costantino |
Autor(en): | Eckart de Castilho, Richard ; Gurevych, Iryna |
Art des Eintrags: | Bibliographie |
Titel: | A Lightweight Framework for Reproducible Parameter Sweeping in Information Retrieval |
Sprache: | Englisch |
Publikationsjahr: | 2011 |
Verlag: | ACM |
Buchtitel: | Proceedings of the 2011 workshop on Data infrastructurEs for supporting information retrieval evaluation |
Reihe: | DESIRE '11 |
Veranstaltungsort: | Glasgow, Scotland, UK |
DOI: | 10.1145/2064227.2064248 |
URL / URN: | https://dl.acm.org/citation.cfm?id=2064227.2064248 |
Zugehörige Links: | |
Kurzbeschreibung (Abstract): | Information retrieval experiments consist of multiple tasks, such as preprocessing and evaluation, each subject to various parameters affecting their results. Dependencies between tasks exist such that one task may have to use the output of another. Many scientific workflow systems come with sophisticated graphical authoring tools but do not integrate well with integrated development environments used for programming. The framework for dataflow-based parameter sweeping experiments introduced in this paper is lightweight, provides support for declaratively setting up experiments, and integrates seamlessly with Java-based development environments. To reduce the computational effort of running an experiment with many different parameter settings, the framework uses dataflow dependency information to maintain and reuse intermediate results. |
Freie Schlagworte: | UKP_p_DARIAHDE;UKP_a_LangTech4eHum;UKP_p_DKPro;UKP_s_DKPro_Lab;Dataflow, Information Retrieval, Workflow |
ID-Nummer: | TUD-CS-2011-0215 |
Fachbereich(e)/-gebiet(e): | 20 Fachbereich Informatik 20 Fachbereich Informatik > Ubiquitäre Wissensverarbeitung |
Hinterlegungsdatum: | 31 Dez 2016 14:29 |
Letzte Änderung: | 24 Jan 2020 12:03 |
PPN: | |
Export: | |
Suche nach Titel in: | TUfind oder in Google |
Frage zum Eintrag |
Optionen (nur für Redakteure)
Redaktionelle Details anzeigen |