TU Darmstadt / ULB / TUbiblio

A Lightweight Framework for Reproducible Parameter Sweeping in Information Retrieval

Eckart de Castilho, Richard and Gurevych, Iryna
Agosti, Maristella and Ferro, Nicola and Thanos, Costantino (eds.) (2011):
A Lightweight Framework for Reproducible Parameter Sweeping in Information Retrieval.
In: Proceedings of the 2011 workshop on Data infrastructurEs for supporting information retrieval evaluation, ACM, Glasgow, Scotland, UK, In: DESIRE '11, ISBN 978-1-4503-0952-3,
DOI: http://doi.acm.org/10.1145/2064227.2064248,
[Online-Edition: https://dl.acm.org/citation.cfm?id=2064227.2064248],
[Conference or Workshop Item]

Abstract

Information retrieval experiments consist of multiple tasks, such as preprocessing and evaluation, each subject to various parameters affecting their results. Dependencies between tasks exist such that one task may have to use the output of another. Many scientific workflow systems come with sophisticated graphical authoring tools but do not integrate well with integrated development environments used for programming. The framework for dataflow-based parameter sweeping experiments introduced in this paper is lightweight, provides support for declaratively setting up experiments, and integrates seamlessly with Java-based development environments. To reduce the computational effort of running an experiment with many different parameter settings, the framework uses dataflow dependency information to maintain and reuse intermediate results.

Item Type: Conference or Workshop Item
Erschienen: 2011
Editors: Agosti, Maristella and Ferro, Nicola and Thanos, Costantino
Creators: Eckart de Castilho, Richard and Gurevych, Iryna
Title: A Lightweight Framework for Reproducible Parameter Sweeping in Information Retrieval
Language: English
Abstract:

Information retrieval experiments consist of multiple tasks, such as preprocessing and evaluation, each subject to various parameters affecting their results. Dependencies between tasks exist such that one task may have to use the output of another. Many scientific workflow systems come with sophisticated graphical authoring tools but do not integrate well with integrated development environments used for programming. The framework for dataflow-based parameter sweeping experiments introduced in this paper is lightweight, provides support for declaratively setting up experiments, and integrates seamlessly with Java-based development environments. To reduce the computational effort of running an experiment with many different parameter settings, the framework uses dataflow dependency information to maintain and reuse intermediate results.

Title of Book: Proceedings of the 2011 workshop on Data infrastructurEs for supporting information retrieval evaluation
Series Name: DESIRE '11
Publisher: ACM
ISBN: 978-1-4503-0952-3
Uncontrolled Keywords: UKP_p_DARIAHDE;UKP_a_LangTech4eHum;UKP_p_DKPro;UKP_s_DKPro_Lab;Dataflow, Information Retrieval, Workflow
Divisions: 20 Department of Computer Science
20 Department of Computer Science > Ubiquitous Knowledge Processing
Event Location: Glasgow, Scotland, UK
Date Deposited: 31 Dec 2016 14:29
DOI: http://doi.acm.org/10.1145/2064227.2064248
Official URL: https://dl.acm.org/citation.cfm?id=2064227.2064248
Identification Number: TUD-CS-2011-0215
Related URLs:
Export:
Suche nach Titel in: TUfind oder in Google

Optionen (nur für Redakteure)

View Item View Item