TU Darmstadt / ULB / TUbiblio

Lowering the Barrier for Successful Replication and Evaluation

Lücke-Tieke, Hendrik and Beuth, Marcel and Schader, Philipp and May, Thorsten and Bernard, Jürgen and Kohlhammer, Jörn (2018):
Lowering the Barrier for Successful Replication and Evaluation.
In: 2018 IEEE Workshop on evaluation and Beyond - methodological approaches for Visualization (BELIV), Berlin, Germany, 21 Oct 2018, ISBN 978-1-5386-6884-9,
DOI: 10.1109/BELIV.2018.8634201,
[Online-Edition: https://doi.org/10.1109/BELIV.2018.8634201],
[Conference or Workshop Item]

Abstract

Evaluation of a visualization technique is complex and time-consuming. We present a system that aims at easing design, creation and execution of controlled experiments for visualizations in the web. We include of parameterizable visualization generation services, thus separating the visualization implementation from study design and execution. This enables experimenters to design and run multiple experiments on the same visualization service in parallel, replicate experiments, and compare different visualization services quickly. The system supports the range from simple questionnaires to visualization-specific interaction techniques as well as automated task generation based on dynamic sampling of parameter spaces. We feature two examples to demonstrate our service-based approach. One example demonstrates how a suite of successive experiments can be conducted, while the other example includes an extended replication study.

Item Type: Conference or Workshop Item
Erschienen: 2018
Creators: Lücke-Tieke, Hendrik and Beuth, Marcel and Schader, Philipp and May, Thorsten and Bernard, Jürgen and Kohlhammer, Jörn
Title: Lowering the Barrier for Successful Replication and Evaluation
Language: English
Abstract:

Evaluation of a visualization technique is complex and time-consuming. We present a system that aims at easing design, creation and execution of controlled experiments for visualizations in the web. We include of parameterizable visualization generation services, thus separating the visualization implementation from study design and execution. This enables experimenters to design and run multiple experiments on the same visualization service in parallel, replicate experiments, and compare different visualization services quickly. The system supports the range from simple questionnaires to visualization-specific interaction techniques as well as automated task generation based on dynamic sampling of parameter spaces. We feature two examples to demonstrate our service-based approach. One example demonstrates how a suite of successive experiments can be conducted, while the other example includes an extended replication study.

ISBN: 978-1-5386-6884-9
Uncontrolled Keywords: Human-computer interaction (HCI), User study, Evaluation
Divisions: 20 Department of Computer Science
20 Department of Computer Science > Interactive Graphics Systems
Event Title: 2018 IEEE Workshop on evaluation and Beyond - methodological approaches for Visualization (BELIV)
Event Location: Berlin, Germany
Event Dates: 21 Oct 2018
Date Deposited: 29 Aug 2019 05:54
DOI: 10.1109/BELIV.2018.8634201
Official URL: https://doi.org/10.1109/BELIV.2018.8634201
Export:
Suche nach Titel in: TUfind oder in Google

Optionen (nur für Redakteure)

View Item View Item