TU Darmstadt / ULB / TUbiblio

VM performance evaluation with functional models: An optimist's outlook

Sinschek, Jan and Sewe, Andreas and Mezini, Mira (2009):
VM performance evaluation with functional models: An optimist's outlook.
In: Proceedings of the Third Workshop on Virtual Machines and Intermediate Languages - VMIL '09,
Third Workshop on Virtual Machines and Intermediate Languages, Orlando, FL, USA, [Conference or Workshop Item]

Abstract

The performance evaluation of virtual machines is notoriously difficult. Therefore, experimental methodology has recently drawn attention, leading to proposals on how to choose benchmarks, interpret results, and detect measurement bias. But this latter task currently relies on the presence of anomalous measurement results, i.e., on outliers, to raise suspicion. We therefore propose the use of functional performance models to detect bias even when benchmark results might appear unsuspicious. Failure to validate the model indicates either bias or a need to refine the model.

Item Type: Conference or Workshop Item
Erschienen: 2009
Creators: Sinschek, Jan and Sewe, Andreas and Mezini, Mira
Title: VM performance evaluation with functional models: An optimist's outlook
Language: English
Abstract:

The performance evaluation of virtual machines is notoriously difficult. Therefore, experimental methodology has recently drawn attention, leading to proposals on how to choose benchmarks, interpret results, and detect measurement bias. But this latter task currently relies on the presence of anomalous measurement results, i.e., on outliers, to raise suspicion. We therefore propose the use of functional performance models to detect bias even when benchmark results might appear unsuspicious. Failure to validate the model indicates either bias or a need to refine the model.

Title of Book: Proceedings of the Third Workshop on Virtual Machines and Intermediate Languages - VMIL '09
Uncontrolled Keywords: measurement bias, performance modeling, statistics, validation, virtual machines
Divisions: 20 Department of Computer Science
20 Department of Computer Science > Software Technology
Event Title: Third Workshop on Virtual Machines and Intermediate Languages
Event Location: Orlando, FL, USA
Date Deposited: 24 Mar 2010 14:23
Official URL: http://doi.acm.org/10.1145/1711506.1711512
Identification Number: doi:10.1145/1711506.1711512
Export:
Suche nach Titel in: TUfind oder in Google
Send an inquiry Send an inquiry

Options (only for editors)
Show editorial Details Show editorial Details