Sinschek, Jan ; Sewe, Andreas ; Mezini, Mira (2009):
VM performance evaluation with functional models: An optimist's outlook.
In: Proceedings of the Third Workshop on Virtual Machines and Intermediate Languages - VMIL '09,
Third Workshop on Virtual Machines and Intermediate Languages, Orlando, FL, USA, [Conference or Workshop Item]
Abstract
The performance evaluation of virtual machines is notoriously difficult. Therefore, experimental methodology has recently drawn attention, leading to proposals on how to choose benchmarks, interpret results, and detect measurement bias. But this latter task currently relies on the presence of anomalous measurement results, i.e., on outliers, to raise suspicion. We therefore propose the use of functional performance models to detect bias even when benchmark results might appear unsuspicious. Failure to validate the model indicates either bias or a need to refine the model.
| Item Type: | Conference or Workshop Item |
|---|---|
| Erschienen: | 2009 |
| Creators: | Sinschek, Jan ; Sewe, Andreas ; Mezini, Mira |
| Title: | VM performance evaluation with functional models: An optimist's outlook |
| Language: | English |
| Abstract: | The performance evaluation of virtual machines is notoriously difficult. Therefore, experimental methodology has recently drawn attention, leading to proposals on how to choose benchmarks, interpret results, and detect measurement bias. But this latter task currently relies on the presence of anomalous measurement results, i.e., on outliers, to raise suspicion. We therefore propose the use of functional performance models to detect bias even when benchmark results might appear unsuspicious. Failure to validate the model indicates either bias or a need to refine the model. |
| Book Title: | Proceedings of the Third Workshop on Virtual Machines and Intermediate Languages - VMIL '09 |
| Uncontrolled Keywords: | measurement bias, performance modeling, statistics, validation, virtual machines |
| Divisions: | 20 Department of Computer Science 20 Department of Computer Science > Software Technology |
| Event Title: | Third Workshop on Virtual Machines and Intermediate Languages |
| Event Location: | Orlando, FL, USA |
| Date Deposited: | 24 Mar 2010 14:23 |
| URL / URN: | http://doi.acm.org/10.1145/1711506.1711512 |
| Identification Number: | doi:10.1145/1711506.1711512 |
| Export: | |
| Suche nach Titel in: | TUfind oder in Google |
 |
Send an inquiry |
Options (only for editors)
 |
Show editorial Details |
Drucken
Impressum