TU Darmstadt / ULB / TUbiblio

Musical Design Patterns: An Example of a Human-Centered Model of Interactive Multimedia

Borchers, Jan and Mühlhäuser, Max (1997):
Musical Design Patterns: An Example of a Human-Centered Model of Interactive Multimedia.
In: Proceedings of the IEEE International Conference on Multimedia Computing Systems, Ottawa, June 3-6, 1997, IEEE Computer Society, [Conference or Workshop Item]

Abstract

Most multimedia data today is sampled and quantized from analog sources. Even with sophisticated recognition and indexing techniques it remains difficult to associate human-centered, semantic content and structural informtion with it. This prohibits many desirable, more advanced interaction metaphors with the data than simple replay. We propose that a human-centered model of both multimedia data and suitable metaphors to directly and instantaneously interact with it is crucial to the design of more interactive and multimedia-aware system and application architectures. We show how we implemented such a model for the media type ?music? in the system, a highly sucessful interactive computer-based music exhibit in the Ars Electronica Center in Linz, Austria. The system uses a high-level semantic concept of musical information called Musical Design Patterns. Interaction with this representation,like spontaneous, computer-supported improvisation,is supported in a novel way using just a pair of infrared batons to control the entire exhibit. The system and its semantic model offer a technologically and artistically innovative approach that should be of interest to multimedia researchers as well as educators, artists and performers.

Item Type: Conference or Workshop Item
Erschienen: 1997
Creators: Borchers, Jan and Mühlhäuser, Max
Title: Musical Design Patterns: An Example of a Human-Centered Model of Interactive Multimedia
Language: German
Abstract:

Most multimedia data today is sampled and quantized from analog sources. Even with sophisticated recognition and indexing techniques it remains difficult to associate human-centered, semantic content and structural informtion with it. This prohibits many desirable, more advanced interaction metaphors with the data than simple replay. We propose that a human-centered model of both multimedia data and suitable metaphors to directly and instantaneously interact with it is crucial to the design of more interactive and multimedia-aware system and application architectures. We show how we implemented such a model for the media type ?music? in the system, a highly sucessful interactive computer-based music exhibit in the Ars Electronica Center in Linz, Austria. The system uses a high-level semantic concept of musical information called Musical Design Patterns. Interaction with this representation,like spontaneous, computer-supported improvisation,is supported in a novel way using just a pair of infrared batons to control the entire exhibit. The system and its semantic model offer a technologically and artistically innovative approach that should be of interest to multimedia researchers as well as educators, artists and performers.

Title of Book: Proceedings of the IEEE International Conference on Multimedia Computing Systems, Ottawa, June 3-6, 1997
Publisher: IEEE Computer Society
Uncontrolled Keywords: multimedia semantics, interactive exhibit, music, improvisation, user interfaces, batons
Divisions: 20 Department of Computer Science > Telecooperation
20 Department of Computer Science
Date Deposited: 31 Dec 2016 12:59
Identification Number: borchers97musical
Export:

Optionen (nur für Redakteure)

View Item View Item