TU Darmstadt / ULB / TUbiblio

A Real-Time Audio/Video System for Interactive Conducting

Borchers, Jan and Lee, Eric and Mühlhäuser, Max and Samminger, Wolfgang :
A Real-Time Audio/Video System for Interactive Conducting.
In: Jrnl. Multimedia Systems 9 (6), 9 (6) pp. 458-465.
[Article] , (2004)

Abstract

We present the first multimedia system to conduct a realistic electronic orchestra. Users can control tempo, dynamics, and instrument emphasis of the orchestra through natural conducting gestures with an infrared baton. Using gesture recognition and tempo adjustment algorithms, the system plays back an audio and video recording of an actual orchestra that follows the user's conducting in real time. A major achievement of this system is its ability to vary playback speed in real time while avoiding audio artifacts such as pitch changes. The system has been deployed as an exhibit and has become a major attraction of a large Vienna-based music exhibition center.

Item Type: Article
Erschienen: 2004
Creators: Borchers, Jan and Lee, Eric and Mühlhäuser, Max and Samminger, Wolfgang
Title: A Real-Time Audio/Video System for Interactive Conducting
Language: German
Abstract:

We present the first multimedia system to conduct a realistic electronic orchestra. Users can control tempo, dynamics, and instrument emphasis of the orchestra through natural conducting gestures with an infrared baton. Using gesture recognition and tempo adjustment algorithms, the system plays back an audio and video recording of an actual orchestra that follows the user's conducting in real time. A major achievement of this system is its ability to vary playback speed in real time while avoiding audio artifacts such as pitch changes. The system has been deployed as an exhibit and has become a major attraction of a large Vienna-based music exhibition center.

Journal or Publication Title: Jrnl. Multimedia Systems 9 (6)
Volume: 9
Number: 6
Uncontrolled Keywords: - HMM: FormerProjects;Conducting – Interactive exhibit – Time stretching
Divisions: 18 Department of Electrical Engineering and Information Technology > Institute of Computer Engineering > Real-Time Systems
Department of Computer Science > Telecooperation
18 Department of Electrical Engineering and Information Technology > Institute of Computer Engineering
18 Department of Electrical Engineering and Information Technology
Department of Computer Science
Date Deposited: 31 Dec 2016 12:59
DOI: 10.1007/s000530-003-0119-y
Identification Number: tk282
Related URLs:
Export:

Optionen (nur für Redakteure)

View Item View Item