TU Darmstadt / ULB / TUbiblio

Engineering a realistic real-time conducting system for the audio/video rendering of a real orchestra

Borchers, Jan and Samminger, Wolfgang and Mühlhäuser, Max (2002):
Engineering a realistic real-time conducting system for the audio/video rendering of a real orchestra.
In: Proceedings of the IEEE Fourth International Symposium on Multimedia Software Engineering (MSE’02, pp. 352-362,
Los Alamitos, Calif., IEEE CS press, Fourth International Symposium on Multimedia Software Engineering (MSE 2002), Newport Beach, California, USA, 11-13 Dec. 2002, ISBN 0-7695-1857-5,
DOI: 10.1109/MMSE.2002.1181633,
[Conference or Workshop Item]

Abstract

This paper describes the first multimedia system that allows users to conduct a realistic electronic orchetra. Users control tempo, dynamics, and instrument emphasis of the orchestra through natural conducting gestures with an infrared baton. Using gesture recognition and tempo adjustment algorithms, the system plays back an audio and video recording of an actual orchestra that follows the user?s conducting in real time. A major achievement of this system is that it is able to play back the audio and video recording of the orchestra at variable speed while avoiding pitch changes or other artifacts in the playback. These speed changes can be executed interactively in real time while the recording is being played back. The system has been deployed as an exhibit that has become a major attraction of a large Vienna-based music exhibition center.

Item Type: Conference or Workshop Item
Erschienen: 2002
Creators: Borchers, Jan and Samminger, Wolfgang and Mühlhäuser, Max
Title: Engineering a realistic real-time conducting system for the audio/video rendering of a real orchestra
Language: English
Abstract:

This paper describes the first multimedia system that allows users to conduct a realistic electronic orchetra. Users control tempo, dynamics, and instrument emphasis of the orchestra through natural conducting gestures with an infrared baton. Using gesture recognition and tempo adjustment algorithms, the system plays back an audio and video recording of an actual orchestra that follows the user?s conducting in real time. A major achievement of this system is that it is able to play back the audio and video recording of the orchestra at variable speed while avoiding pitch changes or other artifacts in the playback. These speed changes can be executed interactively in real time while the recording is being played back. The system has been deployed as an exhibit that has become a major attraction of a large Vienna-based music exhibition center.

Title of Book: Proceedings of the IEEE Fourth International Symposium on Multimedia Software Engineering (MSE’02
Place of Publication: Los Alamitos, Calif.
Publisher: IEEE CS press
ISBN: 0-7695-1857-5
Divisions: 20 Department of Computer Science
20 Department of Computer Science > Telecooperation
Event Title: Fourth International Symposium on Multimedia Software Engineering (MSE 2002)
Event Location: Newport Beach, California, USA
Event Dates: 11-13 Dec. 2002
Date Deposited: 31 Dec 2016 12:59
DOI: 10.1109/MMSE.2002.1181633
Identification Number: borchers2002engineering
Export:
Suche nach Titel in: TUfind oder in Google
Send an inquiry Send an inquiry

Options (only for editors)
Show editorial Details Show editorial Details