TU Darmstadt / ULB / TUbiblio

Boiling Mind: Amplifying the Audience-Performer Connection through Sonification and Visualization of Heart and Electrodermal Activities

Sugawa, Moe ; Furukawa, Taichi ; Chernyshov, George ; Hynds, Danny ; Han, Jiawen ; Padovani, Marcelo ; Zheng, Dingding ; Marky, Karola ; Kunze, Kai ; Minamizawa, Kouta (2021):
Boiling Mind: Amplifying the Audience-Performer Connection through Sonification and Visualization of Heart and Electrodermal Activities.
In: TEI '21: Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction,
ACM, 15th International Conference on Tangible, Embedded, and Embodied Interaction, virtual Conference, 14.-19.02.2021, ISBN 978-1-4503-8213-7,
DOI: 10.1145/3430524.3440653,
[Conference or Workshop Item]

Abstract

In stage performances, an invisible wall in front of the stage often weakens the connections between the audience and performers. To amplify this performative connection, we present the concept ”Boiling Mind”. Our design concept is based on streaming sensor data related to heart and electrodermal activities from audience members and integrating this data into staging elements, such as visual projections, music, and lighting. Thus, the internal states of the audience directly influence the staging. Artists can have a more direct perception of the inner reactions of audience members and can create physical expressions in response to them. In this paper, we present the wearable sensing system as well as design considerations of mapping heart and electrodermal activity to changes in the staging elements. We evaluated our design and setup over three live performances.

Item Type: Conference or Workshop Item
Erschienen: 2021
Creators: Sugawa, Moe ; Furukawa, Taichi ; Chernyshov, George ; Hynds, Danny ; Han, Jiawen ; Padovani, Marcelo ; Zheng, Dingding ; Marky, Karola ; Kunze, Kai ; Minamizawa, Kouta
Title: Boiling Mind: Amplifying the Audience-Performer Connection through Sonification and Visualization of Heart and Electrodermal Activities
Language: English
Abstract:

In stage performances, an invisible wall in front of the stage often weakens the connections between the audience and performers. To amplify this performative connection, we present the concept ”Boiling Mind”. Our design concept is based on streaming sensor data related to heart and electrodermal activities from audience members and integrating this data into staging elements, such as visual projections, music, and lighting. Thus, the internal states of the audience directly influence the staging. Artists can have a more direct perception of the inner reactions of audience members and can create physical expressions in response to them. In this paper, we present the wearable sensing system as well as design considerations of mapping heart and electrodermal activity to changes in the staging elements. We evaluated our design and setup over three live performances.

Title of Book: TEI '21: Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction
Publisher: ACM
ISBN: 978-1-4503-8213-7
Uncontrolled Keywords: Physiological signals, Interactive Dance performance, Embodiment, Audience engagement
Divisions: 20 Department of Computer Science
20 Department of Computer Science > Telecooperation
Event Title: 15th International Conference on Tangible, Embedded, and Embodied Interaction
Event Location: virtual Conference
Event Dates: 14.-19.02.2021
Date Deposited: 17 Feb 2021 09:04
DOI: 10.1145/3430524.3440653
Additional Information:

Art.No.: 34

Export:
Suche nach Titel in: TUfind oder in Google
Send an inquiry Send an inquiry

Options (only for editors)
Show editorial Details Show editorial Details