TU Darmstadt / ULB / TUbiblio

Believable Virtual Characters in Human-Computer Dialogs

Jung, Yvonne and Kuijper, Arjan and Fellner, Dieter W. and Kipp, Michael and Miksatko, Jan and Gratch, Jonathan and Thalmann, Daniel (2011):
Believable Virtual Characters in Human-Computer Dialogs.
Eurographics Association, In: Eurographics 2011. State of the Art Reports (STARs), [Conference or Workshop Item]

Abstract

For many application areas, where a task is most naturally represented by talking or where standard input devices are difficult to use or not available at all, virtual characters can be well suited as an intuitive man-machine-interface due to their inherent ability to simulate verbal as well as nonverbal communicative behavior. This type of interface is made possible with the help of multimodal dialog systems, which extend common speech dialog systems with additional modalities just like in human-human interaction. Multimodal dialog systems consist at least of an auditive and graphical component, and communication is based on speech and nonverbal communication alike. However, employing virtual characters as personal and believable dialog partners in multimodal dialogs entails several challenges, because this requires not only a reliable and consistent motion and dialog behavior but also regarding nonverbal communication and affective components. Besides modeling the "mind" and creating intelligent communication behavior on the encoding side, which is an active field of research in artificial intelligence, the visual representation of a character including its perceivable behavior, from a decoding perspective, such as facial expressions and gestures, belongs to the domain of computer graphics and likewise implicates many open issues concerning natural communication. Therefore, in this report we give a comprehensive overview how to go from communication models to actual animation and rendering.

Item Type: Conference or Workshop Item
Erschienen: 2011
Creators: Jung, Yvonne and Kuijper, Arjan and Fellner, Dieter W. and Kipp, Michael and Miksatko, Jan and Gratch, Jonathan and Thalmann, Daniel
Title: Believable Virtual Characters in Human-Computer Dialogs
Language: English
Abstract:

For many application areas, where a task is most naturally represented by talking or where standard input devices are difficult to use or not available at all, virtual characters can be well suited as an intuitive man-machine-interface due to their inherent ability to simulate verbal as well as nonverbal communicative behavior. This type of interface is made possible with the help of multimodal dialog systems, which extend common speech dialog systems with additional modalities just like in human-human interaction. Multimodal dialog systems consist at least of an auditive and graphical component, and communication is based on speech and nonverbal communication alike. However, employing virtual characters as personal and believable dialog partners in multimodal dialogs entails several challenges, because this requires not only a reliable and consistent motion and dialog behavior but also regarding nonverbal communication and affective components. Besides modeling the "mind" and creating intelligent communication behavior on the encoding side, which is an active field of research in artificial intelligence, the visual representation of a character including its perceivable behavior, from a decoding perspective, such as facial expressions and gestures, belongs to the domain of computer graphics and likewise implicates many open issues concerning natural communication. Therefore, in this report we give a comprehensive overview how to go from communication models to actual animation and rendering.

Publisher: Eurographics Association
Uncontrolled Keywords: Forschungsgruppe Semantic Models, Immersive Systems (SMIS), Business Field: Digital society, Business Field: Visual decision support, Research Area: Generalized digital documents, Research Area: Confluence of graphics and vision, Multimodal systems, Multimodal dialog design, Human-computer interaction (HCI), Avatars, Virtual characters, Virtual camera, Emotion expression, Environmental factors
Divisions: 20 Department of Computer Science
20 Department of Computer Science > Interactive Graphics Systems
Event Title: Eurographics 2011. State of the Art Reports (STARs)
Date Deposited: 12 Nov 2018 11:16
Export:
Suche nach Titel in: TUfind oder in Google

Optionen (nur für Redakteure)

View Item View Item