Bühler, Moritz (2022)
Theory of mind and information relevance in human centric human robot cooperation.
Technische Universität Darmstadt
doi: 10.26083/tuprints-00021432
Dissertation, Erstveröffentlichung, Verlagsversion
Kurzbeschreibung (Abstract)
In the interaction with others, besides consideration of environment and task requirements, it is crucial to account for and develop an understanding for the interaction partner and her state of mind. An understanding of other’s state of knowledge and plans is important to support efficient interaction activities including information sharing, or distribution of sub- tasks. A robot cooperating with and supporting a human partner might decide to communicate information that it has collected. However, sharing every piece of information is not feasible, as not all information is both, currently relevant and new for the human partner, but instead will annoy and dis- tract her from other important activities. An understanding for the human state of mind will enable the robot to balance communication according to the needs of the human partner and the efforts of communication for both. An artificial theory of mind is proposed as Bayesian inference of human beliefs during interaction. It relies on a general model for human information perception and decision making. To cope with the complexity of second order inference – estimating what the human inferred of her environment – an efficient linearization based filtering approach is introduced. The inferred human belief, as understanding of her mental state, is used to estimate her situation awareness. When this is missing, e.g. the human is unaware of some important piece of information, the robot provides supportive communication. It therefore evaluates relevance and novelty of information compared to communication efforts following a systematic information sharing concept. The robot decides about whether, when and what type of information it should provide in a current situation to sup- port the human efficiently without annoying. The decision is derived by planning under uncertainty while considering the inferred human belief in relation to the task requirements. Systematic properties and benefits of the derived concepts are discussed in illustrative example situations. Two human robot collaborative tasks and corresponding user studies were designed and investigated, applying artificial theory of mind as be- lief inference and assistive communication in the interaction with humans.
Equipped with the artificial theory of mind, the robot is able to infer in- terpretable information about the human’s mental state and can detect a lack of human awareness. Supported by adaptive human centric information sharing, participants could recover much earlier from unawareness. A comparison to state-of-the-art communication strategies demonstrates the efficiency, as the new concept explicitly balances benefits and costs of communication to support while avoiding unnecessary interruptions. By sharing information according to human needs and environmental urgency, the robot does not take over nor instruct the human, but enables her to make good decisions herself.
Typ des Eintrags: | Dissertation | ||||
---|---|---|---|---|---|
Erschienen: | 2022 | ||||
Autor(en): | Bühler, Moritz | ||||
Art des Eintrags: | Erstveröffentlichung | ||||
Titel: | Theory of mind and information relevance in human centric human robot cooperation | ||||
Sprache: | Englisch | ||||
Referenten: | Adamy, Prof. Dr. Jürgen ; Sendhoff, Prof. Dr. Bernhard | ||||
Publikationsjahr: | 2022 | ||||
Ort: | Darmstadt | ||||
Kollation: | XIII, 141 Seiten | ||||
Datum der mündlichen Prüfung: | 10 Mai 2022 | ||||
DOI: | 10.26083/tuprints-00021432 | ||||
URL / URN: | https://tuprints.ulb.tu-darmstadt.de/21432 | ||||
Kurzbeschreibung (Abstract): | In the interaction with others, besides consideration of environment and task requirements, it is crucial to account for and develop an understanding for the interaction partner and her state of mind. An understanding of other’s state of knowledge and plans is important to support efficient interaction activities including information sharing, or distribution of sub- tasks. A robot cooperating with and supporting a human partner might decide to communicate information that it has collected. However, sharing every piece of information is not feasible, as not all information is both, currently relevant and new for the human partner, but instead will annoy and dis- tract her from other important activities. An understanding for the human state of mind will enable the robot to balance communication according to the needs of the human partner and the efforts of communication for both. An artificial theory of mind is proposed as Bayesian inference of human beliefs during interaction. It relies on a general model for human information perception and decision making. To cope with the complexity of second order inference – estimating what the human inferred of her environment – an efficient linearization based filtering approach is introduced. The inferred human belief, as understanding of her mental state, is used to estimate her situation awareness. When this is missing, e.g. the human is unaware of some important piece of information, the robot provides supportive communication. It therefore evaluates relevance and novelty of information compared to communication efforts following a systematic information sharing concept. The robot decides about whether, when and what type of information it should provide in a current situation to sup- port the human efficiently without annoying. The decision is derived by planning under uncertainty while considering the inferred human belief in relation to the task requirements. Systematic properties and benefits of the derived concepts are discussed in illustrative example situations. Two human robot collaborative tasks and corresponding user studies were designed and investigated, applying artificial theory of mind as be- lief inference and assistive communication in the interaction with humans. Equipped with the artificial theory of mind, the robot is able to infer in- terpretable information about the human’s mental state and can detect a lack of human awareness. Supported by adaptive human centric information sharing, participants could recover much earlier from unawareness. A comparison to state-of-the-art communication strategies demonstrates the efficiency, as the new concept explicitly balances benefits and costs of communication to support while avoiding unnecessary interruptions. By sharing information according to human needs and environmental urgency, the robot does not take over nor instruct the human, but enables her to make good decisions herself. |
||||
Alternatives oder übersetztes Abstract: |
|
||||
Status: | Verlagsversion | ||||
URN: | urn:nbn:de:tuda-tuprints-214324 | ||||
Sachgruppe der Dewey Dezimalklassifikatin (DDC): | 600 Technik, Medizin, angewandte Wissenschaften > 620 Ingenieurwissenschaften und Maschinenbau | ||||
Fachbereich(e)/-gebiet(e): | 18 Fachbereich Elektrotechnik und Informationstechnik 18 Fachbereich Elektrotechnik und Informationstechnik > Institut für Automatisierungstechnik und Mechatronik 18 Fachbereich Elektrotechnik und Informationstechnik > Institut für Automatisierungstechnik und Mechatronik > Regelungsmethoden und Robotik (ab 01.08.2022 umbenannt in Regelungsmethoden und Intelligente Systeme) |
||||
Hinterlegungsdatum: | 29 Jun 2022 12:01 | ||||
Letzte Änderung: | 11 Nov 2022 10:33 | ||||
PPN: | 496579916 | ||||
Referenten: | Adamy, Prof. Dr. Jürgen ; Sendhoff, Prof. Dr. Bernhard | ||||
Datum der mündlichen Prüfung / Verteidigung / mdl. Prüfung: | 10 Mai 2022 | ||||
Export: | |||||
Suche nach Titel in: | TUfind oder in Google |
Frage zum Eintrag |
Optionen (nur für Redakteure)
Redaktionelle Details anzeigen |