Cogliati Dezza, Irene ; Yu, Angela J. ; Cleeremans, Axel ; Alexander, William (2017)
Learning the value of information and reward over time when solving exploration-exploitation problems.
In: Scientific Reports, 7
doi: 10.1038/s41598-017-17237-w
Artikel, Bibliographie
Kurzbeschreibung (Abstract)
To flexibly adapt to the demands of their environment, animals are constantly exposed to the conflict resulting from having to choose between predictably rewarding familiar options (exploitation) and risky novel options, the value of which essentially consists of obtaining new information about the space of possible rewards (exploration). Despite extensive research, the mechanisms that subtend the manner in which animals solve this exploitation-exploration dilemma are still poorly understood. Here, we investigate human decision-making in a gambling task in which the informational value of each trial and the reward potential were separately manipulated. To better characterize the mechanisms that underlined the observed behavioural choices, we introduce a computational model that augments the standard reward-based reinforcement learning formulation by associating a value to information. We find that both reward and information gained during learning influence the balance between exploitation and exploration, and that this influence was dependent on the reward context. Our results shed light on the mechanisms that underpin decision-making under uncertainty, and suggest new approaches for investigating the exploration-exploitation dilemma throughout the animal kingdom.
Typ des Eintrags: | Artikel |
---|---|
Erschienen: | 2017 |
Autor(en): | Cogliati Dezza, Irene ; Yu, Angela J. ; Cleeremans, Axel ; Alexander, William |
Art des Eintrags: | Bibliographie |
Titel: | Learning the value of information and reward over time when solving exploration-exploitation problems |
Sprache: | Englisch |
Publikationsjahr: | Dezember 2017 |
Ort: | London |
Verlag: | Macmillan Publishers Limited, part of Springer Nature |
Titel der Zeitschrift, Zeitung oder Schriftenreihe: | Scientific Reports |
Jahrgang/Volume einer Zeitschrift: | 7 |
DOI: | 10.1038/s41598-017-17237-w |
URL / URN: | https://www.nature.com/articles/s41598-017-17237-w |
Kurzbeschreibung (Abstract): | To flexibly adapt to the demands of their environment, animals are constantly exposed to the conflict resulting from having to choose between predictably rewarding familiar options (exploitation) and risky novel options, the value of which essentially consists of obtaining new information about the space of possible rewards (exploration). Despite extensive research, the mechanisms that subtend the manner in which animals solve this exploitation-exploration dilemma are still poorly understood. Here, we investigate human decision-making in a gambling task in which the informational value of each trial and the reward potential were separately manipulated. To better characterize the mechanisms that underlined the observed behavioural choices, we introduce a computational model that augments the standard reward-based reinforcement learning formulation by associating a value to information. We find that both reward and information gained during learning influence the balance between exploitation and exploration, and that this influence was dependent on the reward context. Our results shed light on the mechanisms that underpin decision-making under uncertainty, and suggest new approaches for investigating the exploration-exploitation dilemma throughout the animal kingdom. |
Zusätzliche Informationen: | 26 citations (Crossref) 2023-10-13 Number: 1 Publisher: Nature Publishing Group; Article ID: 16919 |
Fachbereich(e)/-gebiet(e): | 03 Fachbereich Humanwissenschaften 03 Fachbereich Humanwissenschaften > Institut für Psychologie |
Hinterlegungsdatum: | 30 Okt 2023 08:09 |
Letzte Änderung: | 31 Okt 2023 06:52 |
PPN: | 512761205 |
Export: | |
Suche nach Titel in: | TUfind oder in Google |
Frage zum Eintrag |
Optionen (nur für Redakteure)
Redaktionelle Details anzeigen |