TU Darmstadt / ULB / TUbiblio

Learning the value of information and reward over time when solving exploration-exploitation problems

Cogliati Dezza, Irene ; Yu, Angela J. ; Cleeremans, Axel ; Alexander, William (2017)
Learning the value of information and reward over time when solving exploration-exploitation problems.
In: Scientific Reports, 7
doi: 10.1038/s41598-017-17237-w
Artikel, Bibliographie

Kurzbeschreibung (Abstract)

To flexibly adapt to the demands of their environment, animals are constantly exposed to the conflict resulting from having to choose between predictably rewarding familiar options (exploitation) and risky novel options, the value of which essentially consists of obtaining new information about the space of possible rewards (exploration). Despite extensive research, the mechanisms that subtend the manner in which animals solve this exploitation-exploration dilemma are still poorly understood. Here, we investigate human decision-making in a gambling task in which the informational value of each trial and the reward potential were separately manipulated. To better characterize the mechanisms that underlined the observed behavioural choices, we introduce a computational model that augments the standard reward-based reinforcement learning formulation by associating a value to information. We find that both reward and information gained during learning influence the balance between exploitation and exploration, and that this influence was dependent on the reward context. Our results shed light on the mechanisms that underpin decision-making under uncertainty, and suggest new approaches for investigating the exploration-exploitation dilemma throughout the animal kingdom.

Typ des Eintrags: Artikel
Erschienen: 2017
Autor(en): Cogliati Dezza, Irene ; Yu, Angela J. ; Cleeremans, Axel ; Alexander, William
Art des Eintrags: Bibliographie
Titel: Learning the value of information and reward over time when solving exploration-exploitation problems
Sprache: Englisch
Publikationsjahr: Dezember 2017
Ort: London
Verlag: Macmillan Publishers Limited, part of Springer Nature
Titel der Zeitschrift, Zeitung oder Schriftenreihe: Scientific Reports
Jahrgang/Volume einer Zeitschrift: 7
DOI: 10.1038/s41598-017-17237-w
URL / URN: https://www.nature.com/articles/s41598-017-17237-w
Kurzbeschreibung (Abstract):

To flexibly adapt to the demands of their environment, animals are constantly exposed to the conflict resulting from having to choose between predictably rewarding familiar options (exploitation) and risky novel options, the value of which essentially consists of obtaining new information about the space of possible rewards (exploration). Despite extensive research, the mechanisms that subtend the manner in which animals solve this exploitation-exploration dilemma are still poorly understood. Here, we investigate human decision-making in a gambling task in which the informational value of each trial and the reward potential were separately manipulated. To better characterize the mechanisms that underlined the observed behavioural choices, we introduce a computational model that augments the standard reward-based reinforcement learning formulation by associating a value to information. We find that both reward and information gained during learning influence the balance between exploitation and exploration, and that this influence was dependent on the reward context. Our results shed light on the mechanisms that underpin decision-making under uncertainty, and suggest new approaches for investigating the exploration-exploitation dilemma throughout the animal kingdom.

Zusätzliche Informationen:

26 citations (Crossref) 2023-10-13 Number: 1 Publisher: Nature Publishing Group; Article ID: 16919

Fachbereich(e)/-gebiet(e): 03 Fachbereich Humanwissenschaften
03 Fachbereich Humanwissenschaften > Institut für Psychologie
Hinterlegungsdatum: 30 Okt 2023 08:09
Letzte Änderung: 31 Okt 2023 06:52
PPN: 512761205
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen