TU Darmstadt / ULB / TUbiblio

Reconciling Signal-Detection Models of Criterion Learning with the Generalized Matching Law

Koß, C. ; de la Cuesta Ferrer, L. ; Stüttgen, M. C. ; Jäkel, F. (2024)
Reconciling Signal-Detection Models of Criterion Learning with the Generalized Matching Law.
In: Computational Brain & Behavior
doi: 10.1007/s42113-024-00212-w
Artikel, Bibliographie

Kurzbeschreibung (Abstract)

To make decisions that lead to favorable outcomes, animals have to consider both their perceptual uncertainty as well as uncertainty about the outcomes of their actions, such as reinforcements. There is a long tradition of research investigating how the reinforcement structure of a task controls animals’ response behavior. The relation between reinforcement and response rates has been described by the matching law and its generalizations for tasks with and without perceptual uncertainty. The influence of perceptual uncertainty on decision behavior is traditionally modeled with signal detection theory, which posits that a decision criterion is placed on an internal evidence axis. Where this criterion is placed and how it is updated based on reinforcements are open questions within signal detection theory. Various criterion learning models have been proposed; however, their steady-state behavior across different experimental conditions is not consistent with the aforementioned empirical matching laws. Here, we integrate models of criterion learning from signal detection theory with matching laws from animal learning theory to gain a better understanding of the mechanisms by which reinforcements and perceptual uncertainty jointly shape behavior. To do so, we first derive the criterion position that leads to behavior aligned with those laws. We then develop a model that updates the decision criterion trial by trial to learn this criterion position. Our model fits data from a previous experiment well and generates behavior in simulations that is in line with matching laws for perceptual tasks and the subjects’ behavior in the experiment.

Typ des Eintrags: Artikel
Erschienen: 2024
Autor(en): Koß, C. ; de la Cuesta Ferrer, L. ; Stüttgen, M. C. ; Jäkel, F.
Art des Eintrags: Bibliographie
Titel: Reconciling Signal-Detection Models of Criterion Learning with the Generalized Matching Law
Sprache: Englisch
Publikationsjahr: 2024
Titel der Zeitschrift, Zeitung oder Schriftenreihe: Computational Brain & Behavior
DOI: 10.1007/s42113-024-00212-w
Zugehörige Links:
Kurzbeschreibung (Abstract):

To make decisions that lead to favorable outcomes, animals have to consider both their perceptual uncertainty as well as uncertainty about the outcomes of their actions, such as reinforcements. There is a long tradition of research investigating how the reinforcement structure of a task controls animals’ response behavior. The relation between reinforcement and response rates has been described by the matching law and its generalizations for tasks with and without perceptual uncertainty. The influence of perceptual uncertainty on decision behavior is traditionally modeled with signal detection theory, which posits that a decision criterion is placed on an internal evidence axis. Where this criterion is placed and how it is updated based on reinforcements are open questions within signal detection theory. Various criterion learning models have been proposed; however, their steady-state behavior across different experimental conditions is not consistent with the aforementioned empirical matching laws. Here, we integrate models of criterion learning from signal detection theory with matching laws from animal learning theory to gain a better understanding of the mechanisms by which reinforcements and perceptual uncertainty jointly shape behavior. To do so, we first derive the criterion position that leads to behavior aligned with those laws. We then develop a model that updates the decision criterion trial by trial to learn this criterion position. Our model fits data from a previous experiment well and generates behavior in simulations that is in line with matching laws for perceptual tasks and the subjects’ behavior in the experiment.

Fachbereich(e)/-gebiet(e): 03 Fachbereich Humanwissenschaften
Forschungsfelder
Forschungsfelder > Information and Intelligence
Forschungsfelder > Information and Intelligence > Cognitive Science
03 Fachbereich Humanwissenschaften > Institut für Psychologie
03 Fachbereich Humanwissenschaften > Institut für Psychologie > Modelle höherer Kognition
Zentrale Einrichtungen
Zentrale Einrichtungen > Centre for Cognitive Science (CCS)
Hinterlegungsdatum: 06 Aug 2024 05:17
Letzte Änderung: 06 Aug 2024 05:17
PPN:
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen