Premium
ADAPTIVE CRITERION SETTING IN PERCEPTUAL DECISION MAKING
Author(s) -
Stüttgen Maik C.,
Yildiz Ali,
Güntürkün Onur
Publication year - 2011
Publication title -
journal of the experimental analysis of behavior
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.75
H-Index - 61
eISSN - 1938-3711
pISSN - 0022-5002
DOI - 10.1901/jeab.2011.96-155
Subject(s) - reinforcement , stimulus (psychology) , categorization , reinforcement learning , perception , contingency , psychology , decision process , statistics , computer science , artificial intelligence , cognitive psychology , social psychology , mathematics , linguistics , philosophy , neuroscience , process management , business
Pigeons responded in a perceptual categorization task with six different stimuli (shades of gray), three of which were to be classified as “light” or “dark”, respectively. Reinforcement probability for correct responses was varied from 0.2 to 0.6 across blocks of sessions and was unequal for correct light and dark responses. Introduction of a new reinforcement contingency resulted in a biphasic process of adjustment: First, choices were strongly biased towards the favored alternative, which was followed by a shift of preference back towards unbiased choice allocation. The data are well described by a signal detection model in which adjustment to a change in reinforcement contingency is modeled as the change of a criterion along a decision axis with fixed stimulus distributions. Moreover, the model shows that pigeons, after an initial overadjustment, distribute their responses almost optimally, although the overall benefit from doing so is extremely small. The strong and swift effect of minute changes in overall reinforcement probability precludes a choice strategy directly maximizing expected value, contrary to the assumption of signal detection theory. Instead, the rapid adjustments observed can be explained by a model in which reinforcement probabilities for each action, contingent on perceived stimulus intensity, determine choice allocation.