Reinforcement learning models of risky choice and the promotion of risk-taking by losses disguised as wins in rats.
Author(s) -
Andrew T. Marshall,
Kimberly Kirkpatrick
Publication year - 2017
Publication title -
journal of experimental psychology animal learning and cognition
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.041
H-Index - 71
eISSN - 2329-8464
pISSN - 2329-8456
DOI - 10.1037/xan0000141
Subject(s) - loss aversion , psychology , context (archaeology) , reinforcement , outcome (game theory) , reinforcement learning , promotion (chess) , animal learning , risk seeking , cognitive psychology , developmental psychology , social psychology , economics , microeconomics , computer science , paleontology , artificial intelligence , politics , political science , law , biology
Risky decisions are inherently characterized by the potential to receive gains or incur losses, and these outcomes have distinct effects on subsequent decision-making. One important factor is that individuals engage in loss-chasing, in which the reception of a loss is followed by relatively increased risk-taking. Unfortunately, the mechanisms of loss-chasing are poorly understood, despite the potential importance for understanding pathological choice behavior. The goal of the present experiment was to illuminate the mechanisms governing individual differences in loss-chasing and risky-choice behaviors. Rats chose between a low-uncertainty outcome that always delivered a variable amount of reward and a high-uncertainty outcome that probabilistically delivered reward. Loss-processing and loss-chasing were assessed in the context of losses disguised as wins (LDWs), which are loss outcomes that are presented along with gain-related stimuli. LDWs have been suggested to interfere with adaptive decision-making in humans and thus potentially increase loss-making. Here, the rats presented with LDWs were riskier, in that they made more choices for the high-uncertainty outcome. A series of nonlinear models were fit to individual rats' data to elucidate the possible psychological mechanisms that best account for individual differences in high-uncertainty choices and loss-chasing behaviors. The models suggested that the rats presented with LDWs were more prone to showing a stay bias following high-uncertainty outcomes compared to rats not presented with LDWs. These results collectively suggest that LDWs acquire conditioned reinforcement properties that encourage continued risk-taking and increase loss-chasing following previous high-risk decisions. (PsycINFO Database Record
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom