z-logo
open-access-imgOpen Access
Computational modeling of choice-induced preference change: A Reinforcement-Learning-based approach
Author(s) -
Jianhong Zhu,
Junya Hashimoto,
Kentaro Katahira,
Makoto Hirakawa,
Takashi Nakao
Publication year - 2021
Publication title -
plos one
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.99
H-Index - 332
ISSN - 1932-6203
DOI - 10.1371/journal.pone.0244434
Subject(s) - preference , reinforcement learning , task (project management) , reinforcement , computer science , artificial intelligence , value (mathematics) , preference learning , machine learning , process (computing) , revealed preference , psychology , social psychology , statistics , mathematics , econometrics , engineering , systems engineering , operating system
The value learning process has been investigated using decision-making tasks with a correct answer specified by the external environment (externally guided decision-making, EDM). In EDM, people are required to adjust their choices based on feedback, and the learning process is generally explained by the reinforcement learning (RL) model. In addition to EDM, value is learned through internally guided decision-making (IDM), in which no correct answer defined by external circumstances is available, such as preference judgment. In IDM, it has been believed that the value of the chosen item is increased and that of the rejected item is decreased (choice-induced preference change; CIPC). An RL-based model called the choice-based learning (CBL) model had been proposed to describe CIPC, in which the values of chosen and/or rejected items are updated as if own choice were the correct answer. However, the validity of the CBL model has not been confirmed by fitting the model to IDM behavioral data. The present study aims to examine the CBL model in IDM. We conducted simulations, a preference judgment task for novel contour shapes, and applied computational model analyses to the behavioral data. The results showed that the CBL model with both the chosen and rejected value’s updated were a good fit for the IDM behavioral data compared to the other candidate models. Although previous studies using subjective preference ratings had repeatedly reported changes only in one of the values of either the chosen or rejected items, we demonstrated for the first time both items’ value changes were based solely on IDM choice behavioral data with computational model analyses.

The content you want is available to Zendy users.

Already have an account? Click here to sign in.
Having issues? You can contact us here