Premium
The autonomy‐validity dilemma in mechanical prediction procedures: The quest for a compromise
Author(s) -
Neumann Marvin,
Niessen A. Susan M.,
Tendeiro Jorge N.,
Meijer Rob R.
Publication year - 2022
Publication title -
journal of behavioral decision making
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.136
H-Index - 76
eISSN - 1099-0771
pISSN - 0894-3257
DOI - 10.1002/bdm.2270
Subject(s) - predictive validity , autonomy , incremental validity , psychology , dilemma , criterion validity , compromise , affect (linguistics) , social psychology , external validity , predictive modelling , construct validity , computer science , machine learning , psychometrics , mathematics , clinical psychology , social science , geometry , communication , sociology , political science , law
Abstract A robust finding in psychological research is that combining information with a mechanical rule results in more valid predictions than combining information holistically in the mind. Nevertheless, information is typically combined holistically in practice, resulting in suboptimal predictions and decisions. Earlier research showed that decision makers are more likely to use mechanical prediction procedures when they retain autonomy in the decision‐making process. However, it remains largely unknown how different autonomy‐enhancing features affect predictive validity. Therefore, in two preregistered studies (total N = 342), we investigated if and how prediction procedures can be designed such that they satisfy decision makers' autonomy needs and acceptance without reducing predictive validity. Based on archival application data from a university admission procedure, participants predicted applicants' first‐year grade point average and chance of dropout. The results of Bayesian analyses showed that participants preferred prediction procedures in which they retained autonomy by choosing consistent predictor weights of a mechanical rule or by holistically adjusting the predictions of an optimal regression model. In general, these prediction procedures resulted in slightly higher predictive validity compared with fully holistic prediction. Providing participants with predictor validity information slightly increased predictive validity when participants could choose predictor weights but not when making holistic predictions or adjusting optimal model predictions. Giving decision makers a role in designing mechanical rules through choosing weights based on explicit predictive validity information could help promote the implementation and validity of mechanical prediction in practice.