Premium
Improved Test–retest Reliability Criteria as Applied to Probability Assessments
Author(s) -
CURLEY SHAWN P.,
GOLDEN JAMES I.
Publication year - 1996
Publication title -
journal of behavioral decision making
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.136
H-Index - 76
eISSN - 1099-0771
pISSN - 0894-3257
DOI - 10.1002/(sici)1099-0771(199612)9:4<291::aid-bdm233>3.0.co;2-7
Subject(s) - statistics , reliability (semiconductor) , consistency (knowledge bases) , centrality , variance (accounting) , econometrics , test (biology) , psychology , regression , mathematics , computer science , artificial intelligence , paleontology , power (physics) , physics , accounting , quantum mechanics , business , biology
Test–retest reliability is a common indicator of response consistency. It is argued that using regression coefficients for detecting systematic response error is less appropriate than testing for shifts in the mean (median) and variance. This procedure is exemplified using probability response data. For this data, shifts in centrality were found to be about 2.5 times more likely than shifts in variability. The shifts in centrality did not favor any particular direction; however, variability tended to decrease over time in early sessions.