Premium
Estimation of Classification Consistency When the Probability of a Correct Response Varies
Author(s) -
Spray Judith A.,
Welch Catherine J.
Publication year - 1990
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.1990.tb00731.x
Subject(s) - statistics , consistency (knowledge bases) , estimation , test (biology) , affect (linguistics) , internal consistency , psychology , mathematics , econometrics , item response theory , psychometrics , paleontology , geometry , management , communication , economics , biology
The purpose of this study was to examine the effect that large, within‐examinee item difficulty variability had on estimates of the proportion of consistent classification of examinees into mastery categories over two test administrations. The classification consistency estimate was based on a single test administration from an estimation procedure suggested by Subkoviak (1976). Analyses of simulated data revealed that the use of a single estimate for an examinee's probability of a correct response, even when that probability varied greatly within a test for an examinee, did not affect the estimation of the proportion of consistent classifications.