Premium
Criterion‐Related Validity: Assessing the Value of Subscores
Author(s) -
Davison Mark L.,
Davenport Ernest C.,
Chang YuFeng,
Vue Kory,
Su Shiyang
Publication year - 2015
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/jedm.12081
Subject(s) - statistics , reliability (semiconductor) , optimal distinctiveness theory , variance (accounting) , criterion validity , psychology , mathematics , econometrics , psychometrics , social psychology , construct validity , power (physics) , physics , accounting , quantum mechanics , business
Criterion‐related profile analysis (CPA) can be used to assess whether subscores of a test or test battery account for more criterion variance than does a single total score. Application of CPA to subscore evaluation is described, compared to alternative procedures, and illustrated using SAT data. Considerations other than validity and reliability are discussed, including broad societal goals (e.g., affirmative action), fairness, and ties in expected criterion predictions. In simulation data, CPA results were sensitive to subscore correlations, sample size, and the proportion of criterion‐related variance accounted for by the subscores. CPA can be a useful component in a thorough subscore evaluation encompassing subscore reliability, validity, distinctiveness, fairness, and broader societal goals.