Premium
Sensitivity of Linkings Between AP Multiple‐Choice Scores and Composite Scores to Geographical Region: An Illustration of Checking for Population Invariance
Author(s) -
Yang WenLing
Publication year - 2004
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.2004.tb01157.x
Subject(s) - invariant (physics) , measurement invariance , statistics , mathematics , composite index , psychology , population , sample (material) , econometrics , mathematics education , demography , confirmatory factor analysis , structural equation modeling , composite indicator , chemistry , chromatography , sociology , mathematical physics
This application study investigates whether the multiple‐choice to composite linking functions that determine Advanced Placement Program exam grades remain invariant over subgroups defined by region. Three years of test data from an AP exam are used to study invariance across regions. The study focuses on two questions: (a) How invariant are grade thresholds across regions? and (b) Do the small sample sizes for some regional groups present particular problems for assessing thresholds invariance? The equatability index proposed by Dorans and Holland (2000) is employed to evaluate the invariance of the linking functions, and cross‐classification is used to evaluate the invariance of the composite cut scores. Overall, the linkings across regions seem to hold up reasonably well. Nevertheless, more exams need to be examined.