Premium
A Comparison of Alternative Matching Strategies for DIF Detection in Tests That Are Multidimensional
Author(s) -
Clauser Brian E.,
Nungester Ronald J.,
Mazor Kathleen,
Ripkey Douglas
Publication year - 1996
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.1996.tb00489.x
Subject(s) - matching (statistics) , differential item functioning , test (biology) , statistics , test score , multivariate statistics , item response theory , psychology , psychometrics , mathematics , standardized test , paleontology , biology
Most currently accepted approaches for identifying differentially functioning test items compare performance across groups after first matching examinees on the ability of interest. The typical basis for this matching is the total test score. Previous research indicates that when the test is not approximately unidimensional, matching using the total test score may result in an inflated Type I error rate. This study compares the results of differential item functioning (DIF) analysis with matching based on the total test score, matching based on subtest scores, or multivariate matching using multiple subtest scores. Analysis of both actual and simulated data indicate that for the dimensionally complex test examined in this study, using the total test score as the matching criterion is inappropriate. The results suggest that matching on multiple subtest scores simultaneously may be superior to using either the total test score or individual relevant subtest scores.