Premium
Applying the Mantel‐Haenszel Procedure to Complex Samples of Items
Author(s) -
Allen Nancy L.,
Donoghue John R.
Publication year - 1996
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.1996.tb00491.x
Subject(s) - differential item functioning , item response theory , statistics , matching (statistics) , block (permutation group theory) , logistic regression , psychology , item analysis , sampling (signal processing) , odds , psychometrics , computer science , mathematics , geometry , filter (signal processing) , computer vision
This Monte Carlo study examined the effect of complex sampling of items on the measurement of differential item functioning (DIF) using the Mantel‐Haenszel procedure. Data were generated using a 3‐parameter logistic item response theory model according to the balanced incomplete block (BIB) design used in the National Assessment of Educational Progress (NAEP). The length of each block of items and the number of DIF items in the matching variable were varied, as was the difficulty, discrimination, and presence of DIF in the studied item. Block, booklet, pooled booklet, and extra‐information analyses were compared to a complete data analysis using the transformed log‐odds on the delta scale. The pooled booklet approach is recommended for use when items are selected for examinees according to a BIB design. This study has implications for DIF analyses of other complex samples of items, such as computer administered testing or another complex assessment design.