Premium
Multilevel Modeling of Item Position Effects
Author(s) -
Albano Anthony D.
Publication year - 2013
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/jedm.12026
Subject(s) - item response theory , differential item functioning , position (finance) , equating , context (archaeology) , test (biology) , multilevel model , econometrics , psychology , statistics , psychometrics , mathematics , rasch model , paleontology , finance , biology , economics
In many testing programs it is assumed that the context or position in which an item is administered does not have a differential effect on examinee responses to the item. Violations of this assumption may bias item response theory estimates of item and person parameters. This study examines the potentially biasing effects of item position. A hierarchical generalized linear model is formulated for estimating item‐position effects. The model is demonstrated using data from a pilot administration of the GRE wherein the same items appeared in different positions across the test form. Methods for detecting and assessing position effects are discussed, as are applications of the model in the contexts of test development and item analysis.