Open AccessDEALING WITH UNCERTAINTY ABOUT ITEM PARAMETERS: EXPECTED RESPONSE FUNCTIONS
Author(s) -
Mislevy Robert J.,
Wingersky Marilyn S.,
Sheehan Kathleen M.
Publication year - 1994
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.1994.tb01601.x
Subject(s) - item response theory , differential item functioning , pointwise , statistics , parametric statistics , econometrics , calibration , mathematics , psychology , psychometrics , mathematical analysis
It is a common practice in item response theory (IRT) to treat estimates of item parameters, say B , as if they were the known, true quantities, B. However, ignoring the uncertainty associated with item parameters can lead to biases and over‐confidence in subsequent inferences such as ability estimation, especially when item‐calibration samples are small. This paper demonstrates how to incorporate uncertainty about B with Lewis's “expected response functions” (ERFs), pointwise expected values of item response conditional on examinee proficiency averaged over posterior distributions of item parameters. This paper presents ERFs, outlines procedures for computing them and using them in practical work, and gives an illustration with data from the National Assessment of Educational Progress. Advantages of approximating ERFs response curves with members of familiar parametric families of IRT curves are noted.