Premium
Estimating Average Domain Scores
Author(s) -
Pommerich Mary,
Nicewander W. Alan,
Hanson Bradley A.
Publication year - 1999
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.1999.tb00554.x
Subject(s) - statistics , item response theory , consistency (knowledge bases) , domain (mathematical analysis) , mathematics , estimation , item analysis , group (periodic table) , econometrics , psychometrics , mathematical analysis , chemistry , geometry , management , organic chemistry , economics
A simulation study was performed to determine whether a group's average percent correct in a content domain could be accurately estimated for groups taking a single test form and not the entire domain of items. Six Item Response Theory based domain score estimation methods were evaluated, under conditions of few items per content area perform taken, small domains, and small group sizes. The methods used item responses to a single form taken to estimate examinee or group ability; domain scores were then computed using the ability estimates and domain item characteristics. The IRT‐based domain score estimates typically showed greater accuracy and greater consistency across forms taken than observed performance on the form taken. For the smallest group size and least number of items taken, the accuracy of most IRT‐based estimates was questionable; however, a procedure that operates on an estimated distribution of group ability showed promise under most conditions.