Open AccessPSYCHOMETRIC AND COGNITIVE ANALYSIS AS A BASIS FOR THE DESIGN AND REVISION OF QUANTITATIVE ITEM MODELS
Author(s) -
Graf Edith Aurora,
Peterson Stephen,
Steffen Manfred,
Lawless René
Publication year - 2005
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.2005.tb02002.x
Subject(s) - item response theory , cognition , psychology , basis (linear algebra) , item analysis , psychometrics , cognitive psychology , computer science , mathematics , clinical psychology , neuroscience , geometry
We describe the item modeling development and evaluation process as applied to a quantitative assessment with high‐stakes outcomes. In addition to expediting the item‐creation process, a model‐based approach may reduce pretesting costs, if the difficulty and discrimination of model‐generated items may be predicted to a predefined level of accuracy. The development and evaluation of item models represents a collaborative effort among content specialists, statisticians, and cognitive scientists. A cycle for developing and revising item models that generate items with more predictable statistics is described. We review the goals of item modeling from different perspectives and recommend a method for structuring families of models that span content and generate items with more predictable psychometric parameters.