Premium
Affordances of Item Formats and Their Effects on Test‐Taker Cognition under Uncertainty
Author(s) -
Moon Jung Aa,
Keehner Madeleine,
Katz Irvin R.
Publication year - 2018
Publication title -
educational measurement: issues and practice
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.158
H-Index - 52
eISSN - 1745-3992
pISSN - 0731-1745
DOI - 10.1111/emip.12229
Subject(s) - affordance , test (biology) , cognition , computer science , cognitive psychology , psychology , scale (ratio) , grid , social psychology , mathematics , paleontology , physics , geometry , quantum mechanics , neuroscience , biology
The current study investigated how item formats and their inherent affordances influence test‐takers’ cognition under uncertainty. Adult participants solved content‐equivalent math items in multiple‐selection multiple‐choice and four alternative grid formats. The results indicated that participants’ affirmative response tendency (i.e., judge the given information as True) was affected by the presence of a grid, type of grid options, and their visual layouts. The item formats further affected the test scores obtained from the alternatives keyed True and the alternatives keyed False, and their psychometric properties. The current results suggest that the affordances rendered by item design can lead to markedly different test‐taker behaviors and can potentially influence test outcomes. They emphasize that a better understanding of the cognitive implications of item formats could potentially facilitate item design decisions for large‐scale educational assessments.