Premium
Guess Where: The Position of Correct Answers in Multiple‐Choice Test Items as a Psychometric Variable
Author(s) -
Attali Yigal,
BarHillel Maya
Publication year - 2003
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.2003.tb01099.x
Subject(s) - test (biology) , multiple choice , psychology , variable (mathematics) , item response theory , item analysis , psychometrics , position (finance) , statistics , social psychology , mathematics , clinical psychology , significant difference , paleontology , mathematical analysis , finance , economics , biology
In this article, the authors show that test makers and test takers have a strong and systematic tendency for hiding correct answers—or, respectively, for seeking them—in middle positions. In single, isolated questions, both prefer middle positions to extreme ones in a ratio of up to 3 or 4 to 1. Because test makers routinely, deliberately, and excessively balance the answer key of operational tests, middle bias almost, though not quite, disappears in those keys. Examinees taking real tests also produce answer sequences that are more balanced than their single question tendencies but less balanced than the correct key. In a typical four‐choice test, about 55% of erroneous answers are in the two central positions. The authors show that this bias is large enough to have real psychometric consequences, as questions with middle correct answers are easier and less discriminating than questions with extreme correct answers, a fact of which some implications are explored.