Premium
Correcting for Guessing Increases Validity in Multiple‐Choice Examinations in an Oral and Maxillofacial Pathology Course
Author(s) -
Prihoda Thomas J.,
Pinckard R. Neal,
McMahan C. Alex,
Jones Anne Cale
Publication year - 2006
Publication title -
journal of dental education
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.53
H-Index - 68
eISSN - 1930-7837
pISSN - 0022-0337
DOI - 10.1002/j.0022-0337.2006.70.4.tb04092.x
Subject(s) - intraclass correlation , multiple choice , test (biology) , weighting , medicine , correlation , statistics , psychology , medical physics , mathematics , dentistry , radiology , psychometrics , significant difference , paleontology , geometry , biology
A standard correction for random guessing on multiple‐choice examinations was examined retrospectively in an oral and maxillofacial pathology course for second‐year dental students. The correction was a weighting formula for points awarded for correct answers, incorrect answers, and unanswered questions such that the expected value of the increase in test score due to guessing was zero. We compared uncorrected and corrected scores on examinations using a multiple‐choice format with scores on examinations composed of short‐answer questions. The short‐answer format eliminated or at least greatly reduced the potential for guessing the correct answer. Agreement of corrected multiple‐choice scores with short‐answer scores (intraclass correlation coefficient 0.78) was significantly (p=0.015) higher than agreement of uncorrected multiple‐choice scores with short‐answer scores (intraclass correlation coefficient 0.71). The higher agreement indicated increased validity for the corrected multiple‐choice examination.