Premium
Standard setting for progress tests: combining external and internal standards
Author(s) -
Ricketts Chris,
Freeman Adrian C,
Coombes Lee R
Publication year - 2009
Publication title -
medical education
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.776
H-Index - 138
eISSN - 1365-2923
pISSN - 0308-0110
DOI - 10.1111/j.1365-2923.2009.03372.x
Subject(s) - normative , graduation (instrument) , grading (engineering) , test (biology) , medical education , set (abstract data type) , computer science , medical physics , medicine , mathematics , engineering , paleontology , philosophy , civil engineering , geometry , epistemology , biology , programming language
Objectives There has been little work on standard setting for progress tests and it is common practice to use normative standards. This study aimed to develop a new approach to standard setting for progress tests administered at the point when students approach graduation. Methods In this study we obtained performance data from newly qualified doctors and used this information to set the standard for the last progress test in the final year of undergraduate medical education. This external reference was validated against projections of student performance data based upon normative grading, and other published results. A simple linear growth model was used to set pass scores for progress tests earlier in the final year and this was also validated by published data. Results There was good agreement between standards set using the data from newly qualified doctors, the standard expected from extrapolation of the student progression data, and published performance data from another medical school. Conclusions We have demonstrated that a combination of data from independent sources can be used to triangulate standard‐setting decisions for progress tests. Performance data from successive cohorts of medical students could provide a fruitful source of information for standard setting for progress tests.