Premium
TOWARD AN INTEGRATION OF THEORY AND METHOD FOR CRITERION‐REFERENCED TESTS 1, 2
Author(s) -
HAMBLETON RONALD K.,
NOVICK MELVIN R.
Publication year - 1973
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.1973.tb00793.x
Subject(s) - criterion referenced test , bayesian probability , bayesian information criterion , reliability (semiconductor) , criterion validity , computer science , test (biology) , decision theory , test theory , norm referenced test , mathematics , statistics , artificial intelligence , psychometrics , construct validity , standardized test , paleontology , power (physics) , physics , quantum mechanics , biology
In this paper, an attempt has been made to synthesize some of the current thinking in the area of criterion‐referenced testing as well as to provide the beginning of an integration of theory and method for such testing. Since criterion‐referenced testing is viewed from a decision‐theoretic point of view, approaches to reliability and validity estimation consistent with this philosophy are suggested. Also, to improve the decision‐making accuracy of criterion‐referenced tests, a Bayesian procedure for estimating true mastery scores has been proposed. This Bayesian procedure uses information about other members of a student's group (collateral information), but the resulting estimation is still criterion referenced rather than norm referenced in that the student is compared to a standard rather than to other students. In theory, the Bayesian procedure increases the “effective length” of the test by improving the reliability, the validity, and more importantly, the decision‐making accuracy of the criterion‐referenced test scores.