Premium
RELIABILITY OF CRITERION‐REFERENCED TESTS: A DECISION‐THEORETIC FORMULATION
Author(s) -
SWAMINATHAN H.,
HAMBLETON RONALD K.,
ALGINA JAMES
Publication year - 1974
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.1974.tb00998.x
Subject(s) - reliability (semiconductor) , test (biology) , criterion referenced test , consistency (knowledge bases) , criterion validity , statistics , measure (data warehouse) , mathematics , psychology , internal consistency , reliability engineering , computer science , econometrics , psychometrics , data mining , standardized test , artificial intelligence , engineering , paleontology , power (physics) , physics , quantum mechanics , biology
It has been suggested that the primary purpose for criterion‐referenced testing in objective‐based instructional programs is to classify examinees into mastery states or categories on the objectives included in the test. We have proposed that the reliability of the criterion‐referenced test scores be defined in terms of the consistency of the decision‐making process across repeated administrations of the test. Specifically, reliability is defined as a measure of agreement over and above that which can be expected by chance between the decisions made about examinee mastery states in repeated test administrations for each objective measured by the criterion‐referenced test.