Premium
ITEM ANALYSIS FOR TEACHER‐MADE MASTERY TESTS 1
Author(s) -
CREHAN KEVIN D.
Publication year - 1974
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.1974.tb00997.x
Subject(s) - selection (genetic algorithm) , reliability (semiconductor) , psychology , test (biology) , statistics , item analysis , predictive validity , test validity , sample (material) , mathematics education , psychometrics , computer science , mathematics , artificial intelligence , paleontology , power (physics) , physics , chemistry , chromatography , quantum mechanics , biology
Various item selection techniques are compared on resultant criterionreferenced reliability and validity. Techniques compared include three nominal criterion‐referenced methods, a traditional point biserial selection, teacher selection, and random selection. Eighteen volunteer junior and senior high school teachers supplied behavioral objectives and item pools ranging from 26 to 40 items. Each teacher obtained reponses from four classes. Pairs of tests of various length were developed by each item selection method. Estimates of test reliability and validity were obtained using responses independent of the test construction sample. Resultant reliability and validity estimates were compared across item selection techniques. Two of the criterion‐referenced item selection methods resulted in consistently higher observed validity. However, the small magnitude of improvement over teacher or random selection raises a question as to whether the benefit warrants the necessary extra effort on the part of the classroom teacher.