Open AccessA BRIEF INTRODUCTION TO EVIDENCE‐CENTERED DESIGN
Author(s) -
Mislevy Robert J.,
Almond Russell G.,
Lukas Janice F.
Publication year - 2003
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.2003.tb01908.x
Subject(s) - terminology , computer science , unobservable , item response theory , process (computing) , educational assessment , class (philosophy) , concept inventory , artificial intelligence , management science , mathematics education , psychology , psychometrics , mathematics , econometrics , programming language , clinical psychology , philosophy , linguistics , economics
Evidence‐centered assessment design (ECD) is an approach to constructing educational assessments in terms of evidentiary arguments. This paper provides an introduction to the basic ideas of ECD, as well as some of the terminology and models that have been developed to implement the approach. In particular, it presents the high‐level models of the Conceptual Assessment Framework (CAF) and the Four‐process Delivery Architecture for assessment delivery systems. Special attention is given to the role of probability‐based reasoning in accumulating evidence across task performances, in terms of belief about unobservable variables that characterize the knowledge, skills, and/or abilities of students. This is the role traditionally associated with psychometric models, such as those of item response theory (IRT) and latent class models. To unify the ideas and to provide a foundation for extending probability‐based reasoning in assessment applications more broadly, however, a more general expression in terms of graphical models is indicated. This brief overview of evidence‐centered design provides the reader with a feel for where and how graphical models fit into the larger enterprise of educational and psychological assessment. A simple example based on familiar large‐scale standardized tests such as the Graduate Record Examinations ® (GRE ® ) is used to fix ideas.