Premium
Multistage Complexity in Language Proficiency Assessment: A Framework for Aligning Theoretical Perspectives, Test Development, and Psychometrics
Author(s) -
Luecht Richard M.
Publication year - 2003
Publication title -
foreign language annals
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.258
H-Index - 49
eISSN - 1944-9720
pISSN - 0015-718X
DOI - 10.1111/j.1944-9720.2003.tb02142.x
Subject(s) - construct (python library) , psychometrics , language proficiency , structuring , computer science , test (biology) , construct validity , language assessment , item response theory , process (computing) , test validity , psychology , natural language processing , mathematics education , programming language , developmental psychology , paleontology , finance , economics , biology
This article contends that the necessary links between constructs and test scores/decisions in language assessment must be established through principled design procedures that align three models: (1) a theoretical construct model; (2) a test development model; and (3) a psychometric scoring model. The theoretical construct model articulates the cognitive tasks, mechanisms, and ability constructs underlying language proficiency. The test development model focuses on developing formal mechanisms for structuring the design and development of the test problems (items and tasks) and for assembling the test as a whole. The psychometric scoring final model involves the use of psychometric modeling techniques capable of handling complex, multidimensional structures underlying the responses to a language proficiency assessment. The authors promote the need for modeling the complexity inherent in the process of defining constructs, designing and building problems and tests, and finally, scaling and scoring the instruments that assess language proficiency.