Open AccessAUTOMATED SCORING OF SPONTANEOUS SPEECH USING SPEECHRATER SM V1.0
Author(s) -
Xi Xiaoming,
Higgins Derrick,
Zechner Klaus,
Williamson David M.
Publication year - 2008
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.2008.tb02148.x
Subject(s) - computer science , context (archaeology) , test of english as a foreign language , natural language processing , test (biology) , construct validity , language assessment , construct (python library) , quality (philosophy) , artificial intelligence , psychology , mathematics education , psychometrics , programming language , developmental psychology , paleontology , philosophy , epistemology , biology
This report presents the results of a research and development effort for SpeechRater SM Version 1.0 (v1.0), an automated scoring system for the spontaneous speech of English language learners used operationally in the Test of English as a Foreign Language™ (TOEFL®) Practice Online assessment (TPO). The report includes a summary of the validity considerations and analyses that drive both the development and the evaluation of the quality of automated scoring. These considerations include perspectives on the construct of interest, the context of use, and the empirical performance of the SpeechRater in relation to both the human scores and the intended use of the scores. The outcomes of this work have implications for short‐ and long‐term goals for iterative improvements to SpeechRater scoring.