Open AccessPsychometric Considerations and a General Scoring Strategy for Assessments of Collaborative Problem Solving
Author(s) -
Hao Jiangang,
Liu Lei,
Kyllonen Patrick,
Flor Michael,
Davier Alina A.
Publication year - 2019
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/ets2.12276
Subject(s) - set (abstract data type) , computer science , scale (ratio) , item response theory , psychometrics , empirical examination , educational assessment , psychometric testing , applied psychology , management science , psychology , mathematics education , clinical psychology , physics , internal consistency , quantum mechanics , economics , programming language , classical economics
Collaborative problem solving (CPS) is an important 21st‐century skill that is crucial for both career and academic success. However, developing a large‐scale and standardized assessment of CPS that can be administered on a regular basis is very challenging. In this report, we introduce a set of psychometric considerations and a general scoring strategy around assessing CPS, summarized based on the results of the extensive empirical studies we conducted at Educational Testing Service (ETS) over the past 6 years. Using the ETS Collaborative Science Assessment Prototype as an example, we show how these psychometric considerations have been incorporated into the development of the assessment prototype and how the scoring strategy has been implemented.