Premium
Modeling Data From Collaborative Assessments: Learning in Digital Interactive Social Networks
Author(s) -
Wilson Mark,
Gochyyev Perman,
Scalise Kathleen
Publication year - 2017
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/jedm.12134
Subject(s) - set (abstract data type) , computer science , collaborative learning , test (biology) , digital literacy , mathematics education , cognitive skill , psychology , field (mathematics) , cognition , world wide web , mathematics , paleontology , neuroscience , biology , programming language , pure mathematics
This article summarizes assessment of cognitive skills through collaborative tasks, using field test results from the Assessment and Teaching of 21st Century Skills (ATC21S) project. This project, sponsored by Cisco, Intel, and Microsoft, aims to help educators around the world enable students with the skills to succeed in future career and college goals. In this article, ATC21S collaborative assessments focus on the project's “ICT Literacy—Learning in digital networks” learning progression. The article includes a description of the development of the learning progression, as well as examples and the logic behind the instrument construction. Assessments took place in random pairs of students in a demonstration digital environment. Modeling of results employed unidimensional and multidimensional item response models, with and without random effects for groups. The results indicated that, based on this data set, the models that take group into consideration in both the unidimensional and the multidimensional analyses fit better. However, the group‐level variances were substantially higher than the individual‐level variances. This indicates that a total individual estimate of group plus individual is likely a more informative estimate than individual alone but also that the performances of the pairs dominated the performances of the individuals. Implications are discussed in the results and conclusions.