Open AccessCPS‐Rater: Automated Sequential Annotation for Conversations in Collaborative Problem‐Solving Activities
Author(s) -
Hao Jiangang,
Chen Lei,
Flor Michael,
Liu Lei,
von Davier Alina A.
Publication year - 2017
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/ets2.12184
Subject(s) - annotation , conditional random field , computer science , dependency (uml) , conversation , field (mathematics) , artificial intelligence , natural language processing , human–computer interaction , psychology , mathematics , communication , pure mathematics
Conversations in collaborative problem‐solving activities can be used to probe the collaboration skills of the team members. Annotating the conversations into different collaboration skills by human raters is laborious and time consuming. In this report, we report our work on developing an automated annotation system, CPS‐rater, for conversational data from collaborative activities. The linear chain conditional random field method is used to model the sequential dependencies between the turns of the conversations, and the resulting automated annotation system outperforms those systems that do not model the sequential dependency.