Premium
Embodiment analytics of practicing teachers in a virtual immersive environment
Author(s) -
Barmaki Roghayeh,
Hughes Charles E.
Publication year - 2018
Publication title -
journal of computer assisted learning
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.583
H-Index - 93
eISSN - 1365-2729
pISSN - 0266-4909
DOI - 10.1111/jcal.12268
Subject(s) - gesture , computer science , nonverbal communication , modalities , context (archaeology) , learning analytics , human–computer interaction , multimedia , haptic technology , virtual reality , virtual machine , reflection (computer programming) , eye tracking , psychology , simulation , data science , artificial intelligence , communication , paleontology , operating system , social science , sociology , programming language , biology
Abstract Interactive training environments typically include feedback mechanisms designed to help trainees improve their performance through either guided or self‐reflection. In this context, trainees are candidate teachers who need to hone their social skills for their future classroom. We chose an interactive virtual training system as the basic research environment to investigate the embodiment of the trainees. Using tracking sensors and improvements for existing gesture recognition utilities, we created a gesture database and used it for the implementation of our real‐time feedback application. We also investigated multiple modalities of feedback including visual and haptics. This paper describes the context in which the utilities have been developed, the importance of recognizing nonverbal communication in the teaching context, the means of providing automated feedback associated with nonverbal messaging, and a series of preliminary studies developed to inform the research. Results from the conducted studies indicate the positive impact of the proposed feedback application.