Open AccessMULTIMODAL COMPLEX EMOTIONS: GESTURE EXPRESSIVITY AND BLENDED FACIAL EXPRESSIONS
Author(s) -
JeanClaude Martin,
Radosław Niewiadomski,
Laurence Devillers,
Stéphanie Buisine,
Catherine Pélachaud
Publication year - 2006
Publication title -
international journal of humanoid robotics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.3
H-Index - 33
eISSN - 1793-6942
pISSN - 0219-8436
DOI - 10.1142/s0219843606000825
Subject(s) - gesture , computer science , facial expression , embodied cognition , modalities , human–computer interaction , representation (politics) , mnemonic , multimodal interaction , natural language processing , expressivity , annotation , relation (database) , dialog system , artificial intelligence , dialog box , cognitive psychology , psychology , database , biology , political science , social science , law , sociology , genetics , politics , world wide web
One of the challenges of designing virtual humans is the definition of appropriate models of the relation between realistic emotions and the coordination of behaviors in several modalities. In this paper, we present the annotation, representation and modeling of multimodal visual behaviors occurring during complex emotions. We illustrate our work using a corpus of TV interviews. This corpus has been annotated at several levels of information: communicative acts, emotion labels, and multimodal signs. We have defined a copy-synthesis approach to drive an Embodied Conversational Agent from these different levels of information. The second part of our paper focuses on a model of complex (superposition and masking of) emotions in facial expressions of the agent. We explain how the complementary aspects of our work on corpus and computational model is used to specify complex emotional behaviors
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom