Premium
Expression Packing: As‐Few‐As‐Possible Training Expressions for Blendshape Transfer
Author(s) -
Carrigan E.,
Zell E.,
Guiard C.,
McDonnell R.
Publication year - 2020
Publication title -
computer graphics forum
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.578
H-Index - 120
eISSN - 1467-8659
pISSN - 0167-7055
DOI - 10.1111/cgf.13925
Subject(s) - computer science , semantics (computer science) , set (abstract data type) , personalization , expression (computer science) , facial expression , transfer (computing) , artificial intelligence , face (sociological concept) , pattern recognition (psychology) , programming language , parallel computing , social science , sociology , world wide web
To simplify and accelerate the creation of blendshape rigs, using a template rig is a common procedure, especially during the creation of digital doubles. Blendshape transfer methods facilitate copy and paste functionality of the blendshapes from the template model to the digital double. However, for adequate personalization, such methods require a set of scanned training expressions of the original actor. So far, the semantics of the facial expressions to scan have been defined manually. In contrast, we formulate the semantics of the facial expressions as an integer optimization of the blendshape weights. By combining different blendshapes of the template model, our method creates facial expressions that serve as semantic references during scanning. Our method guarantees to compute as‐few‐as‐possible training expressions with minimal overlap of activated blendshapes. If the number of training expressions is limited, blendshapes are selected based on their power to personalize the resulting blendshapes compared to generic blendshape transfer methods.