Premium
Facial performance illumination transfer from a single video using interpolation in non‐skin region
Author(s) -
Wu Hongyu,
Chen Xiaowu,
Yang Mengxia,
Fang Zhihong
Publication year - 2013
Publication title -
computer animation and virtual worlds
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.225
H-Index - 49
eISSN - 1546-427X
pISSN - 1546-4261
DOI - 10.1002/cav.1519
Subject(s) - computer science , computer vision , artificial intelligence , key (lock) , reference frame , key frame , face (sociological concept) , filter (signal processing) , consistency (knowledge bases) , interpolation (computer graphics) , frame (networking) , component (thermodynamics) , image (mathematics) , telecommunications , social science , physics , computer security , sociology , thermodynamics
This paper proposes a novel video‐based method to transfer the illumination from a single reference facial performance video to a target one taken under nearly uniform illumination. We first filter the key frames of the reference and the target face videos with an edge‐preserving filter. Then, the illumination component of reference key frame is extracted through dividing the filtered reference key frames by the corresponding filtered target key frames in skin region. The differences in non‐skin region caused by different expressions between the reference and target face may bring about artifacts. Therefore, we interpolate the illumination component of the non‐skin region by that of the surrounded skin region to ensure the spatial smoothness and consistency. After that, the illumination components of key frames are propagated to non‐key frames to ensure the temporal consistency between the two adjacent frames. We obtain convincing results by transferring the illumination effects of a single reference facial performance video to a target one with the spatial and temporal consistencies preserved. Copyright © 2013 John Wiley & Sons, Ltd.