Premium
As‐consistent‐As‐possible compositing of virtual objects and video sequences
Author(s) -
Zhang Guofeng,
Qin Xueying,
An Xiaobo,
Chen Wei,
Bao Hujun
Publication year - 2006
Publication title -
computer animation and virtual worlds
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.225
H-Index - 49
eISSN - 1546-427X
pISSN - 1546-4261
DOI - 10.1002/cav.134
Subject(s) - computer science , compositing , computer vision , artificial intelligence , robustness (evolution) , computer graphics (images) , video tracking , animation , object (grammar) , image (mathematics) , biochemistry , chemistry , gene
We present an efficient approach that merges the virtual objects into video sequences taken by a freely moving camera in a realistic manner. The composition is visually and geometrically consistent through three main steps. First, a robust camera tracking algorithm based on key frames is proposed, which precisely recovers the focal length with a novel multi‐frame strategy. Next, the concerned 3D models of the real scenes are reconstructed by means of an extended multi‐baseline algorithm. Finally, the virtual objects in the form of 3D models are integrated into the real scenes, with special cares on the interaction consistency including shadow casting, occlusions, and object animation. A variety of experiments have been implemented, which demonstrate the robustness and efficiency of our approach. Copyright © 2006 John Wiley & Sons, Ltd.