Premium
Live accurate and dense reconstruction from a handheld camera
Author(s) -
Chen Yadang,
Hao Chuanyan,
Cai Zhongmou,
Wu Wen,
Wu Enhua
Publication year - 2013
Publication title -
computer animation and virtual worlds
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.225
H-Index - 49
eISSN - 1546-427X
pISSN - 1546-4261
DOI - 10.1002/cav.1508
Subject(s) - computer science , polygon mesh , computer vision , mobile device , artificial intelligence , computer graphics (images) , graphics processing unit , camera resectioning , computer graphics , graphics , frame rate , 3d reconstruction , operating system
We present a method to make an accurate and dense reconstruction from the input of video captured by a free moving handheld camera in real time. By the method firstly, the positions of the camera and sparse 3D points are estimated by simultaneous localization mapping. Then the depth maps of selected reference frames are computed from corresponding camera bundles. Lastly a novel linear algorithm is also proposed to integrate all the depth maps into dense meshes partially. The main contributions of this paper are in the following points: the reference frames and corresponding camera bundles are able to be selected automatically, then accurate and smooth depth maps are generated in real time, and the depth maps are merged into a dense mesh by using a linear algorithm based on the error clouds optimization. Our algorithm is implemented on dual CPU and graphics processing unit in a parallel framework for improving the performance. Copyright © 2013 John Wiley & Sons, Ltd.