Premium
18.2: Depth Sensing and Augmented Reality Technologies for Mobile 3D Platforms
Author(s) -
Yuan Chang,
Liao Miao,
Hu Xiaoyan,
Mordohai Philippos
Publication year - 2012
Publication title -
sid symposium digest of technical papers
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.351
H-Index - 44
eISSN - 2168-0159
pISSN - 0097-966X
DOI - 10.1002/j.2168-0159.2012.tb05756.x
Subject(s) - augmented reality , stereoscopy , computer science , computer vision , novelty , artificial intelligence , virtual reality , mixed reality , mobile device , depth map , depth perception , computer graphics (images) , image (mathematics) , perception , philosophy , theology , neuroscience , biology , operating system
This paper presents novel depth sensing and augmented reality technologies based on mobile 3D platforms. The mobile stereoscopic cameras are utilized to provide a “soft depth sensor” generating instant depth estimation of the physical world. The depth sensing algorithms are proposed to recover the 3D geometric structure captured in single or multiple stereoscopic images. Then, two augmented reality applications are developed to showcase the advantages of the depth sensing capability, namely visual measurement and a 3D AR shooter game. In particular, the AR technology allows occlusion between physical and virtual objects. Both visual and quantitative results are shown to illustrate the novelty and effectiveness of the proposed algorithms.