Premium
Proxy‐guided Image‐based Rendering for Mobile Devices
Author(s) -
Reinert Bernhard,
Kopf Johannes,
Ritschel Tobias,
Cuervo Eduardo,
Chu David,
Seidel HansPeter
Publication year - 2016
Publication title -
computer graphics forum
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.578
H-Index - 120
eISSN - 1467-8659
pISSN - 0167-7055
DOI - 10.1111/cgf.13032
Subject(s) - computer science , rendering (computer graphics) , computer graphics (images) , mobile device , tiled rendering , 3d rendering , real time rendering , software rendering , computer vision , image based modeling and rendering , artificial intelligence , computer graphics , 3d computer graphics , operating system
VR headsets and hand‐held devices are not powerful enough to render complex scenes in real‐time. A server can take on the rendering task, but network latency prohibits a good user experience. We present a new image‐based rendering (IBR) architecture for masking the latency. It runs in real‐time even on very weak mobile devices, supports modern game engine graphics, and maintains high visual quality even for large view displacements. We propose a novel server‐side dual‐view representation that leverages an optimally‐placed extra view and depth peeling to provide the client with coverage for filling disocclusion holes. This representation is directly rendered in a novel wide‐angle projection with favorable directional parameterization. A new client‐side IBR algorithm uses a pre‐transmitted level‐of‐detail proxy with an encaging simplification and depth‐carving to maintain highly complex geometric detail. We demonstrate our approach with typical VR / mobile gaming applications running on mobile hardware. Our technique compares favorably to competing approaches according to perceptual and numerical comparisons.