Premium
Learning Scene Illumination by Pairwise Photos from Rear and Front Mobile Cameras
Author(s) -
Cheng Dachuan,
Shi Jian,
Chen Yanyun,
Deng Xiaoming,
Zhang Xiaopeng.
Publication year - 2018
Publication title -
computer graphics forum
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.578
H-Index - 120
eISSN - 1467-8659
pISSN - 0167-7055
DOI - 10.1111/cgf.13561
Subject(s) - computer science , artificial intelligence , computer vision , rendering (computer graphics) , pairwise comparison , high dynamic range , computer graphics (images) , convolutional neural network , computer graphics , mobile device , augmented reality , deep learning , dynamic range , operating system
Illumination estimation is an essential problem in computer vision, graphics and augmented reality. In this paper, we propose a learning based method to recover low‐frequency scene illumination represented as spherical harmonic (SH) functions by pairwise photos from rear and front cameras on mobile devices. An end‐to‐end deep convolutional neural network (CNN) structure is designed to process images on symmetric views and predict SH coefficients. We introduce a novel Render Loss to improve the rendering quality of the predicted illumination. A high quality high dynamic range (HDR) panoramic image dataset was developed for training and evaluation. Experiments show that our model produces visually and quantitatively superior results compared to the state‐of‐the‐arts. Moreover, our method is practical for mobile‐based applications.