Learned large field-of-view imaging with thin-plate optics
Author(s) -
Yifan Peng,
Qilin Sun,
Xiong Dun,
Gordon Wetzstein,
Wolfgang Heidrich,
Felix Heide
Publication year - 2019
Publication title -
acm transactions on graphics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.153
H-Index - 218
eISSN - 1557-7368
pISSN - 0730-0301
DOI - 10.1145/3355089.3356526
Subject(s) - computer science , lens (geology) , field of view , optics , artificial intelligence , computer vision , depth of field , image quality , thin lens , pinhole (optics) , physics , image (mathematics)
Typical camera optics consist of a system of individual elements that are designed to compensate for the aberrations of a single lens. Recent computational cameras shift some of this correction task from the optics to post-capture processing, reducing the imaging optics to only a few optical elements. However, these systems only achieve reasonable image quality by limiting the field of view (FOV) to a few degrees - effectively ignoring severe off-axis aberrations with blur sizes of multiple hundred pixels.In this paper, we propose a lens design and learned reconstruction architecture that lift this limitation and provide an order of magnitude increase in field of view using only a single thin-plate lens element. Specifically, we design a lens to produce spatially shift-invariant point spread functions, over the full FOV, that are tailored to the proposed reconstruction architecture. We achieve this with a mixture PSF, consisting of a peak and and a low-pass component, which provides residual contrast instead of a small spot size as in traditional lens designs. To perform the reconstruction, we train a deep network on captured data from a display lab setup, eliminating the need for manual acquisition of training data in the field. We assess the proposed method in simulation and experimentally with a prototype camera system.We compare our system against existing single-element designs, including an aspherical lens and a pinhole, and we compare against a complex multielement lens, validating high-quality large field-of-view (i.e. 53°) imaging performance using only a single thin-plate element.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom