Open AccessProDebNet: projector deblurring using a convolutional neural network
Author(s) -
Yuta Kageyama,
Mariko Isogawa,
Daisuke Iwai,
Kosuke Sato
Publication year - 2020
Publication title -
optics express
Language(s) - Uncategorized
Resource type - Journals
SCImago Journal Rank - 1.394
H-Index - 271
ISSN - 1094-4087
DOI - 10.1364/oe.396159
Subject(s) - deblurring , projection (relational algebra) , artificial intelligence , projector , computer science , computer vision , convolutional neural network , image restoration , image processing , image (mathematics) , optics , algorithm , physics
Projection blur can occur in practical use cases that have non-planar and/or multi-projection display surfaces with various scattering characteristics because the surface often causes defocus and subsurface scattering. To address this issue, we propose ProDebNet, an end-to-end real-time projection deblurring network that synthesizes a projection image to minimize projection blur. The proposed method generates a projection image without explicitly estimating any geometry or scattering characteristics of the projection screen, which makes real-time processing possible. In addition, ProDebNet does not require real captured images for training data; we design a "pseudo-projected" synthetic dataset that is well-generalized to real-world blur data. Experimental results demonstrate that the proposed ProDebNet compensates for two dominant types of projection blur, i.e., defocus blur and subsurface blur, significantly faster than the baseline method, even in a real-projection scene.