English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Tools annual

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Tools monthly

Global: Zendy Plus monthly

Presents the access of premium content as premium feature

Premium Content

Global: Zendy Plus annual

Global: Zendy Free Plan

Images captured through glass are usually contaminated by reflections, and the removal of them from images is a challenging task. Since the primary concern on photos is face, the face images with reflections annoy viewers severely. In this paper, we propose a face reflection removal network using multispectral fusion of color (RGB) and near infrared (NIR) images, called FRRN. Due to the different spectral wavelengths of visible light [380nm, 780nm] and near infrared [780nm, 2526nm], NIR cameras are not sensitive to the visible light and thus NIR images are less corrupted by reflections. NIR images preserve structure information well and can guide the restoration process from reflections on the RGB images. Thus, we adopt multispectual fusion of RGB and NIR images for reflection removal from a face image. FRRN consists of one encoder model (contextual encoder model (CEM)) and two decoder models (NIR inference decoder model (NIDM) and image inference decoder model (IIDM)). CEM captures features from shallow to deep layers on the scene information while suppressing the sparse reflection component. NIDM infers NIR image to facilitate multi-scale guidance for reflection removal, while IIDM estimates the transmission layer with the guidance of NIDM. Besides, we present the reflection confidence generation module (RCGM) based on Laplacian convolution and channel attention-based residual block (CARB) to represent the reflection confidence in a region for reflection removal. To train FRRN, we construct a large-scale training dataset with face image and reflection layer (RGB and NIR images) and its corresponding test dataset using JAI AD-130 GE camera. Various experiments demonstrate that FRRN outperforms state-of-the-art methods for reflection removal in terms of visual quality and quantitative measurements.

Face Reflection Removal Network Using Multispectral Fusion of RGB and NIR Images