Premium
Appearance Harmonization for Single Image Shadow Removal
Author(s) -
Ma LiQian,
Wang Jue,
Shechtman Eli,
Sunkavalli Kalyan,
Hu ShiMin
Publication year - 2016
Publication title -
computer graphics forum
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.578
H-Index - 120
eISSN - 1467-8659
pISSN - 0167-7055
DOI - 10.1111/cgf.13016
Subject(s) - shadow (psychology) , computer science , computer vision , artificial intelligence , benchmark (surveying) , image (mathematics) , harmonization , range (aeronautics) , rest (music) , computer graphics (images) , geography , cartography , medicine , psychology , physics , materials science , acoustics , cardiology , composite material , psychotherapist
Abstract Shadow removal is a challenging problem and previous approaches often produce de‐shadowed regions that are visually inconsistent with the rest of the image. We propose an automatic shadow region harmonization approach that makes the appearance of a de‐shadowed region (produced using any previous technique) compatible with the rest of the image. We use a shadow‐guided patch‐based image synthesis approach that reconstructs the shadow region using patches sampled from non‐shadowed regions. This result is then refined based on the reconstruction confidence to handle unique textures. Qualitative comparisons over a wide range of images, and a quantitative evaluation on a benchmark dataset show that our technique significantly improves upon the state‐of‐the‐art.