Premium
Cascaded network with deep intensity manipulation for scene understanding
Author(s) -
Yang Xin,
Wang Haoran,
Chen Shaozhe,
Piao Xinglin,
Zhou Dongsheng,
Zhang Qiang,
Yin Baocai,
Wei Xiaopeng
Publication year - 2019
Publication title -
computer animation and virtual worlds
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.225
H-Index - 49
eISSN - 1546-427X
pISSN - 1546-4261
DOI - 10.1002/cav.1888
Subject(s) - computer science , artificial intelligence , computer vision , semantics (computer science) , pixel , light intensity , deep learning , intensity (physics) , quantum mechanics , programming language , physics , optics
Scene understanding is essential to robotic navigation and autonomous driving as it provides semantic information to their controlling system. However, it will fail when processing low‐light images/videos captured under adverse weather or at night use state‐of‐the‐art scene understanding methods. A naive way to directly infer semantics from low‐light images is ill posed because the low‐light condition distorts pixel intensities and buries details. In order to address this problem, we propose the Deep Intensity Manipulation Network (DIMNet), which could relight the input images and recover the details, and combine the DIMNet with a scene understanding network to get a cascaded network to learn the semantics from low‐light images. Through learning pixel intensity manipulation, our method can generate images not only visually pleasing but also practical for scene understanding. Qualitative and quantitative experiments demonstrate that the proposed method is effective and robust for both synthetic and real‐world images.