Open AccessA Deep Learning Approach to Mobile Camera Image Signal Processing
Author(s) -
José Ivson S. Silva,
Gabriel G. Carvalho,
Marcel Santana Santos,
Diêgo J. C. Santiago,
Lucas Pontes de Albuquerque,
J. Battle,
Gabriel M. Da Costa,
Tsang Ing Ren
Publication year - 2020
Language(s) - English
Resource type - Conference proceedings
DOI - 10.5753/sibgrapi.est.2020.13016
Subject(s) - computer science , artificial intelligence , pipeline (software) , rgb color model , computer vision , deep learning , process (computing) , feature (linguistics) , artificial neural network , image processing , image (mathematics) , linguistics , philosophy , programming language , operating system
The quality of the images obtained from mobile cameras has been an important feature for modern smartphones. The camera Image Signal Processing (ISP) is a significant procedure when generating high-quality images. However, the existing algorithms in the ISP pipeline need to be tuned according to the physical resources of the image capture, limiting the final image quality. This work aims at replacing the camera ISP pipeline with a deep learning model that can better generalize the procedure. A Deep Neural Network based on the UNet architecture was employed to process RAW images into RGB. Pre-processing stages were applied, and some resources for training were added incrementally. The results demonstrated that the test images were obtained efficiently, indicating that the replacement of traditional algorithms by deep models is indeed a promising path.