Open AccessContinuous digital zooming using generative adversarial networks for dual camera system
Author(s) -
Yang Yifan,
Li Qi,
Yu Yongyi,
He Zhuang,
Feng Huajun,
Xu Zhihai,
Chen Yueting
Publication year - 2021
Publication title -
iet image processing
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.401
H-Index - 45
eISSN - 1751-9667
pISSN - 1751-9659
DOI - 10.1049/ipr2.12274
Subject(s) - focal length , artificial intelligence , zoom , computer vision , computer science , feature (linguistics) , block (permutation group theory) , image (mathematics) , benchmark (surveying) , mathematics , optics , lens (geology) , linguistics , philosophy , physics , geometry , geodesy , geography
This paper presents a generative adversarial network (GAN) with patch match algorithm to realize a high‐quality digital zooming using two camera modules with different focal lengths. In dual camera system, shorter focal length module produces the wide‐view image with the low resolution. On the other hand, the longer focal length module produces the tele‐view image via optical zooming. The long‐focal image contains more details than short‐focal image and can be used to guide short‐focal image to reconstruct high frequency part. Firstly, a feature extraction block (FEB) is advanced to extract feature of long‐focal image and short focal‐image to reconstruct a wide‐view image with different resolutions. Next, a patch match algorithm is integrated into convolution neural networks (CNN) to fuse information of long‐focal with short‐focal image and generate a new fused image. Finally, the fused image and short‐focal image are merged with a feature fusion block (FFB) to predict high‐resolution images. In addition, generative adversarial networks are used for filtering information integrated by previous network and output the zoomed image. Extensive experiments on benchmark datasets show that our algorithm achieves favorable performance against state‐of‐the‐art methods.