Open AccessSingle Image Super-Resolution Network Based on Multiple- Scale Self-Similarity Module
Author(s) -
Jiaxin Xiong,
Guoyou Wang
Publication year - 2021
Publication title -
journal of physics. conference series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.21
H-Index - 85
eISSN - 1742-6596
pISSN - 1742-6588
DOI - 10.1088/1742-6596/2024/1/012018
Subject(s) - similarity (geometry) , computer science , convolutional neural network , artificial intelligence , residual , pattern recognition (psychology) , feature (linguistics) , scale (ratio) , convolution (computer science) , self similarity , image (mathematics) , artificial neural network , algorithm , mathematics , cartography , geography , linguistics , philosophy , geometry
Recently, single image super-resolution (SISR) based on deep convolutional neural networks (CNNs) has been widely studied and achieved remarkable results. However, most of these methods mainly widen or deepen the network to get better results, ignoring the self-similarity in natural images. Some works have successfully leveraged this self-similarity by exploring non-local attention modules, but they only use non-local attention modules at one scale or two scales. And they need to calculate the self-similarity in each residual module, which makes the network more complex and takes a long time to train. We propose a multiple-scale self-similarity module (MSSS) that can be flexibly inserted into existing various super-resolution networks. MSSS uses convolution with different kernels and the trailing dilated convolution to obtain feature maps at different scales, and then calculates the correlation between multiple feature maps at different scales through two-head region-level recurrent criss-cross attention modules (TRRCCA), finally gets fusion output through channel attention. So MSSS can mine multiple-scale self-similarities. We only insert a MSSS module into the basic residual SISR network, and the result is significantly improved.