
STCRNet: A Semi-Supervised Network Based on Self-Training and Consistency Regularization for Change Detection in VHR Remote Sensing Images
Author(s) -
Lukang Wang,
Min Zhang,
Wenzhong Shi
Publication year - 2023
Publication title -
ieee journal of selected topics in applied earth observations and remote sensing
Language(s) - English
Resource type - Journals
eISSN - 2151-1535
pISSN - 1939-1404
DOI - 10.1109/jstars.2023.3345017
Subject(s) - geoscience , signal processing and analysis , power, energy and industry applications
Change detection (CD) using deep learning techniques is a prominent topic in the field of remote sensing (RS). However, existing methods require large amounts of labeled samples for supervised learning, which is time-consuming and labor-intensive. To address this challenge, semi-supervised learning (SSL) methods that utilize a limited number of labeled samples along with a large pool of unlabeled samples have emerged as a compelling solution. We propose a novel semi-supervised CD (SSCD) network which combines self-training and consistency regularization, namely STCRNet. During the self-training phase, STCRNet selects unlabeled samples with reliable pseudo-labels based on their prediction stability across different training epochs and the consistency between class activation maps (CAMs) and prediction results within the model. Then, we apply data augmentation to the reliable samples and enforce consistency regularization on the augmented samples using the pseudo-labels to enhance the network's robustness. Moreover, feature consistency regularization is applied to the remaining unlabeled samples with image perturbations, thereby broadening the feature space and improving the model's generalization performance. Experimental results on two widely-used datasets demonstrate that STCRNet achieves state-of-the-art (SOTA) performance, especially with a significantly small amount (5%∼10%) of labeled samples. STCRNet presents a promising solution for SSCD. The demo code is available at https://github.com/WangLukang/STCRNet .