Dynamic and Adaptive Self-Training for Semi-Supervised Remote Sensing Image Semantic Segmentation

被引:0
|
作者
Jin, Jidong [1 ,2 ,3 ,4 ]
Lu, Wanxuan [1 ,2 ]
Yu, Hongfeng [1 ,2 ]
Rong, Xuee [1 ,2 ,3 ,4 ]
Sun, Xian [1 ,2 ,3 ,4 ]
Wu, Yirong [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Inst Elect, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Inst Elect, Key Lab Network Informat Syst Technol NIST, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100190, Peoples R China
[4] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; Semantic segmentation; Transformers; Data models; Training; Semantics; Predictive models; Consistency regularization (CR); remote sensing (RS) image; self-training; semantic segmentation; semisupervised learning (SSL);
D O I
10.1109/TGRS.2024.3407142
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing (RS) technology has made remarkable progress, providing a wealth of data for various applications, such as ecological conservation and urban planning. However, the meticulous annotation of this data is labor-intensive, leading to a shortage of labeled data, particularly in tasks like semantic segmentation. Semi-supervised methods, combining consistency regularization (CR) with self-training, offer a solution to efficiently utilize labeled and unlabeled data. However, these methods encounter challenges due to imbalanced data ratios. To tackle these challenges, we introduce a self-training approach named dynamic and adaptive self-training (DAST), which is combined with dynamic pseudo-label sampling (DPS), distribution matching (DM), and adaptive threshold updating (ATU). DPS is tailored to address the issue of class distribution imbalance by giving priority to classes with fewer samples. Meanwhile, DM and ATU aim to reduce distribution disparities by adjusting model predictions across augmented images within the framework of CR, ensuring they align with the actual data distribution. Experimental results on the Potsdam and iSAID datasets demonstrate that DAST effectively balances class distribution, aligns model predictions with data distribution, and stabilizes pseudo-labels, leading to state-of-the-art performance on both datasets. These findings highlight the potential of DAST in overcoming the challenges associated with significant disparities in labeled-to-unlabeled data ratios.
引用
下载
收藏
页码:1 / 1
页数:14
相关论文
共 50 条
  • [1] SEMI-SUPERVISED SEMANTIC GENERATIVE NETWORKS FOR REMOTE SENSING IMAGE SEGMENTATION
    Lu, Wanxuan
    Jin, Jidong
    Sun, Xian
    Fu, Kun
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6386 - 6389
  • [2] Self-training with dual uncertainty for semi-supervised MRI image segmentation
    Qiu, Zhanhong
    Gan, Haitao
    Shi, Ming
    Huang, Zhongwei
    Yang, Zhi
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 94
  • [3] A Three-Stage Self-Training Framework for Semi-Supervised Semantic Segmentation
    Ke, Rihuan
    Aviles-Rivero, Angelica, I
    Pandey, Saurabh
    Reddy, Saikumar
    Schonlieb, Carola-Bibiane
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1805 - 1815
  • [4] The GIST and RIST of Iterative Self-Training for Semi-Supervised Segmentation
    Teh, Eu Wern
    DeVries, Terrance
    Duke, Brendan
    Jiang, Ruowei
    Aarabi, Parham
    Taylor, Graham W.
    2022 19TH CONFERENCE ON ROBOTS AND VISION (CRV 2022), 2022, : 58 - 66
  • [5] ST plus plus : Make Self-training Work Better for Semi-supervised Semantic Segmentation
    Yang, Lihe
    Zhuo, Wei
    Qi, Lei
    Shi, Yinghuan
    Gao, Yang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 4258 - 4267
  • [6] Semi-Supervised Remote Sensing Image Semantic Segmentation Method Based on Deep Learning
    Li, Linhui
    Zhang, Wenjun
    Zhang, Xiaoyan
    Emam, Mahmoud
    Jing, Weipeng
    ELECTRONICS, 2023, 12 (02)
  • [7] Remote Sensing Image Semantic Change Detection Boosted by Semi-Supervised Contrastive Learning of Semantic Segmentation
    Zhang, Xiuwei
    Yang, Yizhe
    Ran, Lingyan
    Chen, Liang
    Wang, Kangwei
    Yu, Lei
    Wang, Peng
    Zhang, Yanning
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 13
  • [8] Multi-scale Self-attention Based Semi-supervised Remote Sensing Image Semantic Segmentation
    Sun, Deyan
    Liu, Hai
    Chen, Wei
    Zhu, Pengcheng
    Chen, Dufeng
    Liu, Jueting
    Wang, Jiaqi
    Wu, Yuliang
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VI, ICIC 2024, 2024, 14867 : 430 - 439
  • [9] Semi-supervised Segmentation with Self-training Based on Quality Estimation and Refinement
    Zheng, Zhou
    Wang, Xiaoxia
    Zhang, Xiaoyun
    Zhong, Yumin
    Yao, Xiaofen
    Zhang, Ya
    Wang, Yanfeng
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2020, 2020, 12436 : 30 - 39
  • [10] Granulation-based self-training for the semi-supervised classification of remote-sensing images
    Prem Shankar Singh Aydav
    Sonajharia Minz
    Granular Computing, 2020, 5 : 309 - 327