Domain-Incremental Learning for Remote Sensing Semantic Segmentation With Multifeature Constraints in Graph Space

被引:0
|
作者
Huang, Wubiao [1 ]
Ding, Mingtao [2 ,3 ,4 ]
Deng, Fei [5 ,6 ]
机构
[1] Wuhan Univ, Sch Geodesy & Geomat, Wuhan 430079, Peoples R China
[2] Changan Univ, Coll Geol Engn & Geomat, Xian 710054, Peoples R China
[3] Changan Univ, Key Lab Loess, Xian 710054, Peoples R China
[4] Minist Educ, Key Lab Western Chinas Mineral Resource & Geol Eng, Xian 710054, Peoples R China
[5] Wuhan Univ, Sch Geodesy & Geomat, Wuhan 430079, Peoples R China
[6] Luojia Lab Hubei, Wuhan 430079, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross attention; domain-incremental learning (DIL); graph space reasoning (GSR); remote sensing image; semantic segmentation;
D O I
10.1109/TGRS.2024.3481875
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The use of deep learning techniques for semantic segmentation in remote sensing has been increasingly prevalent. Effectively modeling remote contextual information and integrating high-level abstract features with low-level spatial features are critical challenges for semantic segmentation tasks. This article addresses these challenges by constructing a graph space reasoning (GSR) module and a dual-channel cross-attention upsampling (DCAU) module. Meanwhile, a new domain-incremental learning (DIL) framework is designed to alleviate catastrophic forgetting when the deep learning model is used in cross-domain. This framework makes a balance between retaining prior knowledge and acquiring new information through the use of frozen feature layers and multifeature joint loss optimization. Based on this, a new DIL of remote sensing semantic segmentation with multifeature constraints in graph space (GSMF-RS-DIL) framework is proposed. Extensive experiments, including ablation experiments on the ISPRS and LoveDA datasets, demonstrate that the proposed method achieves superior performance and optimal computational efficiency in both single-domain and cross-domain tasks. The code is publicly available at https://github.com/Huang WBill/GSMF-RS-DIL.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Transformer-induced graph reasoning for multimodal semantic segmentation in remote sensing
    He, Qibin
    Sun, Xian
    Diao, Wenhui
    Yan, Zhiyuan
    Yin, Dongshuo
    Fu, Kun
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 193 : 90 - 103
  • [22] Geographic knowledge graph-guided remote sensing image semantic segmentation
    Li Y.
    Wu K.
    Ouyang S.
    Yang K.
    Li H.
    Zhang Y.
    National Remote Sensing Bulletin, 2024, 28 (02) : 455 - 469
  • [23] Quarta: quantum supervised and unsupervised learning for binary classification in domain-incremental learning
    Loglisci, Corrado
    Malerba, Donato
    Pascazio, Saverio
    QUANTUM MACHINE INTELLIGENCE, 2024, 6 (02)
  • [24] Transformed-*: A domain-incremental lifelong learning scenario generation framework
    Zurek, Dominik
    Corizzo, Roberto
    Karwatowski, Michal
    Pietron, Marcin
    Faber, Kamil
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [25] Personalized Federated Domain-Incremental Learning Based on Adaptive Knowledge Matching
    Lp, Yichen
    Xu, Wenchao
    Wang, Haozhao
    Qi, Yining
    Li, Ruixuan
    Gu, Jingcai
    COMPUTER VISION-ECCV 2024, PT XLVI, 2025, 15104 : 127 - 144
  • [26] Incremental Learning Techniques for Semantic Segmentation
    Michieli, Umberto
    Zanuttigh, Pietro
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3205 - 3212
  • [27] MiSSNet: Memory-Inspired Semantic Segmentation Augmentation Network for Class-Incremental Learning in Remote Sensing Images
    Xie, Jiajun
    Pan, Bin
    Xu, Xia
    Shi, Zhenwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 13
  • [28] Prompt-based Transceiver Cooperation for Semantic Communications with Domain-Incremental Background Knowledge
    Zhang, Lan
    Das, Madhureeta
    Sun, Yao
    Niyato, Dusit
    Yuan, Xiaoyong
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2087 - 2092
  • [29] An Efficient Domain-Incremental Learning Approach to Drive in All Weather Conditions
    Mirza, M. Jehanzeb
    Masana, Marc
    Possegger, Horst
    Bischof, Horst
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 3000 - 3010
  • [30] SR-FDIL: Synergistic Replay for Federated Domain-Incremental Learning
    Li, Yichen
    Xu, Wenchao
    Qi, Yining
    Wang, Haozhao
    Li, Ruixuan
    Guo, Song
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2024, 35 (11) : 1879 - 1890