Domain-Incremental Learning for Remote Sensing Semantic Segmentation With Multifeature Constraints in Graph Space

被引:0
|
作者
Huang, Wubiao [1 ]
Ding, Mingtao [2 ,3 ,4 ]
Deng, Fei [5 ,6 ]
机构
[1] Wuhan Univ, Sch Geodesy & Geomat, Wuhan 430079, Peoples R China
[2] Changan Univ, Coll Geol Engn & Geomat, Xian 710054, Peoples R China
[3] Changan Univ, Key Lab Loess, Xian 710054, Peoples R China
[4] Minist Educ, Key Lab Western Chinas Mineral Resource & Geol Eng, Xian 710054, Peoples R China
[5] Wuhan Univ, Sch Geodesy & Geomat, Wuhan 430079, Peoples R China
[6] Luojia Lab Hubei, Wuhan 430079, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross attention; domain-incremental learning (DIL); graph space reasoning (GSR); remote sensing image; semantic segmentation;
D O I
10.1109/TGRS.2024.3481875
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The use of deep learning techniques for semantic segmentation in remote sensing has been increasingly prevalent. Effectively modeling remote contextual information and integrating high-level abstract features with low-level spatial features are critical challenges for semantic segmentation tasks. This article addresses these challenges by constructing a graph space reasoning (GSR) module and a dual-channel cross-attention upsampling (DCAU) module. Meanwhile, a new domain-incremental learning (DIL) framework is designed to alleviate catastrophic forgetting when the deep learning model is used in cross-domain. This framework makes a balance between retaining prior knowledge and acquiring new information through the use of frozen feature layers and multifeature joint loss optimization. Based on this, a new DIL of remote sensing semantic segmentation with multifeature constraints in graph space (GSMF-RS-DIL) framework is proposed. Extensive experiments, including ablation experiments on the ISPRS and LoveDA datasets, demonstrate that the proposed method achieves superior performance and optimal computational efficiency in both single-domain and cross-domain tasks. The code is publicly available at https://github.com/Huang WBill/GSMF-RS-DIL.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] DILRS: Domain-Incremental Learning for Semantic Segmentation in Multi-Source Remote Sensing Data
    Rui, Xue
    Li, Ziqiang
    Cao, Yang
    Li, Ziyang
    Song, Weiguo
    REMOTE SENSING, 2023, 15 (10)
  • [2] Continual Learning for Class- and Domain-Incremental Semantic Segmentation
    Kalb, Tobias
    Roschani, Masoud
    Ruf, Miriam
    Beyerer, Juergen
    2021 32ND IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2021, : 1345 - 1351
  • [3] Domain-Incremental Semantic Segmentation for Traffic Scenes
    Liu, Yazhou
    Chen, Haoqi
    Lasang, Pongsak
    Wu, Zheng
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025,
  • [4] Principles of Forgetting in Domain-Incremental Semantic Segmentation in Adverse Weather Conditions
    Kalb, Tobias
    Beyerer, Juergen
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 19508 - 19518
  • [5] Incremental Learning for Semantic Segmentation of Large-Scale Remote Sensing Data
    Tasar, Onur
    Tarabalka, Yuliya
    Alliez, Pierre
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (09) : 3524 - 3537
  • [6] Research on Multifeature Segmentation Method of Remote Sensing Images Based on Graph Theory
    Bao, Wenxing
    Yao, Xiuhong
    JOURNAL OF SENSORS, 2016, 2016
  • [7] Learning deep semantic segmentation network under multiple weakly-supervised constraints for cross-domain remote sensing image semantic segmentation
    Li, Yansheng
    Shi, Te
    Zhang, Yongjun
    Chen, Wei
    Wang, Zhibin
    Li, Hao
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 175 : 20 - 33
  • [8] Clustering-based Domain-Incremental Learning
    Lamers, Christiaan
    Vidal, Rene
    Belbachir, Nabil
    Van Stein, Niki
    Back, Thomas
    Giampouras, Paris
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 3376 - 3384
  • [9] Multi-Domain Incremental Learning for Semantic Segmentation
    Garg, Prachi
    Saluja, Rohit
    Balasubramanian, Vineeth N.
    Arora, Chetan
    Subramanian, Anbumani
    Jawahar, C., V
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 2080 - 2090
  • [10] Unsupervised Domain Adaptation for Remote Sensing Semantic Segmentation with Transformer
    Li, Weitao
    Gao, Hui
    Su, Yi
    Momanyi, Biffon Manyura
    REMOTE SENSING, 2022, 14 (19)