Domain-Incremental Learning for Remote Sensing Semantic Segmentation With Multifeature Constraints in Graph Space

被引:0
|
作者
Huang, Wubiao [1 ]
Ding, Mingtao [2 ,3 ,4 ]
Deng, Fei [5 ,6 ]
机构
[1] Wuhan Univ, Sch Geodesy & Geomat, Wuhan 430079, Peoples R China
[2] Changan Univ, Coll Geol Engn & Geomat, Xian 710054, Peoples R China
[3] Changan Univ, Key Lab Loess, Xian 710054, Peoples R China
[4] Minist Educ, Key Lab Western Chinas Mineral Resource & Geol Eng, Xian 710054, Peoples R China
[5] Wuhan Univ, Sch Geodesy & Geomat, Wuhan 430079, Peoples R China
[6] Luojia Lab Hubei, Wuhan 430079, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Cross attention; domain-incremental learning (DIL); graph space reasoning (GSR); remote sensing image; semantic segmentation;
D O I
10.1109/TGRS.2024.3481875
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The use of deep learning techniques for semantic segmentation in remote sensing has been increasingly prevalent. Effectively modeling remote contextual information and integrating high-level abstract features with low-level spatial features are critical challenges for semantic segmentation tasks. This article addresses these challenges by constructing a graph space reasoning (GSR) module and a dual-channel cross-attention upsampling (DCAU) module. Meanwhile, a new domain-incremental learning (DIL) framework is designed to alleviate catastrophic forgetting when the deep learning model is used in cross-domain. This framework makes a balance between retaining prior knowledge and acquiring new information through the use of frozen feature layers and multifeature joint loss optimization. Based on this, a new DIL of remote sensing semantic segmentation with multifeature constraints in graph space (GSMF-RS-DIL) framework is proposed. Extensive experiments, including ablation experiments on the ISPRS and LoveDA datasets, demonstrate that the proposed method achieves superior performance and optimal computational efficiency in both single-domain and cross-domain tasks. The code is publicly available at https://github.com/Huang WBill/GSMF-RS-DIL.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Graph Attention Guidance Network With Knowledge Distillation for Semantic Segmentation of Remote Sensing Images
    Zhou, Wujie
    Fan, Xiaomin
    Yan, Weiqing
    Shan, Shengdao
    Jiang, Qiuping
    Hwang, Jenq-Neng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [42] Cross-scale Graph Interaction Network for Semantic Segmentation of Remote Sensing Images
    Nie, Jie
    Huang, Lei
    Zheng, Chengyu
    Lv, Xiaowei
    Wang, Rui
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (06)
  • [43] SAM-Assisted Remote Sensing Imagery Semantic Segmentation With Object and Boundary Constraints
    Ma, Xianping
    Wu, Qianqian
    Zhao, Xingyu
    Zhang, Xiaokang
    Pun, Man-On
    Huang, Bo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [44] Historical Information-Guided Class-Incremental Semantic Segmentation in Remote Sensing Images
    Rong, Xuee
    Sun, Xian
    Diao, Wenhui
    Wang, Peijin
    Yuan, Zhiqiang
    Wang, Hongqi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [45] A Generalization Sample Learning Method of Deep Learning for Semantic Segmentation of Remote Sensing Images
    Zheng, Chen
    Li, Jingying
    Chen, Yuncheng
    Wang, Leiguang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [46] Multi-granularity semantic alignment distillation learning for remote sensing image semantic segmentation
    Di Zhang
    Yong Zhou
    Jiaqi Zhao
    Zhongyuan Yang
    Hui Dong
    Rui Yao
    Huifang Ma
    Frontiers of Computer Science, 2022, 16
  • [47] Multi-granularity semantic alignment distillation learning for remote sensing image semantic segmentation
    ZHANG Di
    ZHOU Yong
    ZHAO Jiaqi
    YANG Zhongyuan
    DONG Hui
    YAO Rui
    MA Huifang
    Frontiers of Computer Science, 2022, 16 (04)
  • [48] Multi-granularity semantic alignment distillation learning for remote sensing image semantic segmentation
    Zhang, Di
    Zhou, Yong
    Zhao, Jiaqi
    Yang, Zhongyuan
    Dong, Hui
    Yao, Rui
    Ma, Huifang
    FRONTIERS OF COMPUTER SCIENCE, 2022, 16 (04)
  • [49] Incremental Class Discovery for Semantic Segmentation with RGBD Sensing
    Nakajima, Yoshikatsu
    Kang, Byeongkeun
    Saito, Hideo
    Kitani, Kris
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 972 - 981
  • [50] Knowledge distillation for incremental learning in semantic segmentation
    Michieli, Umberto
    Zanuttigh, Pietro
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 205