High-Resolution Remote Sensing Bitemporal Image Change Detection Based on Feature Interaction and Multitask Learning

被引:16
|
作者
Zhao, Chunhui [1 ]
Tang, Yingjie [1 ]
Feng, Shou [1 ,2 ,3 ]
Fan, Yuanze [1 ]
Li, Wei [2 ]
Tao, Ran [1 ,2 ]
Zhang, Lifu [3 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
[3] Chinese Acad Sci, Aerosp Informat Res Inst, State Key Lab Remote Sensing Sci, Beijing 100101, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Task analysis; Remote sensing; Semantics; Transformers; Generative adversarial networks; Multitasking; Change detection; domain adaptation; feature interaction; high-resolution (HR) remote sensing image; multitask learning;
D O I
10.1109/TGRS.2023.3275140
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
With the development of remote sensing technology, high-resolution (HR) remote sensing optical images have gradually become the main source of change detection data. Albeit, the change detection for HR remote sensing images still faces challenges: 1) in complex scenes, a region contains a large amount of semantic information, which makes it difficult to accurately locate the boundaries between different semantics in the feature maps and 2) due to the inability to maintain consistent conditions such as light, weather, and other factors when acquiring bitemporal images, confounding factors such as the style of bitemporal data that are not related to change detection can cause detection difficulties. Therefore, a change detection method based on feature interaction and multitask learning (FMCD) is proposed in this article. To improve the ability to detect changes in complex scenes, FMCD models the context information of features through a multilevel feature interaction module, so as to obtain representative features, and to improve the sensitivity of the model to changes, the interaction between two temporal features is realized through the mix attention block (MAB). In addition, to eliminate the influence of weather and other factors, FMCD adopts a multitask learning strategy, takes domain adaptation as an auxiliary task, and maps the features of bitemporal images to the same space through the feature relationship adaptation module (FRAM) and feature distribution adaptation module (FDAM). Experiments on three datasets show that the proposed method is superior to other state-of-the-art methods.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] High-Resolution Remote Sensing Image Change Detection Based on Fourier Feature Interaction and Multiscale Perception
    Chen, Yongqi
    Feng, Shou
    Zhao, Chunhui
    Su, Nan
    Li, Wei
    Tao, Ran
    Ren, Jinchang
    IEEE Transactions on Geoscience and Remote Sensing, 2024, 62
  • [2] BiFA: Remote Sensing Image Change Detection With Bitemporal Feature Alignment
    Zhang, Haotian
    Chen, Hao
    Zhou, Chenyao
    Chen, Keyan
    Liu, Chenyang
    Zou, Zhengxia
    Shi, Zhenwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 17
  • [3] Change Detection from High-Resolution Remote Sensing Image Based on MSE Model
    Wei Li-fei
    Wang Hai-bo
    SPECTROSCOPY AND SPECTRAL ANALYSIS, 2013, 33 (03) : 728 - 732
  • [4] Remote Sensing Image Change Detection Network Based on Twin High-Resolution Representation
    Wu X.
    Ma Y.
    Yan H.
    Qiao Z.
    Wu C.
    Guo C.
    Yao S.
    Fan Y.
    Mobile Information Systems, 2023, 2023
  • [5] Full-scale feature aggregation network for high-resolution remote sensing image change detection
    Jiang M.
    Zhang X.
    Sun Y.
    Feng W.
    Ruan Y.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2023, 52 (10): : 1738 - 1748
  • [6] High-resolution optical remote sensing image change detection based on dense connection and attention feature fusion network
    Peng, Daifeng
    Zhai, Chenchen
    Zhang, Yongjun
    Guan, Haiyan
    PHOTOGRAMMETRIC RECORD, 2023, 38 (184): : 498 - 519
  • [7] CHANGE DETECTION OF HIGH-RESOLUTION REMOTE SENSING IMAGE BASED ON SEMI-SUPERVISED SEGMENTATION AND ADVERSARIAL LEARNING
    Yang, Shengnan
    Hou, Shilong
    Zhang, Yifan
    Wang, Hongyu
    Ma, Xiaorui
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1055 - 1058
  • [8] Change Detection and Feature Extraction Using High-Resolution Remote Sensing Images
    Sharma V.K.
    Luthra D.
    Mann E.
    Chaudhary P.
    Chowdary V.M.
    Jha C.S.
    Remote Sensing in Earth Systems Sciences, 2022, 5 (3) : 154 - 164
  • [9] Change Detection Based on Supervised Contrastive Learning for High-Resolution Remote Sensing Imagery
    Wang, Jue
    Zhong, Yanfei
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [10] Combining iterative slow feature analysis and deep feature learning for change detection in high-resolution remote sensing images
    Xu, Junfeng
    Zhang, Baoming
    Guo, Haitao
    Lu, Jun
    Lin, Yuzhun
    JOURNAL OF APPLIED REMOTE SENSING, 2019, 13 (02)