High-Resolution Remote Sensing Bitemporal Image Change Detection Based on Feature Interaction and Multitask Learning

被引:21
|
作者
Zhao, Chunhui [1 ]
Tang, Yingjie [1 ]
Feng, Shou [1 ,2 ,3 ]
Fan, Yuanze [1 ]
Li, Wei [2 ]
Tao, Ran [1 ,2 ]
Zhang, Lifu [3 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
[3] Chinese Acad Sci, Aerosp Informat Res Inst, State Key Lab Remote Sensing Sci, Beijing 100101, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Task analysis; Remote sensing; Semantics; Transformers; Generative adversarial networks; Multitasking; Change detection; domain adaptation; feature interaction; high-resolution (HR) remote sensing image; multitask learning;
D O I
10.1109/TGRS.2023.3275140
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
With the development of remote sensing technology, high-resolution (HR) remote sensing optical images have gradually become the main source of change detection data. Albeit, the change detection for HR remote sensing images still faces challenges: 1) in complex scenes, a region contains a large amount of semantic information, which makes it difficult to accurately locate the boundaries between different semantics in the feature maps and 2) due to the inability to maintain consistent conditions such as light, weather, and other factors when acquiring bitemporal images, confounding factors such as the style of bitemporal data that are not related to change detection can cause detection difficulties. Therefore, a change detection method based on feature interaction and multitask learning (FMCD) is proposed in this article. To improve the ability to detect changes in complex scenes, FMCD models the context information of features through a multilevel feature interaction module, so as to obtain representative features, and to improve the sensitivity of the model to changes, the interaction between two temporal features is realized through the mix attention block (MAB). In addition, to eliminate the influence of weather and other factors, FMCD adopts a multitask learning strategy, takes domain adaptation as an auxiliary task, and maps the features of bitemporal images to the same space through the feature relationship adaptation module (FRAM) and feature distribution adaptation module (FDAM). Experiments on three datasets show that the proposed method is superior to other state-of-the-art methods.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Instance Segmentation of Buildings from High-Resolution Remote Sensing Images with Multitask Learning
    Hui J.
    Qin Q.
    Xu W.
    Sui J.
    Beijing Daxue Xuebao (Ziran Kexue Ban)/Acta Scientiarum Naturalium Universitatis Pekinensis, 2019, 55 (06): : 1067 - 1077
  • [32] High-Resolution Remote Sensing Image Change Detection Method Based on Improved Siamese U-Net
    Wang, Qing
    Li, Mengqi
    Li, Gongquan
    Zhang, Jiling
    Yan, Shuoyue
    Chen, Zhuoran
    Zhang, Xiaodong
    Chen, Guanzhou
    REMOTE SENSING, 2023, 15 (14)
  • [33] High-Resolution Remote Sensing Image Building Change Detection Based on One-Class Classifier Framework
    Wang Z.
    Shen Y.
    Wang L.
    Zhang Q.
    You S.
    Shen, Yan (120252840@qq.com), 1610, Editorial Board of Medical Journal of Wuhan University (45): : 1610 - 1618
  • [34] MDESNet: Multitask Difference-Enhanced Siamese Network for Building Change Detection in High-Resolution Remote Sensing Images
    Zheng, Jiaxiang
    Tian, Yichen
    Yuan, Chao
    Yin, Kai
    Zhang, Feifei
    Chen, Fangmiao
    Chen, Qiang
    REMOTE SENSING, 2022, 14 (15)
  • [35] Multitask Siamese Network Guided by Enhanced Change Information for Semantic Change Detection in Bitemporal Remote Sensing Images
    Zuo, Xibing
    Jin, Fei
    Ding, Lei
    Wang, Shuxiang
    Lin, Yuzhun
    Liu, Bing
    Ding, Yao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 61 - 77
  • [37] Study on the technology of classifying high-resolution remote sensing image based on multi-feature
    Lin, H
    Li, JP
    Mo, DK
    Xiong, YJ
    Sun, H
    Liu, XY
    REMOTE SENSING AND SPACE TECHNOLOGY FOR MULTIDISCIPLINARY RESEARCH AND APPLICATIONS, 2006, 6199
  • [38] Quantizing and analyzing the feature information of coastal zone based on high-resolution remote sensing image
    Yang Xiaomei
    Lan Rongqin
    Luo Hancheng
    ACTA OCEANOLOGICA SINICA, 2006, 25 (06) : 33 - 42
  • [39] High-resolution remote sensing image semantic segmentation based on a deep feature aggregation network
    Wang, Zhen
    Guo, Jianxin
    Huang, Wenzhun
    Zhang, Shanwen
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2021, 32 (09)
  • [40] A high-resolution remote sensing image building extraction method based on deep learning
    Fan R.
    Chen Y.
    Xu Q.
    Wang J.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2019, 48 (01): : 34 - 41