High-Resolution Remote Sensing Bitemporal Image Change Detection Based on Feature Interaction and Multitask Learning

被引:21
|
作者
Zhao, Chunhui [1 ]
Tang, Yingjie [1 ]
Feng, Shou [1 ,2 ,3 ]
Fan, Yuanze [1 ]
Li, Wei [2 ]
Tao, Ran [1 ,2 ]
Zhang, Lifu [3 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
[3] Chinese Acad Sci, Aerosp Informat Res Inst, State Key Lab Remote Sensing Sci, Beijing 100101, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Task analysis; Remote sensing; Semantics; Transformers; Generative adversarial networks; Multitasking; Change detection; domain adaptation; feature interaction; high-resolution (HR) remote sensing image; multitask learning;
D O I
10.1109/TGRS.2023.3275140
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
With the development of remote sensing technology, high-resolution (HR) remote sensing optical images have gradually become the main source of change detection data. Albeit, the change detection for HR remote sensing images still faces challenges: 1) in complex scenes, a region contains a large amount of semantic information, which makes it difficult to accurately locate the boundaries between different semantics in the feature maps and 2) due to the inability to maintain consistent conditions such as light, weather, and other factors when acquiring bitemporal images, confounding factors such as the style of bitemporal data that are not related to change detection can cause detection difficulties. Therefore, a change detection method based on feature interaction and multitask learning (FMCD) is proposed in this article. To improve the ability to detect changes in complex scenes, FMCD models the context information of features through a multilevel feature interaction module, so as to obtain representative features, and to improve the sensitivity of the model to changes, the interaction between two temporal features is realized through the mix attention block (MAB). In addition, to eliminate the influence of weather and other factors, FMCD adopts a multitask learning strategy, takes domain adaptation as an auxiliary task, and maps the features of bitemporal images to the same space through the feature relationship adaptation module (FRAM) and feature distribution adaptation module (FDAM). Experiments on three datasets show that the proposed method is superior to other state-of-the-art methods.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Land Cover Change Detection Based on Vector Polygons and Deep Learning With High-Resolution Remote Sensing Images
    Zhang, Hui
    Liu, Wei
    Niu, Hao
    Yin, Pengcheng
    Dong, Shiling
    Wu, Jialin
    Li, Erzhu
    Zhang, Lianpeng
    Zhu, Changming
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 18
  • [42] Fine Object Change Detection Based on Vector Boundary and Deep Learning With High-Resolution Remote Sensing Images
    Shi, Jiacheng
    Liu, Wei
    Zhu, Yihu
    Wang, Shengli
    Hao, Sibao
    Zhu, Changming
    Shan, Haoyu
    Li, Erzhu
    Li, Xing
    Zhang, Lianpeng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 4094 - 4103
  • [43] Feature Enhancement Attention for Road Extraction in High-Resolution Remote Sensing Image
    Yu, Hang
    Li, Chenyang
    Guo, Yuru
    Zhou, Suiping
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 19805 - 19816
  • [44] Spatial Focused Bitemporal Interactive Network for Remote Sensing Image Change Detection
    Sun, Hang
    Yao, Yuan
    Zhang, Lefei
    Ren, Dong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 1
  • [45] Detection of volcanic disaster scene from high-resolution remote sensing image with deep learning
    Li, Chengfan
    Han, Jingxin
    Pan, Xiaodong
    Wang, Shengnan
    Yin, Jingyuan
    CHINESE JOURNAL OF GEOPHYSICS-CHINESE EDITION, 2024, 67 (12): : 4717 - 4732
  • [46] A Densely Attentive Refinement Network for Change Detection Based on Very-High-Resolution Bitemporal Remote Sensing Images
    Li, Ziming
    Yan, Chenxi
    Sun, Ying
    Xin, Qinchuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [47] EUNetMTL: multitask joint learning for road extraction from high-resolution remote sensing images
    Yi, Feng
    Te, Rigen
    Zhao, Yuheng
    Xu, Guocheng
    REMOTE SENSING LETTERS, 2022, 13 (03) : 258 - 268
  • [48] Machine learning paradigms in high-resolution remote sensing image interpretation
    Zhou P.
    Cheng G.
    Yao X.
    Han J.
    National Remote Sensing Bulletin, 2021, 25 (01) : 182 - 197
  • [49] A Multitask CNN-Transformer Network for Semantic Change Detection From Bitemporal Remote Sensing Images
    Liu, Wei
    Kang, Ziwen
    Liu, Jiawei
    Lin, Yiyuan
    Yu, Yongtao
    Li, Jonathan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [50] High-resolution optical remote sensing imagery change detection through deep transfer learning
    Larabi, Mohammed El Amin
    Chaib, Souleyman
    Bakhti, Khadidja
    Hasni, Kamel
    Bouhlala, Mohammed Amine
    JOURNAL OF APPLIED REMOTE SENSING, 2019, 13 (04)