High-Resolution Remote Sensing Bitemporal Image Change Detection Based on Feature Interaction and Multitask Learning

被引:21
|
作者
Zhao, Chunhui [1 ]
Tang, Yingjie [1 ]
Feng, Shou [1 ,2 ,3 ]
Fan, Yuanze [1 ]
Li, Wei [2 ]
Tao, Ran [1 ,2 ]
Zhang, Lifu [3 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
[3] Chinese Acad Sci, Aerosp Informat Res Inst, State Key Lab Remote Sensing Sci, Beijing 100101, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Task analysis; Remote sensing; Semantics; Transformers; Generative adversarial networks; Multitasking; Change detection; domain adaptation; feature interaction; high-resolution (HR) remote sensing image; multitask learning;
D O I
10.1109/TGRS.2023.3275140
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
With the development of remote sensing technology, high-resolution (HR) remote sensing optical images have gradually become the main source of change detection data. Albeit, the change detection for HR remote sensing images still faces challenges: 1) in complex scenes, a region contains a large amount of semantic information, which makes it difficult to accurately locate the boundaries between different semantics in the feature maps and 2) due to the inability to maintain consistent conditions such as light, weather, and other factors when acquiring bitemporal images, confounding factors such as the style of bitemporal data that are not related to change detection can cause detection difficulties. Therefore, a change detection method based on feature interaction and multitask learning (FMCD) is proposed in this article. To improve the ability to detect changes in complex scenes, FMCD models the context information of features through a multilevel feature interaction module, so as to obtain representative features, and to improve the sensitivity of the model to changes, the interaction between two temporal features is realized through the mix attention block (MAB). In addition, to eliminate the influence of weather and other factors, FMCD adopts a multitask learning strategy, takes domain adaptation as an auxiliary task, and maps the features of bitemporal images to the same space through the feature relationship adaptation module (FRAM) and feature distribution adaptation module (FDAM). Experiments on three datasets show that the proposed method is superior to other state-of-the-art methods.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Building Change Detection in High-Resolution Remote-Sensing Images Based on Deep Learning
    Han Xing
    Han Ling
    Li Liangzhi
    Li Huihui
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (10)
  • [22] Remote Sensing Change Detection With Bitemporal and Differential Feature Interactive Perception
    Chang, Hao
    Wang, Peijin
    Diao, Wenhui
    Xu, Guangluan
    Sun, Xian
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 4543 - 4555
  • [23] Building change detection in very high-resolution remote sensing image based on pseudo-orthorectification
    Chen, Hui
    Zhang, Ka
    Xiao, Wen
    Sheng, Yehua
    Cheng, Liang
    Zhou, Wei
    Wang, Pengbo
    Su, Dong
    Ye, Longjie
    Zhang, Shan
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (07) : 2686 - 2705
  • [24] High-Resolution Remote Sensing Image Change Detection Based on Cross-Mixing Attention Network
    Wu, Chaoyang
    Yang, Le
    Guo, Cunge
    Wu, Xiaosuo
    ELECTRONICS, 2024, 13 (03)
  • [25] Transformer With Feature Interaction and Fusion for Remote Sensing Image Change Detection
    Guo, Dongen
    Zou, Tao
    Xia, Ying
    Feng, Jiangfan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 15407 - 15419
  • [26] Contrastive Scene Change Representation Learning for High-Resolution Remote Sensing Scene Change Detection
    Wang, Jue
    Zhong, Yanfei
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 18
  • [27] A Segmentation Based Change Detection Method for High Resolution Remote Sensing Image
    Wu, Lin
    Zhang, Zhaoxiang
    Wang, Yunhong
    Liu, Qingjie
    PATTERN RECOGNITION (CCPR 2014), PT I, 2014, 483 : 314 - 324
  • [28] Landslide Inventory Mapping From Bitemporal High-Resolution Remote Sensing Images Using Change Detection and Multiscale Segmentation
    Lv, Zhi Yong
    Shi, Wenzhong
    Zhang, Xiaokang
    Benediktsson, Jon Atli
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (05) : 1520 - 1532
  • [29] A Survey on Deep Learning-Based Change Detection from High-Resolution Remote Sensing Images
    Jiang, Huiwei
    Peng, Min
    Zhong, Yuanjun
    Xie, Haofeng
    Hao, Zemin
    Lin, Jingming
    Ma, Xiaoli
    Hu, Xiangyun
    REMOTE SENSING, 2022, 14 (07)
  • [30] Bitemporal Attention Sharing Network for Remote Sensing Image Change Detection
    Wang, Zhongchen
    Gu, Guowei
    Xia, Min
    Weng, Liguo
    Hu, Kai
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 10368 - 10379