A Unified Deep Learning Network for Remote Sensing Image Registration and Change Detection

被引:3
|
作者
Zhou, Rufan [1 ]
Quan, Dou [1 ]
Wang, Shuang [1 ]
Lv, Chonghua [1 ]
Cao, Xianwei [1 ]
Chanussot, Jocelyn [2 ]
Li, Yi [3 ]
Jiao, Licheng [1 ]
机构
[1] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Minist Educ China, Xian 710071, Peoples R China
[2] Univ Grenoble Alpes, GIPSA Lab, CNRS, GIPSA Lab, F-38000 Grenoble, France
[3] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Image registration; Task analysis; Feature extraction; Remote sensing; Deep learning; Optimization; Learning systems; Change detection; deep collaborative learning; image registration; unified deep network; ALGORITHM;
D O I
10.1109/TGRS.2023.3344751
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Image registration and change detection are crucial for multitemporal remote sensing image analysis. The images should be registered before the change information detection. Existing deep learning methods have shown significant advantages in image registration and change detection tasks. They usually design two independent task-specific deep networks for image registration and change detection, respectively. These independent deep networks will learn from scratch and rely on many task-specific labeled training datasets. This article finds that image registration and change detection have similar learning mechanisms, which focus on extracting discriminative features. Inspired by this, we propose a Unified image Registration and Change detection Network (URCNet) that can perform image alignment and change information detection through a single network. Additionally, this article proposes various deep collaborative learning methods for URCNet optimization, which enforce that the URCNet can effectively support remote sensing image registration and change detection simultaneously. Extensive experiments demonstrate the effectiveness of the proposed URCNet for image registration and change detection, which can achieve comparable and better results with task-specific and more complex deep networks. The proposed URCNet can support multitasks based on the same scene images, different scene images, and even multimodal images. Moreover, URCNet shows significant advantages over other deep networks in change detection under limited labeled datasets.
引用
收藏
页码:1 / 16
页数:16
相关论文
共 50 条
  • [1] Deep supervised network for change detection of remote sensing image
    Yuan, Xiao-Ping
    Wang, Xiao-Qian
    He, Xiang
    Hu, Yang-Ming
    [J]. Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (10): : 1966 - 1976
  • [2] A deep learning framework for remote sensing image registration
    Wang, Shuang
    Quan, Dou
    Liang, Xuefeng
    Ning, Mengdan
    Guo, Yanhe
    Jiao, Licheng
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 145 : 148 - 164
  • [3] REMOTE SENSING IMAGE CHANGE DETECTION BASED ON DEEP DICTIONARY LEARNING
    Yang, Yuqun
    Tang, Xu
    Liu, Fang
    Ma, Jingjing
    Jiao, Licheng
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1416 - 1419
  • [4] Survey of remote sensing image registration based on deep learning
    Li, Xinghua
    Ai, Wenhao
    Feng, Ruitao
    Luo, Shaojie
    [J]. National Remote Sensing Bulletin, 2023, 27 (02) : 5 - 22
  • [5] Image Registration and Change Detection for Artifact Detection in Remote Sensing Imagery
    Zelinski, Michael E.
    Henderson, John R.
    Held, Elizabeth L.
    [J]. ALGORITHMS AND TECHNOLOGIES FOR MULTISPECTRAL, HYPERSPECTRAL, AND ULTRASPECTRAL IMAGERY XXIV, 2018, 10644
  • [6] Hyperspectral remote sensing image change detection based on tensor and deep learning
    Huang, Fenghua
    Yu, Ying
    Feng, Tinghao
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 58 : 233 - 244
  • [7] Remote Sensing Image Registration Based on Deep Learning Regression Model
    Li, Liangzhi
    Han, Ling
    Ding, Mingtao
    Liu, Zhiheng
    Cao, Hongye
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [8] Deep learning for change detection in remote sensing: a review
    Bai, Ting
    Wang, Le
    Yin, Dameng
    Sun, Kaimin
    Chen, Yepei
    Li, Wenzhuo
    Li, Deren
    [J]. GEO-SPATIAL INFORMATION SCIENCE, 2023, 26 (03) : 262 - 288
  • [9] Change Detection in Remote Sensing Images Based on Image Mapping and a Deep Capsule Network
    Ma, Wenping
    Xiong, Yunta
    Wu, Yue
    Yang, Hui
    Zhang, Xiangrong
    Jiao, Licheng
    [J]. REMOTE SENSING, 2019, 11 (06)
  • [10] Change detection and registration of remote sensing image based on random walk
    Xu, De-He
    Yang, Cheng-jie
    Zhang, Jun-feng
    [J]. International Journal of Advancements in Computing Technology, 2012, 4 (23) : 138 - 144