Bilateral Semantic Fusion Siamese Network for Change Detection From Multitemporal Optical Remote Sensing Imagery

被引:12
|
作者
Du, Hailin [1 ]
Zhuang, Yin [1 ]
Dong, Shan [2 ]
Li, Can [1 ]
Chen, He [1 ]
Zhao, Boya [3 ]
Chen, Liang [1 ]
机构
[1] Beijing Key Lab Embedded Real Time Informat Proc, Beijing 100081, Peoples R China
[2] Commun Univ China, Engn Ctr Digital Audio & Video, Beijing 100024, Peoples R China
[3] Chinese Acad Sci, Space Technol Res Inst Remote Sensing Technol, Beijing 100081, Peoples R China
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Semantics; Feature extraction; Convolution; Remote sensing; Optical sensors; Optical imaging; Training; Bilateral semantic fusion; bitemporal images; change detection (CD); siamese network;
D O I
10.1109/LGRS.2021.3082630
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Change detection (CD) is an essential task in optical remote sensing, and it can be used to extract the valid information from sequential multitemporal images. However, since the character of long-term revisiting and very high resolution (VHR) development, the great differences of illumination, season, and interior textures between bitemporal images bring considerable challenges for pixel-wise CD. In this letter, focusing on accurate pixel-wise CD, a bilateral semantic fusion Siamese network (BSFNet) is proposed. First, to better map bitemporal images into semantic feature domain for comparison, a novel BSFNet is designed to effectively integrate shallow and deep semantic features, which can provide pixel-wise CD results with complete regions and clear boundary locations. Then, in order to facilitate the reasonable convergence of the proposed BSFNet, a scale-invariant sample balance (SISB) loss is designed for metric learning to avoid the problems of sample imbalance and scale variance. Finally, extensive experiments are carried out on two published CDD and LEVIR CD datasets, and results indicate that the proposed BSFNet can provide superior performance than the other state-of-the-art methods. Our work is available at https://github.com/ClarissaDHL/BSFNet.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] OPTICAL REMOTE SENSING CHANGE DETECTION THROUGH DEEP SIAMESE NETWORK
    Arabi, Mohammed El Amin
    Karoui, Moussa Sofiane
    Djerriri, Khelifa
    [J]. IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 5041 - 5044
  • [2] A transformer-based Siamese network and an open optical dataset for semantic change detection of remote sensing images
    Yuan, Panli
    Zhao, Qingzhan
    Zhao, Xingbiao
    Wang, Xuewen
    Long, Xuefeng
    Zheng, Yuchen
    [J]. INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2022, 15 (01) : 1506 - 1525
  • [3] SCDNET: A novel convolutional network for semantic change detection in high resolution optical remote sensing imagery
    Peng, Daifeng
    Bruzzone, Lorenzo
    Zhang, Yongjun
    Guan, Haiyan
    He, Pengfei
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2021, 103
  • [4] Attention-Guided Siamese Fusion Network for Change Detection of Remote Sensing Images
    Chen, Puhua
    Guo, Lei
    Zhang, Xiangrong
    Qin, Kai
    Ma, Wentao
    Jiao, Licheng
    [J]. REMOTE SENSING, 2021, 13 (22)
  • [5] A Full-Scale Feature Fusion Siamese Network for Remote Sensing Change Detection
    Zhou, Huaping
    Song, Minglong
    Sun, Kelei
    [J]. ELECTRONICS, 2023, 12 (01)
  • [6] Multiscale Semantic Fusion-Guided Fractal Convolutional Object Detection Network for Optical Remote Sensing Imagery
    Zhang, Tong
    Zhuang, Yin
    Wang, Guanqun
    Dong, Shan
    Chen, He
    Li, Lianlin
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [7] A Deep Siamese Postclassification Fusion Network for Semantic Change Detection
    Xia, Hao
    Tian, Yugang
    Zhang, Lihao
    Li, Shuangliang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Semantic feature-constrained multitask siamese network for building change detection in high-spatial-resolution remote sensing imagery
    Shen, Qian
    Huang, Jiru
    Wang, Min
    Tao, Shikang
    Yang, Rui
    Zhang, Xin
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 189 : 78 - 94
  • [9] WAVELET SIAMESE NETWORK FOR CHANGE DETECTION IN REMOTE SENSING IMAGES
    Li, Tianhan
    Xiong, Fengchao
    Zheng, Wenbin
    Li, Zhuanfeng
    Zhou, Jun
    Qian, Yuntao
    [J]. IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 5455 - 5458
  • [10] Siamese Biattention Pooling Network for Change Detection in Remote Sensing
    Chen, Hengzhi
    Hu, Kun
    Filippi, Patrick
    Xiang, Wei
    Bishop, Thomas
    Wang, Zhiyong
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 7278 - 7291