RaSRNet: An End-to-End Relation-Aware Semantic Reasoning Network for Change Detection in Optical Remote Sensing Images

被引:4
|
作者
Liang, Yi [1 ]
Zhang, Chengkun [2 ]
Han, Min [3 ]
机构
[1] Dalian Univ Technol, Fac Elect Informat & Elect Engn, Dalian 116000, Peoples R China
[2] Qinghai Univ, Dept Comp Technol & Applicat, Xining 810000, Peoples R China
[3] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantics; Feature extraction; Cognition; Decoding; Semantic segmentation; Head; Convolution; Change detection (CD); optical remote sensing images (RSIs); relation-aware (Ra); semantic reasoning;
D O I
10.1109/TIM.2023.3243680
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Optical remote sensing images (RSIs) are used in surface observation, and one of the most interesting research topics is change detection (CD). The internal problem of RSIs, including multiscales changed objects and cluttered background, still deserves attention. Existing methods make great efforts to solve this problem but inevitably miss detection, which affects the model performance. To address this dilemma, this article proposes a relation-aware semantic reasoning network (RaSRNet) in an end-to-end manner to pop-out change objects in RSIs, where the key point is to perceive contextual semantic information. The relation-aware (Ra) module in RaSRNet combats the lack of contextual information caused by the limited receptive field (RF) of the general convolutional layer, which facilitates all-around changed object detection. The multilevel semantic reasoning encoder-decoder (ED) backbone in RaSRNet extracts and reconstructs pixel semantic information, alleviates the interference of background noise, and improves the integrity recognition of changed objects. In addition, the decoder backend undertakes two semantic segmentation branches and introduces a semantic reasoning loss between the two branches to infer pixel semantic categories, which provides more accurate semantic features for the CD. Extensive experiments are conducted on the three public RSI CD datasets, and the results demonstrate that the proposed RaSRNet can accurately locate changed objects, which consistently outperforms the state-of-the-art CD competitors.
引用
收藏
页码:1 / 11
页数:11
相关论文
共 50 条
  • [21] ESPC_NASUnet: An End-to-End Super-Resolution Semantic Segmentation Network for Mapping Buildings From Remote Sensing Images
    Xu, Penglei
    Tang, Hong
    Ge, Jiayi
    Feng, Lin
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 5421 - 5435
  • [22] ESPC_NASUnet: An End-to-End Super-Resolution Semantic Segmentation Network for Mapping Buildings from Remote Sensing Images
    Xu, Penglei
    Tang, Hong
    Ge, Jiayi
    Feng, Lin
    [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14 : 5421 - 5435
  • [23] Semantic Information Collaboration Network for Semantic Change Detection in Remote Sensing Images
    Ning, Xiaogang
    He, You
    Zhang, Hanchao
    Zhang, Ruiqian
    Chang, Dong
    Hao, Minghui
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 12893 - 12909
  • [24] AN END-TO-END FRAMEWORK FOR LOW-RESOLUTION REMOTE SENSING SEMANTIC SEGMENTATION
    Pereira, Matheus B.
    dos Santos, Jefersson A.
    [J]. 2020 IEEE LATIN AMERICAN GRSS & ISPRS REMOTE SENSING CONFERENCE (LAGIRS), 2020, : 6 - 11
  • [25] Bi-Temporal Semantic Reasoning for the Semantic Change Detection in HR Remote Sensing Images
    Ding, Lei
    Guo, Haitao
    Liu, Sicong
    Mou, Lichao
    Zhang, Jing
    Bruzzone, Lorenzo
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [26] Small-Object Detection in Remote Sensing Images with End-to-End Edge-Enhanced GAN and Object Detector Network
    Rabbi, Jakaria
    Ray, Nilanjan
    Schubert, Matthias
    Chowdhury, Subir
    Chao, Dennis
    [J]. REMOTE SENSING, 2020, 12 (09)
  • [27] CBANet: An End-to-End Cross-Band 2-D Attention Network for Hyperspectral Change Detection in Remote Sensing
    Li, Yinhe
    Ren, Jinchang
    Yan, Yijun
    Liu, Qiaoyuan
    Ma, Ping
    Petrovski, Andrei
    Sun, Haijiang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [28] IRU-Net: An Efficient End-to-End Network for Automatic Building Extraction From Remote Sensing Images
    Sheikh, Md Abdul Alim
    Maity, Tanmoy
    Kole, Alok
    [J]. IEEE ACCESS, 2022, 10 : 37811 - 37828
  • [29] Adaptive Edge-Aware Semantic Interaction Network for Salient Object Detection in Optical Remote Sensing Images
    Zeng, Xiangyu
    Xu, Mingzhu
    Hu, Yijun
    Tang, Haoyu
    Hu, Yupeng
    Nie, Liqiang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [30] An end-to-end multiple side-outputs fusion deep supervision network based remote sensing image change detection algorithm
    Wu, Xiaosuo
    Yang, Le
    Ma, Yaya
    Wu, Chaoyang
    Guo, Cunge
    Yan, Haowen
    Qiao, Ze
    Yao, Shuang
    Fan, Yufeng
    [J]. SIGNAL PROCESSING, 2023, 213