RaSRNet: An End-to-End Relation-Aware Semantic Reasoning Network for Change Detection in Optical Remote Sensing Images

被引:4
|
作者
Liang, Yi [1 ]
Zhang, Chengkun [2 ]
Han, Min [3 ]
机构
[1] Dalian Univ Technol, Fac Elect Informat & Elect Engn, Dalian 116000, Peoples R China
[2] Qinghai Univ, Dept Comp Technol & Applicat, Xining 810000, Peoples R China
[3] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantics; Feature extraction; Cognition; Decoding; Semantic segmentation; Head; Convolution; Change detection (CD); optical remote sensing images (RSIs); relation-aware (Ra); semantic reasoning;
D O I
10.1109/TIM.2023.3243680
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Optical remote sensing images (RSIs) are used in surface observation, and one of the most interesting research topics is change detection (CD). The internal problem of RSIs, including multiscales changed objects and cluttered background, still deserves attention. Existing methods make great efforts to solve this problem but inevitably miss detection, which affects the model performance. To address this dilemma, this article proposes a relation-aware semantic reasoning network (RaSRNet) in an end-to-end manner to pop-out change objects in RSIs, where the key point is to perceive contextual semantic information. The relation-aware (Ra) module in RaSRNet combats the lack of contextual information caused by the limited receptive field (RF) of the general convolutional layer, which facilitates all-around changed object detection. The multilevel semantic reasoning encoder-decoder (ED) backbone in RaSRNet extracts and reconstructs pixel semantic information, alleviates the interference of background noise, and improves the integrity recognition of changed objects. In addition, the decoder backend undertakes two semantic segmentation branches and introduces a semantic reasoning loss between the two branches to infer pixel semantic categories, which provides more accurate semantic features for the CD. Extensive experiments are conducted on the three public RSI CD datasets, and the results demonstrate that the proposed RaSRNet can accurately locate changed objects, which consistently outperforms the state-of-the-art CD competitors.
引用
收藏
页码:1 / 11
页数:11
相关论文
共 50 条
  • [1] A semantic relation-aware deep neural network model for end-to-end conversational recommendation
    Wu, Jiajin
    Yang, Bo
    Li, Dongsheng
    Deng, Lihui
    [J]. APPLIED SOFT COMPUTING, 2023, 132
  • [2] AN END-TO-END SCALABLE OBJECT DETECTION NETWORK FOR REMOTE SENSING IMAGES
    Duan, Yani
    Teng, Zhu
    Zhang, Baopeng
    Fan, Jianping
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 960 - 963
  • [3] AN END-TO-END DEEP LEARNING CHANGE DETECTION FRAMEWORK FOR REMOTE SENSING IMAGES
    Yang, Yi
    Gu, Haiyan
    Han, Yanshun
    Li, Haitao
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 652 - 655
  • [4] OFACD: An end-to-end change detection network for small UAVs remote sensing with viewpoint differences
    Dong, Yaxin
    Li, Fei
    Yan, Kai
    Deng, Shen
    Wen, Tao
    Yang, Yang
    [J]. IMAGE AND VISION COMPUTING, 2024, 148
  • [5] Target heat-map network: An end-to-end deep network for target detection in remote sensing images
    Chen, Huai
    Zhang, Libao
    Ma, Jie
    Zhang, Jue
    [J]. NEUROCOMPUTING, 2019, 331 : 375 - 387
  • [6] End-to-End Remote Sensing Change Detection of Unregistered Bi-temporal Images for Natural Disasters
    Zhao, Guiqin
    Shan, Lianlei
    Wang, Weiqiang
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT II, 2023, 14255 : 259 - 270
  • [7] ESCNet: An End-to-End Superpixel-Enhanced Change Detection Network for Very-High-Resolution Remote Sensing Images
    Zhang, Hongyan
    Lin, Manhui
    Yang, Guangyi
    Zhang, Liangpei
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (01) : 28 - 42
  • [8] End-to-End Detail-Enhanced Dehazing Network for Remote Sensing Images
    Dong, Weida
    Wang, Chunyan
    Sun, Hao
    Teng, Yunjie
    Liu, Huan
    Zhang, Yue
    Zhang, Kailin
    Li, Xiaoyan
    Xu, Xiping
    [J]. REMOTE SENSING, 2024, 16 (02)
  • [9] End-to-End Airplane Detection Using Transfer Learning in Remote Sensing Images
    Chen, Zhong
    Zhang, Ting
    Ouyang, Chao
    [J]. REMOTE SENSING, 2018, 10 (01)
  • [10] Improving Graph Convolutional Networks Based on Relation-Aware Attention for End-to-End Relation Extraction
    Hong, Yin
    Liu, Yanxia
    Yang, Suizhu
    Zhang, Kaiwen
    Wen, Aiqing
    Hu, Jianjun
    [J]. IEEE ACCESS, 2020, 8 : 51315 - 51323