RaSRNet: An End-to-End Relation-Aware Semantic Reasoning Network for Change Detection in Optical Remote Sensing Images

被引:4
|
作者
Liang, Yi [1 ]
Zhang, Chengkun [2 ]
Han, Min [3 ]
机构
[1] Dalian Univ Technol, Fac Elect Informat & Elect Engn, Dalian 116000, Peoples R China
[2] Qinghai Univ, Dept Comp Technol & Applicat, Xining 810000, Peoples R China
[3] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantics; Feature extraction; Cognition; Decoding; Semantic segmentation; Head; Convolution; Change detection (CD); optical remote sensing images (RSIs); relation-aware (Ra); semantic reasoning;
D O I
10.1109/TIM.2023.3243680
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Optical remote sensing images (RSIs) are used in surface observation, and one of the most interesting research topics is change detection (CD). The internal problem of RSIs, including multiscales changed objects and cluttered background, still deserves attention. Existing methods make great efforts to solve this problem but inevitably miss detection, which affects the model performance. To address this dilemma, this article proposes a relation-aware semantic reasoning network (RaSRNet) in an end-to-end manner to pop-out change objects in RSIs, where the key point is to perceive contextual semantic information. The relation-aware (Ra) module in RaSRNet combats the lack of contextual information caused by the limited receptive field (RF) of the general convolutional layer, which facilitates all-around changed object detection. The multilevel semantic reasoning encoder-decoder (ED) backbone in RaSRNet extracts and reconstructs pixel semantic information, alleviates the interference of background noise, and improves the integrity recognition of changed objects. In addition, the decoder backend undertakes two semantic segmentation branches and introduces a semantic reasoning loss between the two branches to infer pixel semantic categories, which provides more accurate semantic features for the CD. Extensive experiments are conducted on the three public RSI CD datasets, and the results demonstrate that the proposed RaSRNet can accurately locate changed objects, which consistently outperforms the state-of-the-art CD competitors.
引用
收藏
页码:1 / 11
页数:11
相关论文
共 50 条
  • [41] AI-ForestWatch: semantic segmentation based end-to-end framework for forest estimation and change detection using multi-spectral remote sensing imagery
    Zulfiqar, Annus
    Ghaffar, Muhammad M.
    Shahzad, Muhammad
    Weis, Christian
    Malik, Muhammad, I
    Shafait, Faisal
    Wehn, Norbert
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2021, 15 (02)
  • [42] Dynamic Evidential Reasoning for Change Detection in Remote Sensing Images
    Liu, Zhun-ga
    Dezert, Jean
    Mercier, Gregoire
    Pan, Quan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2012, 50 (05): : 1955 - 1967
  • [43] Structure-Aware Multiscale Hybrid Network for Change Detection of Remote Sensing Images
    Liu Qi
    Cao Lin
    Tian Shu
    Du Kangning
    Song Peiran
    Guo Yanan
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (14)
  • [44] RR-Net: Relation Reasoning for End-to-End Human-Object Interaction Detection
    Yang, Dongming
    Zou, Yuexian
    Zhang, Can
    Cao, Meng
    Chen, Jie
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (06) : 3853 - 3865
  • [45] End-to-End Super-Resolution for Remote-Sensing Images Using an Improved Multi-Scale Residual Network
    Huan, Hai
    Li, Pengcheng
    Zou, Nan
    Wang, Chao
    Xie, Yaqin
    Xie, Yong
    Xu, Dongdong
    [J]. REMOTE SENSING, 2021, 13 (04) : 1 - 28
  • [46] An End-to-End Network for Remote Sensing Imagery Semantic Segmentation via Joint Pixel- and Representation-Level Domain Adaptation
    Shi, Lukui
    Wang, Ziyuan
    Pan, Bin
    Shi, Zhenwei
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (11) : 1896 - 1900
  • [47] An End-to-End Geometric Characterization-aware Semantic Instance Segmentation Network for ALS Point Clouds
    Wang, Jinhong
    Yao, Wei
    [J]. MID-TERM SYMPOSIUM THE ROLE OF PHOTOGRAMMETRY FOR A SUSTAINABLE WORLD, VOL. 48-2, 2024, : 435 - 442
  • [48] A Semi-Supervised Semantic and Spatial Change Detail Retention Network for Semantic Change Detection in Remote Sensing Images
    Lv, Pengyuan
    Cheng, Peng
    Ma, Chuang
    Zhong, Yanfei
    [J]. IEEE Transactions on Geoscience and Remote Sensing, 2024, 62
  • [49] End-to-End Object-Level Contrastive Pretraining for Detection via Semantic-Aware Localization
    Geng, Long
    Huang, Xiaoming
    [J]. ARTIFICIAL INTELLIGENCE, CICAI 2023, PT I, 2024, 14473 : 293 - 304
  • [50] Remote Sensing Airport Detection Based on End-to-End Deep Transferable Convolutional Neural Networks
    Li, Shuai
    Xu, Yuelei
    Zhu, Mingming
    Ma, Shiping
    Tang, Hong
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (10) : 1640 - 1644