EDGE-Net: an edge-guided enhanced network for RGB-T salient object detection

被引:0
|
作者
Zheng, Xin [1 ]
Wang, Boyang [1 ]
Ai, Liefu [1 ]
Tang, Pan [1 ]
Liu, Deyang [1 ,2 ]
机构
[1] Anqing Normal Univ, Sch Comp & Informat, Anqing, Peoples R China
[2] Shanghai Univ, Key Lab Specialty Fiber Opt & Opt Access Networks, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
RGB-T data; salient object detection; information fusion; multi-modality; VISUAL-ATTENTION; IMAGE; SCENE; MODEL;
D O I
10.1117/1.JEI.32.6.063032
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With similar textures, dark backgrounds, and complex scenes, RGB images are usually unable to provide discriminative information for model training, which often leads to inaccurate prediction results. Compared with RGB salient object detection (SOD) methods, RGB-T SOD have thermal infrared (TIR) information as an informational supplement. As a result, RGB-T SOD can adapt to more complex environments and achieve better results. However, existing methods do not efficiently integrate features between different modalities and do not fully exploit spatial information from the shallow-level features. Accordingly, we propose an EDGE-Net. First, we propose an edge extraction module to capture the edge information in the shallow-level features and use it to guide the subsequent decoding. The original edge features are then weighted after channel attention processing. Second, to additionally suppress the noise of the shallow-level features, we design a global information extraction module. In this module, multiple convolutions are used instead of single convolutions to reduce the computational effort, and convolutions with different dilation rates are used to obtain different receptive fields. We conduct extensive experiments on the RGB-T dataset and show that the proposed method achieves superior performance compared to several state-of-the-art algorithms. The code and results of our method are available in a Github repository available at: https://github.com/BorreloadD/EDGE-Net.git.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Pyramid contract-based network for RGB-T salient object detection
    Wu, Ranwan
    Bi, Hongbo
    Zhang, Cong
    Zhang, Jiayuan
    Tong, Yuyu
    Jin, Wei
    Liu, Zhigang
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (07) : 20805 - 20825
  • [22] Interactive context-aware network for RGB-T salient object detection
    Wang, Yuxuan
    Dong, Feng
    Zhu, Jinchao
    Chen, Jianren
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (28) : 72153 - 72174
  • [23] Edge guided salient object detection
    Yang, Bing
    Zhang, Xiaoyun
    Chen, Li
    Yang, Hua
    Gao, Zhiyong
    [J]. NEUROCOMPUTING, 2017, 221 : 60 - 71
  • [24] WaveNet: Wavelet Network With Knowledge Distillation for RGB-T Salient Object Detection
    Zhou, Wujie
    Sun, Fan
    Jiang, Qiuping
    Cong, Runmin
    Hwang, Jenq-Neng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 3027 - 3039
  • [25] ECW-EGNet: Exploring Cross-Modal Weighting and Edge-Guided Decoder Network for RGB-D Salient Object Detection
    Xia, Chenxing
    Yang, Feng
    Duan, Songsong
    Gao, Xiuju
    Ge, Bin
    Li, Kuan-Ching
    Fang, Xianjin
    Zhang, Yan
    Yang, Ke
    [J]. COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2024, 21 (03)
  • [26] CAE-Net: Cross-Modal Attention Enhancement Network for RGB-T Salient Object Detection
    Lv, Chengtao
    Wan, Bin
    Zhou, Xiaofei
    Sun, Yaoqi
    Hu, Ji
    Zhang, Jiyong
    Yan, Chenggang
    [J]. ELECTRONICS, 2023, 12 (04)
  • [27] FEATURE ENHANCEMENT AND FUSION FOR RGB-T SALIENT OBJECT DETECTION
    Sun, Fengming
    Zhang, Kang
    Yuan, Xia
    Zhao, Chunxia
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1300 - 1304
  • [28] Feature aggregation with transformer for RGB-T salient object detection
    Zhang, Ping
    Xu, Mengnan
    Zhang, Ziyan
    Gao, Pan
    Zhang, Jing
    [J]. NEUROCOMPUTING, 2023, 546
  • [29] Revisiting Feature Fusion for RGB-T Salient Object Detection
    Zhang, Qiang
    Xiao, Tonglin
    Huang, Nianchang
    Zhang, Dingwen
    Han, Jungong
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (05) : 1804 - 1818
  • [30] Adaptive interactive network for RGB-T salient object detection with double mapping transformer
    Dong, Feng
    Wang, Yuxuan
    Zhu, Jinchao
    Li, Yuehua
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (20) : 59169 - 59193