EDGE-Net: an edge-guided enhanced network for RGB-T salient object detection

被引:0
|
作者
Zheng, Xin [1 ]
Wang, Boyang [1 ]
Ai, Liefu [1 ]
Tang, Pan [1 ]
Liu, Deyang [1 ,2 ]
机构
[1] Anqing Normal Univ, Sch Comp & Informat, Anqing, Peoples R China
[2] Shanghai Univ, Key Lab Specialty Fiber Opt & Opt Access Networks, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
RGB-T data; salient object detection; information fusion; multi-modality; VISUAL-ATTENTION; IMAGE; SCENE; MODEL;
D O I
10.1117/1.JEI.32.6.063032
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With similar textures, dark backgrounds, and complex scenes, RGB images are usually unable to provide discriminative information for model training, which often leads to inaccurate prediction results. Compared with RGB salient object detection (SOD) methods, RGB-T SOD have thermal infrared (TIR) information as an informational supplement. As a result, RGB-T SOD can adapt to more complex environments and achieve better results. However, existing methods do not efficiently integrate features between different modalities and do not fully exploit spatial information from the shallow-level features. Accordingly, we propose an EDGE-Net. First, we propose an edge extraction module to capture the edge information in the shallow-level features and use it to guide the subsequent decoding. The original edge features are then weighted after channel attention processing. Second, to additionally suppress the noise of the shallow-level features, we design a global information extraction module. In this module, multiple convolutions are used instead of single convolutions to reduce the computational effort, and convolutions with different dilation rates are used to obtain different receptive fields. We conduct extensive experiments on the RGB-T dataset and show that the proposed method achieves superior performance compared to several state-of-the-art algorithms. The code and results of our method are available in a Github repository available at: https://github.com/BorreloadD/EDGE-Net.git.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Edge-guided feature fusion network for RGB-T salient object detection
    Chen, Yuanlin
    Sun, Zengbao
    Yan, Cheng
    Zhao, Ming
    [J]. Frontiers in Neurorobotics, 2024, 18
  • [2] BCNet: Bidirectional collaboration network for edge-guided salient object detection
    Dong, Bo
    Zhou, Yan
    Hu, Chuanfei
    Fu, Keren
    Chen, Geng
    [J]. NEUROCOMPUTING, 2021, 437 : 58 - 71
  • [3] Weighted Guided Optional Fusion Network for RGB-T Salient Object Detection
    Wang, Jie
    Li, Guoqiang
    Shi, Jie
    Xi, Jinwen
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (05)
  • [4] A cross-modal edge-guided salient object detection for RGB-D image
    Liu, Zhengyi
    Wang, Kaixun
    Dong, Hao
    Wang, Yuan
    [J]. NEUROCOMPUTING, 2021, 454 : 168 - 177
  • [5] Salient Object Detection With Edge-Guided Learning and Specific Aggregation
    Zhang, Liqian
    Zhang, Qing
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (01) : 534 - 548
  • [6] MSEDNet: Multi-scale fusion and edge-supervised network for RGB-T salient object detection
    Peng, Daogang
    Zhou, Weiyi
    Pan, Junzhen
    Wang, Danhao
    [J]. NEURAL NETWORKS, 2024, 171 : 410 - 422
  • [7] CGFNet: Cross-Guided Fusion Network for RGB-T Salient Object Detection
    Wang, Jie
    Song, Kechen
    Bao, Yanqi
    Huang, Liming
    Yan, Yunhui
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (05) : 2949 - 2961
  • [8] Edge-Guided Non-Local Fully Convolutional Network for Salient Object Detection
    Tu, Zhengzheng
    Ma, Yan
    Li, Chenglong
    Tang, Jin
    Luo, Bin
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (02) : 582 - 593
  • [9] Multi-enhanced Adaptive Attention Network for RGB-T Salient Object Detection
    Hao, Hao-Zhou
    Cheng, Yao
    Ji, Yi
    Li, Ying
    Liu, Chun-Ping
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [10] EAF-Net: an enhancement and aggregation–feedback network for RGB-T salient object detection
    Haiyang He
    Jing Wang
    Xiaolin Li
    Minglin Hong
    Shiguo Huang
    Tao Zhou
    [J]. Machine Vision and Applications, 2022, 33