EDGE-Net: an edge-guided enhanced network for RGB-T salient object detection

被引:0
|
作者
Zheng, Xin [1 ]
Wang, Boyang [1 ]
Ai, Liefu [1 ]
Tang, Pan [1 ]
Liu, Deyang [1 ,2 ]
机构
[1] Anqing Normal Univ, Sch Comp & Informat, Anqing, Peoples R China
[2] Shanghai Univ, Key Lab Specialty Fiber Opt & Opt Access Networks, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
RGB-T data; salient object detection; information fusion; multi-modality; VISUAL-ATTENTION; IMAGE; SCENE; MODEL;
D O I
10.1117/1.JEI.32.6.063032
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With similar textures, dark backgrounds, and complex scenes, RGB images are usually unable to provide discriminative information for model training, which often leads to inaccurate prediction results. Compared with RGB salient object detection (SOD) methods, RGB-T SOD have thermal infrared (TIR) information as an informational supplement. As a result, RGB-T SOD can adapt to more complex environments and achieve better results. However, existing methods do not efficiently integrate features between different modalities and do not fully exploit spatial information from the shallow-level features. Accordingly, we propose an EDGE-Net. First, we propose an edge extraction module to capture the edge information in the shallow-level features and use it to guide the subsequent decoding. The original edge features are then weighted after channel attention processing. Second, to additionally suppress the noise of the shallow-level features, we design a global information extraction module. In this module, multiple convolutions are used instead of single convolutions to reduce the computational effort, and convolutions with different dilation rates are used to obtain different receptive fields. We conduct extensive experiments on the RGB-T dataset and show that the proposed method achieves superior performance compared to several state-of-the-art algorithms. The code and results of our method are available in a Github repository available at: https://github.com/BorreloadD/EDGE-Net.git.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Enabling modality interactions for RGB-T salient object detection
    Zhang, Qiang
    Xi, Ruida
    Xiao, Tonglin
    Huang, Nianchang
    Luo, Yongjiang
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 222
  • [32] Scribble-Supervised RGB-T Salient Object Detection
    Liu, Zhengyi
    Huang, Xiaoshen
    Zhang, Guanghui
    Fang, Xianyong
    Wang, Linbo
    Tang, Bin
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2369 - 2374
  • [33] Saliency Prototype for RGB-D and RGB-T Salient Object Detection
    Zhang, Zihao
    Wang, Jie
    Han, Yahong
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3696 - 3705
  • [34] EMNet: Edge-guided multi-level network for salient object detection in low-light images
    Jing, Lianghu
    Wang, Bo
    [J]. IMAGE AND VISION COMPUTING, 2024, 143
  • [35] Edge-Guided Feature Pyramid Networks: An Edge-Guided Model for Enhanced Small Target Detection
    Liang, Zimeng
    Shen, Hua
    [J]. Sensors, 2024, 24 (23)
  • [36] ECFFNet: Effective and Consistent Feature Fusion Network for RGB-T Salient Object Detection
    Zhou, Wujie
    Guo, Qinling
    Lei, Jingsheng
    Yu, Lu
    Hwang, Jenq-Neng
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) : 1224 - 1235
  • [37] Asymmetric cross-modal activation network for RGB-T salient object detection
    Xu, Chang
    Li, Qingwu
    Zhou, Qingkai
    Jiang, Xiongbiao
    Yu, Dabing
    Zhou, Yaqin
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 258
  • [38] TSFNet: Two-Stage Fusion Network for RGB-T Salient Object Detection
    Guo, Qinling
    Zhou, Wujie
    Lei, Jingsheng
    Yu, Lu
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 1655 - 1659
  • [39] CFRNet: Cross-Attention-Based Fusion and Refinement Network for Enhanced RGB-T Salient Object Detection
    Deng, Biao
    Liu, Di
    Cao, Yang
    Liu, Hong
    Yan, Zhiguo
    Chen, Hu
    [J]. Sensors, 2024, 24 (22)
  • [40] Edge-guided representation learning for underwater object detection
    Dai, Linhui
    Liu, Hong
    Song, Pinhao
    Tang, Hao
    Ding, Runwei
    Li, Shengquan
    [J]. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2024, 9 (05) : 1078 - 1091