EDGE-Net: an edge-guided enhanced network for RGB-T salient object detection

被引:0
|
作者
Zheng, Xin [1 ]
Wang, Boyang [1 ]
Ai, Liefu [1 ]
Tang, Pan [1 ]
Liu, Deyang [1 ,2 ]
机构
[1] Anqing Normal Univ, Sch Comp & Informat, Anqing, Peoples R China
[2] Shanghai Univ, Key Lab Specialty Fiber Opt & Opt Access Networks, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
RGB-T data; salient object detection; information fusion; multi-modality; VISUAL-ATTENTION; IMAGE; SCENE; MODEL;
D O I
10.1117/1.JEI.32.6.063032
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With similar textures, dark backgrounds, and complex scenes, RGB images are usually unable to provide discriminative information for model training, which often leads to inaccurate prediction results. Compared with RGB salient object detection (SOD) methods, RGB-T SOD have thermal infrared (TIR) information as an informational supplement. As a result, RGB-T SOD can adapt to more complex environments and achieve better results. However, existing methods do not efficiently integrate features between different modalities and do not fully exploit spatial information from the shallow-level features. Accordingly, we propose an EDGE-Net. First, we propose an edge extraction module to capture the edge information in the shallow-level features and use it to guide the subsequent decoding. The original edge features are then weighted after channel attention processing. Second, to additionally suppress the noise of the shallow-level features, we design a global information extraction module. In this module, multiple convolutions are used instead of single convolutions to reduce the computational effort, and convolutions with different dilation rates are used to obtain different receptive fields. We conduct extensive experiments on the RGB-T dataset and show that the proposed method achieves superior performance compared to several state-of-the-art algorithms. The code and results of our method are available in a Github repository available at: https://github.com/BorreloadD/EDGE-Net.git.
引用
收藏
页数:15
相关论文
共 50 条
  • [11] Efficient Context-Guided Stacked Refinement Network for RGB-T Salient Object Detection
    Huo, Fushuo
    Zhu, Xuegui
    Zhang, Lei
    Liu, Qifeng
    Shu, Yu
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (05) : 3111 - 3124
  • [12] PSNet: Parallel symmetric network for RGB-T salient object detection
    Bi, Hongbo
    Wu, Ranwan
    Liu, Ziqi
    Zhang, Jiayuan
    Zhang, Cong
    Xiang, Tian-Zhu
    Wang, Xiufang
    [J]. NEUROCOMPUTING, 2022, 511 (410-425) : 410 - 425
  • [13] Modal complementary fusion network for RGB-T salient object detection
    Ma, Shuai
    Song, Kechen
    Dong, Hongwen
    Tian, Hongkun
    Yan, Yunhui
    [J]. APPLIED INTELLIGENCE, 2023, 53 (08) : 9038 - 9055
  • [14] Edge-Guided Recurrent Positioning Network for Salient Object Detection in Optical Remote Sensing Images
    Zhou, Xiaofei
    Shen, Kunye
    Weng, Li
    Cong, Runmin
    Zheng, Bolun
    Zhang, Jiyong
    Yan, Chenggang
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (01) : 539 - 552
  • [15] SIA: RGB-T salient object detection network with salient-illumination awareness
    Song, Kechen
    Wen, Hongwei
    Ji, Yingying
    Xue, Xiaotong
    Huang, Liming
    Yan, Yunhui
    Meng, Qinggang
    [J]. OPTICS AND LASERS IN ENGINEERING, 2024, 172
  • [16] Modal complementary fusion network for RGB-T salient object detection
    Shuai Ma
    Kechen Song
    Hongwen Dong
    Hongkun Tian
    Yunhui Yan
    [J]. Applied Intelligence, 2023, 53 : 9038 - 9055
  • [17] SwinNet: Swin Transformer Drives Edge-Aware RGB-D and RGB-T Salient Object Detection
    Liu, Zhengyi
    Tan, Yacheng
    He, Qian
    Xiao, Yun
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (07) : 4486 - 4497
  • [18] EAF-Net: an enhancement and aggregation-feedback network for RGB-T salient object detection
    He, Haiyang
    Wang, Jing
    Li, Xiaolin
    Hong, Minglin
    Huang, Shiguo
    Zhou, Tao
    [J]. MACHINE VISION AND APPLICATIONS, 2022, 33 (04)
  • [19] CGMDRNet: Cross-Guided Modality Difference Reduction Network for RGB-T Salient Object Detection
    Chen, Gang
    Shao, Feng
    Chai, Xiongli
    Chen, Hangwei
    Jiang, Qiuping
    Meng, Xiangchao
    Ho, Yo-Sung
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (09) : 6308 - 6323
  • [20] Pyramid contract-based network for RGB-T salient object detection
    Ranwan Wu
    Hongbo Bi
    Cong Zhang
    Jiayuan Zhang
    Yuyu Tong
    Wei Jin
    Zhigang Liu
    [J]. Multimedia Tools and Applications, 2024, 83 : 20805 - 20825