CSNet: a ConvNeXt-based Siamese network for RGB-D salient object detection

被引:2
|
作者
Zhang, Yunhua [1 ,2 ]
Wang, Hangxu [1 ]
Yang, Gang [1 ]
Zhang, Jianhao [1 ]
Gong, Congjin [1 ]
Wang, Yutao [1 ]
机构
[1] Northeastern Univ, Shenyang 110819, Peoples R China
[2] DUT Artificial Intelligence Inst, Dalian 116024, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 03期
基金
中国国家自然科学基金;
关键词
Salient object detection; Siamese network; ConvNeXt; RGB-D SOD; Multi-modality;
D O I
10.1007/s00371-023-02887-x
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Global contexts are critical to locating salient objects for salient object detection (SOD). However, the convolution operation in CNNs has a local receptive field, which cannot capture long-distance global information. Recent studies have shown that modernized CNN models with large kernel convolution, such as ConvNeXt, can effectively extend the receptive fields. Based on it, this paper explores the potential of large kernel CNN for SOD task. Inspired by the common information between RGB and depth images in salient objects, we propose a ConvNeXt-based Siamese network with shared weight parameters. This structural design can effectively reduce the number of parameters without sacrificing performance. Furthermore, a depth information preprocessing module is proposed to minimize the impact of low-quality depth images on predicted saliency maps. For cross-modal feature interaction, a dynamic fusion module is designed to enhance cross-modal complementarity dynamically. Extensive experiments and evaluation results on six benchmark datasets demonstrate the outstanding performance of the proposed method against 14 state-of-the-art RGB-D methods. Our code will be released at .
引用
收藏
页码:1805 / 1823
页数:19
相关论文
共 50 条
  • [11] DYNAMIC SELECTION NETWORK FOR RGB-D SALIENT OBJECT DETECTION
    Zhou, Jinlin
    Luo, Zhiming
    Li, Shaozi
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 776 - 780
  • [12] ICNet: Information Conversion Network for RGB-D Based Salient Object Detection
    Li, Gongyang
    Liu, Zhi
    Ling, Haibin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 4873 - 4884
  • [13] RGB-D salient object detection: A survey
    Tao Zhou
    Deng-Ping Fan
    Ming-Ming Cheng
    Jianbing Shen
    Ling Shao
    ComputationalVisualMedia, 2021, 7 (01) : 37 - 69
  • [14] RGB-D salient object detection: A survey
    Zhou, Tao
    Fan, Deng-Ping
    Cheng, Ming-Ming
    Shen, Jianbing
    Shao, Ling
    COMPUTATIONAL VISUAL MEDIA, 2021, 7 (01) : 37 - 69
  • [15] RGB-D salient object detection: A survey
    Tao Zhou
    Deng-Ping Fan
    Ming-Ming Cheng
    Jianbing Shen
    Ling Shao
    Computational Visual Media, 2021, 7 : 37 - 69
  • [16] Salient Object Detection in RGB-D Videos
    Mou, Ao
    Lu, Yukang
    He, Jiahao
    Min, Dingyao
    Fu, Keren
    Zhao, Qijun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6660 - 6675
  • [17] Calibrated RGB-D Salient Object Detection
    Ji, Wei
    Li, Jingjing
    Yu, Shuang
    Zhang, Miao
    Piao, Yongri
    Yao, Shunyu
    Bi, Qi
    Ma, Kai
    Zheng, Yefeng
    Lu, Huchuan
    Cheng, Li
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 9466 - 9476
  • [18] A salient object detection algorithm based on RGB-D images
    Song, Can
    Wu, Jin
    Deng, Huiping
    Zhu, Lei
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 1692 - 1697
  • [19] Bidirectional feature learning network for RGB-D salient object detection
    Niu, Ye
    Zhou, Sanping
    Dong, Yonghao
    Wang, Le
    Wang, Jinjun
    Zheng, Nanning
    PATTERN RECOGNITION, 2024, 150
  • [20] Hierarchical Alternate Interaction Network for RGB-D Salient Object Detection
    Li, Gongyang
    Liu, Zhi
    Chen, Minyu
    Bai, Zhen
    Lin, Weisi
    Ling, Haibin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3528 - 3542