Absolute and Relative Depth-Induced Network for RGB-D Salient Object Detection

被引:1
|
作者
Kong, Yuqiu [1 ]
Wang, He [2 ]
Kong, Lingwei [3 ,4 ]
Liu, Yang [1 ]
Yao, Cuili [1 ]
Yin, Baocai [2 ]
机构
[1] Dalian Univ Technol, Sch Innovat & Entrepreneurship, Dalian 116024, Peoples R China
[2] Dalian Univ Technol, Sch Comp Sci & Technol, Dalian 116024, Peoples R China
[3] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116024, Peoples R China
[4] JD com, Mkt & Monetizat Ctr, JD Bldg 18 Kechuang 11 St, Beijing 101111, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
RGB-D salient object detection; multi-modal analysis and understanding; multi-modal fusion strategy; ATTENTION; FEATURES;
D O I
10.3390/s23073611
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Detecting salient objects in complicated scenarios is a challenging problem. Except for semantic features from the RGB image, spatial information from the depth image also provides sufficient cues about the object. Therefore, it is crucial to rationally integrate RGB and depth features for the RGB-D salient object detection task. Most existing RGB-D saliency detectors modulate RGB semantic features with absolution depth values. However, they ignore the appearance contrast and structure knowledge indicated by relative depth values between pixels. In this work, we propose a depth-induced network (DIN) for RGB-D salient object detection, to take full advantage of both absolute and relative depth information, and further, enforce the in-depth fusion of the RGB-D cross-modalities. Specifically, an absolute depth-induced module (ADIM) is proposed, to hierarchically integrate absolute depth values and RGB features, to allow the interaction between the appearance and structural information in the encoding stage. A relative depth-induced module (RDIM) is designed, to capture detailed saliency cues, by exploring contrastive and structural information from relative depth values in the decoding stage. By combining the ADIM and RDIM, we can accurately locate salient objects with clear boundaries, even from complex scenes. The proposed DIN is a lightweight network, and the model size is much smaller than that of state-of-the-art algorithms. Extensive experiments on six challenging benchmarks, show that our method outperforms most existing RGB-D salient object detection models.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] An adaptive guidance fusion network for RGB-D salient object detection
    Sun, Haodong
    Wang, Yu
    Ma, Xinpeng
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (02) : 1683 - 1693
  • [32] DMNet: Dynamic Memory Network for RGB-D Salient Object Detection
    Du, Haishun
    Zhang, Zhen
    Zhang, Minghao
    Qiao, Kangyi
    [J]. DIGITAL SIGNAL PROCESSING, 2023, 142
  • [33] Hierarchical Alternate Interaction Network for RGB-D Salient Object Detection
    Li, Gongyang
    Liu, Zhi
    Chen, Minyu
    Bai, Zhen
    Lin, Weisi
    Ling, Haibin
    [J]. IEEE Transactions on Image Processing, 2021, 30 : 3528 - 3542
  • [34] Context-aware network for RGB-D salient object detection
    Liang, Fangfang
    Duan, Lijuan
    Ma, Wei
    Qiao, Yuanhua
    Miao, Jun
    Ye, Qixiang
    [J]. PATTERN RECOGNITION, 2021, 111
  • [35] Scale Adaptive Fusion Network for RGB-D Salient Object Detection
    Kong, Yuqiu
    Zheng, Yushuo
    Yao, Cuili
    Liu, Yang
    Wang, He
    [J]. COMPUTER VISION - ACCV 2022, PT III, 2023, 13843 : 608 - 625
  • [36] An adaptive guidance fusion network for RGB-D salient object detection
    Haodong Sun
    Yu Wang
    Xinpeng Ma
    [J]. Signal, Image and Video Processing, 2024, 18 : 1683 - 1693
  • [37] Salient object detection for RGB-D images by generative adversarial network
    Liu, Zhengyi
    Tang, Jiting
    Xiang, Qian
    Zhao, Peng
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (35-36) : 25403 - 25425
  • [38] HiDAnet: RGB-D Salient Object Detection via Hierarchical Depth Awareness
    Wu, Zongwei
    Allibert, Guillaume
    Meriaudeau, Fabrice
    Ma, Chao
    Demonceaux, Cedric
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 2160 - 2173
  • [39] Salient object detection for RGB-D images by generative adversarial network
    Zhengyi Liu
    Jiting Tang
    Qian Xiang
    Peng Zhao
    [J]. Multimedia Tools and Applications, 2020, 79 : 25403 - 25425
  • [40] Synergizing triple attention with depth quality for RGB-D salient object detection
    Song, Peipei
    Li, Wenyu
    Zhong, Peiyan
    Zhang, Jing
    Konuisz, Piotr
    Duan, Feng
    Barnes, Nick
    [J]. NEUROCOMPUTING, 2024, 589