Deep Salient Object Detection With Contextual Information Guidance

被引:63
|
作者
Liu, Yi [1 ,2 ]
Han, Jungong [3 ]
Zhang, Qiang [1 ,2 ]
Shan, Caifeng [4 ]
机构
[1] Xidian Univ, Minist Educ, Key Lab Elect Equipment Struct Design, Xian 710071, Shaanxi, Peoples R China
[2] Xidian Univ, Ctr Complex Syst, Sch Mechanoelect Engn, Xian 710071, Shaanxi, Peoples R China
[3] Univ Warwick, WMG Data Sci, Coventry CV4 AL7, W Midlands, England
[4] Philips Res, NL-5656 AE Eindhoven, Netherlands
基金
中国国家自然科学基金;
关键词
Feature extraction; Object detection; Convolution; Semantics; Saliency detection; Neural networks; Object recognition; Salient object detection; convolutional neural networks (CNNs); group convolution; multi-level contextual information integration; VISUAL-ATTENTION; IMAGES;
D O I
10.1109/TIP.2019.2930906
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Integration of multi-level contextual information, such as feature maps and side outputs, is crucial for Convolutional Neural Networks (CNNs)-based salient object detection. However, most existing methods either simply concatenate multi-level feature maps or calculate element-wise addition of multi-level side outputs, thus failing to take full advantages of them. In this paper, we propose a new strategy for guiding multi-level contextual information integration, where feature maps and side outputs across layers are fully engaged. Specifically, shallower-level feature maps are guided by the deeper-level side outputs to learn more accurate properties of the salient object. In turn, the deeper-level side outputs can be propagated to high-resolution versions with spatial details complemented by means of shallower-level feature maps. Moreover, a group convolution module is proposed with the aim to achieve high-discriminative feature maps, in which the backbone feature maps are divided into a number of groups and then the convolution is applied to the channels of backbone feature maps within each group. Eventually, the group convolution module is incorporated in the guidance module to further promote the guidance role. Experiments on three public benchmark datasets verify the effectiveness and superiority of the proposed method over the state-of-the-art methods.
引用
下载
收藏
页码:360 / 374
页数:15
相关论文
共 50 条
  • [1] Deep Salient Object Detection with Contextual Information Guidance
    Liu, Yi
    Han, Jungong
    Zhang, Qiang
    Shan, Caifeng
    IEEE Transactions on Image Processing, 2020, 29 : 360 - 374
  • [2] Salient object detection by aggregating contextual information
    Liu, Yan
    Zhang, Yunzhou
    Liu, Shichang
    Coleman, Sonya
    Wang, Zhenyu
    Qiu, Feng
    PATTERN RECOGNITION LETTERS, 2022, 153 : 190 - 199
  • [3] Boundary Information Progressive Guidance Network for Salient Object Detection
    Yao, Zhaojian
    Wang, Luping
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 4236 - 4249
  • [4] Salient Object Detection by Contextual Refinement
    Bardhan, Sayanti
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 1464 - 1472
  • [5] Real-time salient object detection with boundary information guidance
    Wang, Yongxiong
    Chen, Kai
    Song, Yan
    NEUROCOMPUTING, 2020, 412 : 437 - 446
  • [6] Contextual Hypergraph Modeling for Salient Object Detection
    Li, Xi
    Li, Yao
    Shen, Chunhua
    Dick, Anthony
    van den Hengel, Anton
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 3328 - 3335
  • [7] Gated Contextual Features for Salient Object Detection
    Gupta, Ashish Kumar
    Seal, Ayan
    Khanna, Pritee
    Yazidi, Anis
    Krejcar, Ondrej
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [8] SALIENT OBJECT DETECTION WITH BOUNDARY INFORMATION
    Chen, Kai
    Wang, Yongxiong
    Hu, Chuanfei
    Shao, Hang
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [9] TFGNet: Traffic Salient Object Detection Using a Feature Deep Interaction and Guidance Fusion
    Jia, Ning
    Sun, Yougang
    Liu, Xianhui
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (03) : 3020 - 3030
  • [10] Salient object detection with side information
    Qiuning LI
    Yidong LI
    Congyan LANG
    Science China(Information Sciences), 2020, 63 (08) : 245 - 247