Deep Salient Object Detection With Contextual Information Guidance

被引:63
|
作者
Liu, Yi [1 ,2 ]
Han, Jungong [3 ]
Zhang, Qiang [1 ,2 ]
Shan, Caifeng [4 ]
机构
[1] Xidian Univ, Minist Educ, Key Lab Elect Equipment Struct Design, Xian 710071, Shaanxi, Peoples R China
[2] Xidian Univ, Ctr Complex Syst, Sch Mechanoelect Engn, Xian 710071, Shaanxi, Peoples R China
[3] Univ Warwick, WMG Data Sci, Coventry CV4 AL7, W Midlands, England
[4] Philips Res, NL-5656 AE Eindhoven, Netherlands
基金
中国国家自然科学基金;
关键词
Feature extraction; Object detection; Convolution; Semantics; Saliency detection; Neural networks; Object recognition; Salient object detection; convolutional neural networks (CNNs); group convolution; multi-level contextual information integration; VISUAL-ATTENTION; IMAGES;
D O I
10.1109/TIP.2019.2930906
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Integration of multi-level contextual information, such as feature maps and side outputs, is crucial for Convolutional Neural Networks (CNNs)-based salient object detection. However, most existing methods either simply concatenate multi-level feature maps or calculate element-wise addition of multi-level side outputs, thus failing to take full advantages of them. In this paper, we propose a new strategy for guiding multi-level contextual information integration, where feature maps and side outputs across layers are fully engaged. Specifically, shallower-level feature maps are guided by the deeper-level side outputs to learn more accurate properties of the salient object. In turn, the deeper-level side outputs can be propagated to high-resolution versions with spatial details complemented by means of shallower-level feature maps. Moreover, a group convolution module is proposed with the aim to achieve high-discriminative feature maps, in which the backbone feature maps are divided into a number of groups and then the convolution is applied to the channels of backbone feature maps within each group. Eventually, the group convolution module is incorporated in the guidance module to further promote the guidance role. Experiments on three public benchmark datasets verify the effectiveness and superiority of the proposed method over the state-of-the-art methods.
引用
收藏
页码:360 / 374
页数:15
相关论文
共 50 条
  • [21] Benchmarking deep models on salient object detection
    Zhou, Huajun
    Lin, Yang
    Yang, Lingxiao
    Lai, Jianhuang
    Xie, Xiaohua
    PATTERN RECOGNITION, 2024, 145
  • [22] Deep Embedding Features for Salient Object Detection
    Zhuge, Yunzhi
    Zeng, Yu
    Lu, Huchuan
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 9340 - 9347
  • [23] Deep Contrast Learning for Salient Object Detection
    Li, Guanbin
    Yu, Yizhou
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 478 - 487
  • [24] Deep Level Sets for Salient Object Detection
    Hu, Ping
    Shuai, Bing
    Liu, Jun
    Wang, Gang
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 540 - 549
  • [25] Quantifying Contextual Information for Object Detection
    Zheng, Wei-Shi
    Gong, Shaogang
    Xiang, Tao
    2009 IEEE 12TH INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2009, : 932 - 939
  • [26] Salient Object Detection: Integrate Salient Features in the Deep Learning Framework
    Chen, Qixin
    Liu, Tie
    Shang, Yuanyuan
    Shao, Zhuhong
    Ding, Hui
    IEEE ACCESS, 2019, 7 : 152483 - 152492
  • [27] Salient object detection using the phase information and object model
    Hooman Afsharirad
    Seyed Alireza Seyedin
    Multimedia Tools and Applications, 2019, 78 : 19061 - 19080
  • [28] Weakly supervised salient object detection via double object proposals guidance
    Zhou, Zhiheng
    Guo, Yongfan
    Dai, Ming
    Huang, Junchu
    Li, Xiangwei
    IET IMAGE PROCESSING, 2021, 15 (09) : 1957 - 1970
  • [29] CAGNet: Content-Aware Guidance for Salient Object Detection
    Mohammadi, Sina
    Noori, Mehrdad
    Bahri, Ali
    Majelan, Sina Ghofrani
    Havaei, Mohammad
    PATTERN RECOGNITION, 2020, 103
  • [30] DIG: dual interaction and guidance network for salient object detection
    Ning Jia
    Yufei Chen
    Xianhui Liu
    Hui Wang
    Applied Intelligence, 2023, 53 : 28039 - 28053