Detection of Co-salient Objects by Looking Deep and Wide

被引:295
|
作者
Zhang, Dingwen [1 ]
Han, Junwei [1 ]
Li, Chao [1 ]
Wang, Jingdong [2 ]
Li, Xuelong [3 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian 710072, Peoples R China
[2] Microsoft Res Asia, Beijing, Peoples R China
[3] Chinese Acad Sci, Xian Inst Opt & Precis Mech, Xian, Peoples R China
基金
美国国家科学基金会;
关键词
Co-saliency detection; Domain adaptive convolutional neural network; Bayesian framework; COSEGMENTATION; SEGMENTATION; EXTRACTION; DISCOVERY; MODEL;
D O I
10.1007/s11263-016-0907-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a unified co-salient object detection framework by introducing two novel insights: (1) looking deep to transfer higher-level representations by using the convolutional neural network with additional adaptive layers could better reflect the sematic properties of the co-salient objects; (2) looking wide to take advantage of the visually similar neighbors from other image groups could effectively suppress the influence of the common background regions. The wide and deep information are explored for the object proposal windows extracted in each image. The window-level co-saliency scores are calculated by integrating the intra-image contrast, the intra-group consistency, and the inter-group separability via a principled Bayesian formulation and are then converted to the superpixel-level co-saliency maps through a foreground region agreement strategy. Comprehensive experiments on two existing and one newly established datasets have demonstrated the consistent performance gain of the proposed approach.
引用
收藏
页码:215 / 232
页数:18
相关论文
共 50 条
  • [21] Co-saliency Detection via Looking Deep and Wide
    Zhang, Dingwen
    Han, Junwei
    Li, Chao
    Wang, Jingdong
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 2994 - 3002
  • [22] Co-Salient Object Detection with Semantic-Level Consensus Extraction and Dispersion
    Xu, Peiran
    Mu, Yadong
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 2744 - 2755
  • [23] Democracy Does Matter: Comprehensive Feature Mining for Co-Salient Object Detection
    Yu, Siyue
    Xiao, Jimin
    Zhang, Bingfeng
    Lim, Eng Gee
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 969 - 978
  • [24] TCNet: Co-Salient Object Detection via Parallel Interaction of Transformers and CNNs
    Ge, Yanliang
    Zhang, Qiao
    Xiang, Tian-Zhu
    Zhang, Cong
    Bi, Hongbo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (06) : 2600 - 2615
  • [25] Global-guided cross-reference network for co-salient object detection
    Liu, Zhengyi
    Dong, Hao
    Zhang, Zhili
    Xiao, Yun
    MACHINE VISION AND APPLICATIONS, 2022, 33 (05)
  • [26] Global-guided cross-reference network for co-salient object detection
    Zhengyi Liu
    Hao Dong
    Zhili Zhang
    Yun Xiao
    Machine Vision and Applications, 2022, 33
  • [27] Co-Salient Object Detection with Uncertainty-aware Group Exchange-Masking
    Wu, Yang
    Song, Huihui
    Liu, Bo
    Zhang, Kaihua
    Liu, Dong
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 19639 - 19648
  • [28] SPARSE CODING-BASED CO-SALIENT OBJECT DETECTION WITH APPLICATION TO VIDEO ABSTRACTION
    Chen, Duan-Yu
    Lin, Chuan-Yu
    Yang, Nien-Tzu
    Yu, Jen-Yu
    PROCEEDINGS OF 2013 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOLS 1-4, 2013, : 1474 - 1479
  • [29] Learning Implicit Class Knowledge for RGB-D Co-Salient Object Detection With Transformers
    Zhang, Ni
    Han, Junwei
    Liu, Nian
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 4556 - 4570
  • [30] GSNNet: Group semantic-guided neighbor interaction network for co-salient object detection
    Ge, Yanliang
    Zhang, Qiao
    Xiang, Tian-Zhu
    Zhang, Cong
    Zhang, Jing
    Bi, Hongbo
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 227