Detection of Co-salient Objects by Looking Deep and Wide

被引:295
|
作者
Zhang, Dingwen [1 ]
Han, Junwei [1 ]
Li, Chao [1 ]
Wang, Jingdong [2 ]
Li, Xuelong [3 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian 710072, Peoples R China
[2] Microsoft Res Asia, Beijing, Peoples R China
[3] Chinese Acad Sci, Xian Inst Opt & Precis Mech, Xian, Peoples R China
基金
美国国家科学基金会;
关键词
Co-saliency detection; Domain adaptive convolutional neural network; Bayesian framework; COSEGMENTATION; SEGMENTATION; EXTRACTION; DISCOVERY; MODEL;
D O I
10.1007/s11263-016-0907-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a unified co-salient object detection framework by introducing two novel insights: (1) looking deep to transfer higher-level representations by using the convolutional neural network with additional adaptive layers could better reflect the sematic properties of the co-salient objects; (2) looking wide to take advantage of the visually similar neighbors from other image groups could effectively suppress the influence of the common background regions. The wide and deep information are explored for the object proposal windows extracted in each image. The window-level co-saliency scores are calculated by integrating the intra-image contrast, the intra-group consistency, and the inter-group separability via a principled Bayesian formulation and are then converted to the superpixel-level co-saliency maps through a foreground region agreement strategy. Comprehensive experiments on two existing and one newly established datasets have demonstrated the consistent performance gain of the proposed approach.
引用
收藏
页码:215 / 232
页数:18
相关论文
共 50 条
  • [1] Detection of Co-salient Objects by Looking Deep and Wide
    Dingwen Zhang
    Junwei Han
    Chao Li
    Jingdong Wang
    Xuelong Li
    International Journal of Computer Vision, 2016, 120 : 215 - 232
  • [2] Detecting Co-Salient Objects in Large Image Sets
    Du, Shuze
    Chen, Shifeng
    IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (02) : 145 - 148
  • [3] Two-stage Co-salient Object Detection
    Wang, Zuyi
    Zhang, Lihe
    2017 10TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION (ICICTA 2017), 2017, : 287 - 290
  • [4] Co-Salient Object Detection From Multiple Images
    Li, Hongliang
    Meng, Fanman
    Ngan, King Ngi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2013, 15 (08) : 1896 - 1909
  • [5] Group Collaborative Learning for Co-Salient Object Detection
    Fan, Qi
    Fan, Deng-Ping
    Fu, Huazhu
    Tang, Chi-Keung
    Shao, Ling
    Tai, Yu-Wing
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12283 - 12293
  • [6] Co-Salient Object Detection With Co-Representation Purification
    Zhu, Ziyue
    Zhang, Zhao
    Lin, Zheng
    Sun, Xing
    Cheng, Ming-Ming
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (07) : 8193 - 8205
  • [7] Re-Thinking Co-Salient Object Detection
    Fan, Deng-Ping
    Li, Tengpeng
    Lin, Zheng
    Ji, Ge-Peng
    Zhang, Dingwen
    Cheng, Ming-Ming
    Fu, Huazhu
    Shen, Jianbing
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (08) : 4339 - 4354
  • [8] Taking a Deeper Look at Co-Salient Object Detection
    Fan, Deng-Ping
    Lin, Zheng
    Ji, Ge-Peng
    Zhang, Dingwen
    Fu, Huazhu
    Cheng, Ming-Ming
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2916 - 2926
  • [9] Similarity activation map for co-salient object detection
    Wang, Yu
    Li, Shuxiao
    PATTERN RECOGNITION LETTERS, 2022, 163 : 159 - 167
  • [10] Group attention retention network for co-salient object detection
    Jing Liu
    Jiaxiang Wang
    Zhiwei Fan
    Min Yuan
    Weikang Wang
    Jiexiao Yu
    Machine Vision and Applications, 2023, 34