Cluster-Based Co-Saliency Detection

被引:335
|
作者
Fu, Huazhu [1 ]
Cao, Xiaochun [2 ]
Tu, Zhuowen [3 ]
机构
[1] Tianjin Univ, Sch Comp Sci & Technol, Tianjin 300072, Peoples R China
[2] Chinese Acad Sci, Inst Informat Engn, Key Lab Informat Secur, Beijing 100093, Peoples R China
[3] Univ Calif Los Angeles, Dept Neurol, Lab Neuro Imaging, Los Angeles, CA 90095 USA
基金
美国国家科学基金会;
关键词
Saliency detection; co-saliency; co-segmentation; weakly supervised learning; VISUAL-ATTENTION; IMAGE; DISCOVERY; COSEGMENTATION; SEGMENTATION; RECOGNITION;
D O I
10.1109/TIP.2013.2260166
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Co-saliency is used to discover the common saliency on the multiple images, which is a relatively underexplored area. In this paper, we introduce a new cluster-based algorithm for co-saliency detection. Global correspondence between the multiple images is implicitly learned during the clustering process. Three visual attention cues: contrast, spatial, and corresponding, are devised to effectively measure the cluster saliency. The final co-saliency maps are generated by fusing the single image saliency and multiimage saliency. The advantage of our method is mostly bottom-up without heavy learning, and has the property of being simple, general, efficient, and effective. Quantitative and qualitative experiments result in a variety of benchmark datasets demonstrating the advantages of the proposed method over the competing co-saliency methods. Our method on single image also outperforms most the state-of-the-art saliency detection methods. Furthermore, we apply the co-saliency method on four vision applications: co-segmentation, robust image distance, weakly supervised learning, and video foreground detection, which demonstrate the potential usages of the co-saliency map.
引用
收藏
页码:3766 / 3778
页数:13
相关论文
共 50 条
  • [1] Co-saliency Detection via cluster-based Structured Matrix Decomposition
    Liu, Zhengyi
    Shi, Song
    Duan, Quntao
    [J]. TENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2018), 2019, 11069
  • [2] Co-saliency Detection Based on Superpixel Clustering
    Zhu, Guiqian
    Ji, Yi
    Jiang, Xianjin
    Xu, Zenan
    Liu, Chunping
    [J]. KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT (KSEM 2017): 10TH INTERNATIONAL CONFERENCE, KSEM 2017, MELBOURNE, VIC, AUSTRALIA, AUGUST 19-20, 2017, PROCEEDINGS, 2017, 10412 : 287 - 295
  • [3] Co-saliency Detection Based on Hierarchical Consistency
    Li, Bo
    Sun, Zhengxing
    Wang, Quan
    Li, Qian
    [J]. PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 1392 - 1400
  • [4] Co-Saliency Detection Based on Hierarchical Segmentation
    Liu, Zhi
    Zou, Wenbin
    Li, Lina
    Shen, Liquan
    Le Meur, Olivier
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2014, 21 (01) : 88 - 92
  • [5] Exemplar-based image saliency and co-saliency detection
    Huang, Rui
    Feng, Wei
    Wang, Zezheng
    Xing, Yan
    Zou, Yaobin
    [J]. NEUROCOMPUTING, 2020, 371 : 147 - 157
  • [6] Video co-saliency detection
    Xie, Yufeng
    Ye, Linwei
    Liu, Zhi
    Zou, Xuemei
    [J]. EIGHTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2016), 2016, 10033
  • [7] PREATTENTIVE CO-SALIENCY DETECTION
    Chen, Hwann-Tzong
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 1117 - 1120
  • [8] A Review of Co-saliency Detection
    Qian, Xiao-Liang
    Bai, Zhen
    Chen, Yuan
    Zhang, Ding-Wen
    Shi, Kun-Feng
    Wang, Fang
    Wu, Qing-E
    Wu, Yuan-Yuan
    Wang, Wei
    [J]. Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2019, 47 (06): : 1352 - 1365
  • [9] CO-SALIENCY DETECTION VIA SIMILARITY-BASED SALIENCY PROPAGATION
    Ge, Chenjie
    Fu, Keren
    Li, Yijun
    Yang, Jie
    Shi, Pengfei
    Bai, Li
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 1845 - 1849
  • [10] Co-saliency Detection with Graph Matching
    Li, Zun
    Lang, Congyan
    Feng, Jiashi
    Li, Yidong
    Wang, Tao
    Feng, Songhe
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2019, 10 (03)