Cluster-Based Co-Saliency Detection

被引:335
|
作者
Fu, Huazhu [1 ]
Cao, Xiaochun [2 ]
Tu, Zhuowen [3 ]
机构
[1] Tianjin Univ, Sch Comp Sci & Technol, Tianjin 300072, Peoples R China
[2] Chinese Acad Sci, Inst Informat Engn, Key Lab Informat Secur, Beijing 100093, Peoples R China
[3] Univ Calif Los Angeles, Dept Neurol, Lab Neuro Imaging, Los Angeles, CA 90095 USA
基金
美国国家科学基金会;
关键词
Saliency detection; co-saliency; co-segmentation; weakly supervised learning; VISUAL-ATTENTION; IMAGE; DISCOVERY; COSEGMENTATION; SEGMENTATION; RECOGNITION;
D O I
10.1109/TIP.2013.2260166
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Co-saliency is used to discover the common saliency on the multiple images, which is a relatively underexplored area. In this paper, we introduce a new cluster-based algorithm for co-saliency detection. Global correspondence between the multiple images is implicitly learned during the clustering process. Three visual attention cues: contrast, spatial, and corresponding, are devised to effectively measure the cluster saliency. The final co-saliency maps are generated by fusing the single image saliency and multiimage saliency. The advantage of our method is mostly bottom-up without heavy learning, and has the property of being simple, general, efficient, and effective. Quantitative and qualitative experiments result in a variety of benchmark datasets demonstrating the advantages of the proposed method over the competing co-saliency methods. Our method on single image also outperforms most the state-of-the-art saliency detection methods. Furthermore, we apply the co-saliency method on four vision applications: co-segmentation, robust image distance, weakly supervised learning, and video foreground detection, which demonstrate the potential usages of the co-saliency map.
引用
收藏
页码:3766 / 3778
页数:13
相关论文
共 50 条
  • [31] A Unified Metric Learning-Based Framework for Co-Saliency Detection
    Han, Junwei
    Cheng, Gong
    Li, Zhenpeng
    Zhang, Dingwen
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (10) : 2473 - 2483
  • [32] Co-saliency Detection Based on Convolutional Neural Network and Global Optimization
    Wu Zemin
    Wang Jun
    Hu Lei
    Tian Chang
    Zeng Mingyong
    Du Lin
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2018, 40 (12) : 2896 - 2904
  • [33] Re-Thinking the Relations in Co-Saliency Detection
    Tang, Lv
    Li, Bo
    Kuang, Senyun
    Song, Mofei
    Ding, Shouhong
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (08) : 5453 - 5466
  • [34] Efficient Saliency-Model-Guided Visual Co-Saliency Detection
    Li, Yijun
    Fu, Keren
    Liu, Zhi
    Yang, Jie
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (05) : 588 - 592
  • [35] Self-supervised image co-saliency detection
    Liu, Yan
    Li, Tengpeng
    Wu, Yang
    Song, Huihui
    Zhang, Kaihua
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2023, 105
  • [36] Co-saliency Detection via Looking Deep and Wide
    Zhang, Dingwen
    Han, Junwei
    Li, Chao
    Wang, Jingdong
    [J]. 2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 2994 - 3002
  • [37] CO-SALIENCY DETECTION VIA HIERARCHICAL CONSISTENCY MEASURE
    Zhang, Yonghua
    Li, Liang
    Cong, Runmin
    Guo, Xiaojie
    Xu, Hui
    Zhang, Jiawan
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2018,
  • [38] Robust Deep Co-Saliency Detection with Group Semantic
    Wang, Chong
    Zha, Zheng-Jun
    Liu, Dong
    Xie, Hongtao
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 8917 - 8924
  • [39] Co-saliency Detection via Weakly Supervised Learning
    Kompella, Aditya
    Kulkarni, Raghavendra V.
    [J]. 2018 9TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING TECHNOLOGIES (ICCCNT), 2018,
  • [40] Reverse collaborative fusion model for co-saliency detection
    Xiufang Wang
    Wei Wang
    Hongbo Bi
    Kang Wang
    [J]. The Visual Computer, 2022, 38 : 3911 - 3921