Cluster-Based Co-Saliency Detection

被引:335
|
作者
Fu, Huazhu [1 ]
Cao, Xiaochun [2 ]
Tu, Zhuowen [3 ]
机构
[1] Tianjin Univ, Sch Comp Sci & Technol, Tianjin 300072, Peoples R China
[2] Chinese Acad Sci, Inst Informat Engn, Key Lab Informat Secur, Beijing 100093, Peoples R China
[3] Univ Calif Los Angeles, Dept Neurol, Lab Neuro Imaging, Los Angeles, CA 90095 USA
基金
美国国家科学基金会;
关键词
Saliency detection; co-saliency; co-segmentation; weakly supervised learning; VISUAL-ATTENTION; IMAGE; DISCOVERY; COSEGMENTATION; SEGMENTATION; RECOGNITION;
D O I
10.1109/TIP.2013.2260166
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Co-saliency is used to discover the common saliency on the multiple images, which is a relatively underexplored area. In this paper, we introduce a new cluster-based algorithm for co-saliency detection. Global correspondence between the multiple images is implicitly learned during the clustering process. Three visual attention cues: contrast, spatial, and corresponding, are devised to effectively measure the cluster saliency. The final co-saliency maps are generated by fusing the single image saliency and multiimage saliency. The advantage of our method is mostly bottom-up without heavy learning, and has the property of being simple, general, efficient, and effective. Quantitative and qualitative experiments result in a variety of benchmark datasets demonstrating the advantages of the proposed method over the competing co-saliency methods. Our method on single image also outperforms most the state-of-the-art saliency detection methods. Furthermore, we apply the co-saliency method on four vision applications: co-segmentation, robust image distance, weakly supervised learning, and video foreground detection, which demonstrate the potential usages of the co-saliency map.
引用
收藏
页码:3766 / 3778
页数:13
相关论文
共 50 条
  • [41] Cluster-based point set saliency
    Tasse, Flora Ponjou
    Kosinka, Jiri
    Dodgson, Neil
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 163 - 171
  • [42] A model of co-saliency based audio attention
    XiaoMing Zhao
    Xinxin Wang
    De Cheng
    [J]. Multimedia Tools and Applications, 2020, 79 : 23045 - 23069
  • [43] Reverse collaborative fusion model for co-saliency detection
    Wang, Xiufang
    Wang, Wei
    Bi, Hongbo
    Wang, Kang
    [J]. VISUAL COMPUTER, 2022, 38 (11): : 3911 - 3921
  • [44] IMAGE CO-SALIENCY DETECTION BY PROPAGATING SUPERPIXEL AFFINITIES
    Tan, Zhiyu
    Wan, Liang
    Feng, Wei
    Pun, Chi-Man
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 2114 - 2118
  • [45] MULTIPLE GRAPH CONVOLUTIONAL NETWORKS FOR CO-SALIENCY DETECTION
    Jiang, Bo
    Jiang, Xingyue
    Tang, Jin
    Luo, Bin
    Huang, Shilei
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 332 - 337
  • [46] Consistent image processing based on co-saliency
    Ren, Xiangnan
    Li, Jinjiang
    Hua, Zhen
    Jiang, Xinbo
    [J]. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2021, 6 (03) : 324 - 337
  • [47] Group-wise Deep Co-saliency Detection
    Wei, Lina
    Zhao, Shanshan
    Bourahla, Omar El Farouk
    Li, Xi
    Wu, Fei
    [J]. PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 3041 - 3047
  • [48] Implicit Rank-Sparsity Decomposition: Applications to Saliency/Co-Saliency Detection
    Chen, Yi-Lei
    Hsu, Chiou-Ting
    [J]. 2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 2305 - 2310
  • [49] IMAGE CO-SALIENCY DETECTION VIA LOCALLY ADAPTIVE SALIENCY MAP FUSION
    Tsai, Chung-Chi
    Qian, Xiaoning
    Lin, Yen-Yu
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 1897 - 1901
  • [50] Co-saliency detection based on objectness and multi-layer linear model
    Jin, Zhi-Gang
    Li, Jing-Kun
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2019, 27 (08): : 1845 - 1853