Cluster-Based Co-Saliency Detection

被引:335
|
作者
Fu, Huazhu [1 ]
Cao, Xiaochun [2 ]
Tu, Zhuowen [3 ]
机构
[1] Tianjin Univ, Sch Comp Sci & Technol, Tianjin 300072, Peoples R China
[2] Chinese Acad Sci, Inst Informat Engn, Key Lab Informat Secur, Beijing 100093, Peoples R China
[3] Univ Calif Los Angeles, Dept Neurol, Lab Neuro Imaging, Los Angeles, CA 90095 USA
基金
美国国家科学基金会;
关键词
Saliency detection; co-saliency; co-segmentation; weakly supervised learning; VISUAL-ATTENTION; IMAGE; DISCOVERY; COSEGMENTATION; SEGMENTATION; RECOGNITION;
D O I
10.1109/TIP.2013.2260166
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Co-saliency is used to discover the common saliency on the multiple images, which is a relatively underexplored area. In this paper, we introduce a new cluster-based algorithm for co-saliency detection. Global correspondence between the multiple images is implicitly learned during the clustering process. Three visual attention cues: contrast, spatial, and corresponding, are devised to effectively measure the cluster saliency. The final co-saliency maps are generated by fusing the single image saliency and multiimage saliency. The advantage of our method is mostly bottom-up without heavy learning, and has the property of being simple, general, efficient, and effective. Quantitative and qualitative experiments result in a variety of benchmark datasets demonstrating the advantages of the proposed method over the competing co-saliency methods. Our method on single image also outperforms most the state-of-the-art saliency detection methods. Furthermore, we apply the co-saliency method on four vision applications: co-segmentation, robust image distance, weakly supervised learning, and video foreground detection, which demonstrate the potential usages of the co-saliency map.
引用
收藏
页码:3766 / 3778
页数:13
相关论文
共 50 条
  • [21] Co-Saliency Detection Based on Unified Hierarchical Graph Neural Network
    Liu, Bing
    Wang, Tiantian
    Fu, Ping
    Sun, Shaowei
    Li, Yongqiang
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2023, 35 (07): : 1010 - 1019
  • [22] CO-SALIENCY DETECTION VIA SEED PROPAGATION OVER THE INTEGRATED GRAPH WITH A CLUSTER LAYER
    Hwang, Insung
    Jeong, Dong-ju
    Park, Jae Sung
    Cho, Nam Ik
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2040 - 2044
  • [23] Co-Saliency Detection for RGBD Images Based on Effective Propagation Mechanism
    Jin, Zhigang
    Li, Jingkun
    Li, Dong
    [J]. IEEE ACCESS, 2019, 7 : 141311 - 141318
  • [24] SALIENCY AND CO-SALIENCY DETECTION BY LOW-RANK MULTISCALE FUSION
    Huang, Rui
    Feng, Wei
    Sun, Jizhou
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME), 2015,
  • [25] Unsupervised CNN-Based Co-saliency Detection with Graphical Optimization
    Hsu, Kuang-Jui
    Tsai, Chung-Chi
    Lin, Yen-Yu
    Qian, Xiaoning
    Chuang, Yung-Yu
    [J]. COMPUTER VISION - ECCV 2018, PT V, 2018, 11209 : 502 - 518
  • [26] Traffic sign detection based on visual co-saliency in complex scenes
    Yu, Lingli
    Xia, Xumei
    Zhou, Kaijun
    [J]. APPLIED INTELLIGENCE, 2019, 49 (02) : 764 - 790
  • [27] Traffic sign detection based on visual co-saliency in complex scenes
    Lingli Yu
    Xumei Xia
    Kaijun Zhou
    [J]. Applied Intelligence, 2019, 49 : 764 - 790
  • [28] HSCS: Hierarchical Sparsity Based Co-saliency Detection for RGBD Images
    Cong, Runmin
    Lei, Jianjun
    Fu, Huazhu
    Huang, Qingming
    Cao, Xiaochun
    Ling, Nam
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (07) : 1660 - 1671
  • [29] A model of co-saliency based audio attention
    Zhao, XiaoMing
    Wang, Xinxin
    Cheng, De
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (31-32) : 23045 - 23069
  • [30] RGBD Image Co-saliency Object Detection Based on Sample Selection
    Liu Zhengyi
    Liu Junlei
    Zhao Peng
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (09) : 2277 - 2284