A novel graph-based optimization framework for salient object detection

被引:46
|
作者
Zhang, Jinxia [1 ,2 ]
Ehinger, Krista A. [3 ,4 ]
Wei, Haikun [1 ]
Zhang, Kanjian [1 ]
Yang, Jingyu [2 ]
机构
[1] Southeast Univ, Sch Automat, Key Lab Measurement & Control CSE, Minist Educ, Nanjing 210096, Jiangsu, Peoples R China
[2] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens In, Minist Educ, Nanjing 210094, Jiangsu, Peoples R China
[3] Brigham & Womens Hosp, Visual Attent Lab, Cambridge, MA 02139 USA
[4] Harvard Med Sch, Cambridge, MA 02139 USA
关键词
Optimization framework; Multiple graphs; Visual rarity; Saliency detection; REGION; MODEL; IMAGE; ATTENTION;
D O I
10.1016/j.patcog.2016.10.025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In traditional graph-based optimization framework for salient object detection, an image is over-segmented into superpixels and mapped to one single graph. The saliency value of each superpixel is then computed based on the similarity between connected nodes and the saliency related queries. When applying the traditional graph based optimization framework to the salient object detection problem in natural scene images, we observe at least two limitations: only one graph is employed to describe the information contained in an image and no cognitive property about visual saliency is explicitly modeled in the optimization framework. In this work, we propose a novel graph-based optimization framework for salient object detection. Firstly, we employ multiple graphs in our optimization framework. A natural scene image is usually complex, employing multiple graphs from different image properties can better describe the complex information contained in the image. Secondly, we model one popular cognitive property about visual saliency (visual rarity) in our graph-based optimization framework, making this framework more suitable for saliency detection problem. Specifically, we add a regularization term to constrain the saliency value of each superpixel according to visual rarity in our optimization framework. Our experimental results on four benchmark databases with comparisons to fifteen representative methods demonstrate that our graph-based optimization framework is effective and computationally efficient.
引用
收藏
页码:39 / 50
页数:12
相关论文
共 50 条
  • [1] A novel graph-based optimization framework for salient object detection (vol 64C, pg 39, 2017)
    Zhang, Jinxia
    Ehinger, Krista A.
    Wei, Haikun
    Zhang, Kanjian
    Yang, Jingyu
    [J]. PATTERN RECOGNITION, 2017, 71 : 387 - 388
  • [2] A novel optimization framework for salient object detection
    Zhang, Hanling
    Xu, Min
    Zhuo, Liyuan
    Havyarimana, Vincent
    [J]. VISUAL COMPUTER, 2016, 32 (01): : 31 - 41
  • [3] A novel optimization framework for salient object detection
    Hanling Zhang
    Min Xu
    Liyuan Zhuo
    Vincent Havyarimana
    [J]. The Visual Computer, 2016, 32 : 31 - 41
  • [4] Learning graph affinities for spectral graph-based salient object detection
    Aytekin, Caglar Caglar
    Iosifidis, Alexandros
    Kiranyaz, Serkan
    Gabbouj, Moncef
    [J]. PATTERN RECOGNITION, 2017, 64 : 159 - 167
  • [5] An improved graph-based manifold ranking for salient object detection
    School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing
    210094, China
    [J]. Dianzi Yu Xinxi Xuebao, 11 (2555-2563):
  • [6] A novel multi-graph framework for salient object detection
    Lu, Ye
    Zhou, Kedong
    Wu, Xiyin
    Gong, Penghan
    [J]. VISUAL COMPUTER, 2019, 35 (11): : 1683 - 1699
  • [7] A novel multi-graph framework for salient object detection
    Ye Lu
    Kedong Zhou
    Xiyin Wu
    Penghan Gong
    [J]. The Visual Computer, 2019, 35 : 1683 - 1699
  • [8] Salient Object Detection via Graph-Based Flexible Manifold Ranking
    Yang, Ying
    Jiang, Bo
    Xiao, Yun
    Tang, Jin
    [J]. ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, 2020, 11691 : 396 - 405
  • [9] Salient object detection based on novel graph model
    Pang, Yu
    Yu, Xiaosheng
    Wang, Ying
    Wu, Chengdong
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 65
  • [10] Graph-based Salient Object Detection Using Background and Foreground Connectivity Cues
    Abkenar, M. Rezaei
    Sadreazami, H.
    Ahmad, M. Omair
    [J]. 2019 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2019,