Image saliency detection via multi-scale iterative CNN

被引:0
|
作者
Kun Huang
Shenghua Gao
机构
[1] Chinese Academy of Sciences,Shanghai Institute of Microsysterm and Information Technology
[2] ShanghaiTech University,School of Information Science and Technology
[3] University of Chinese Academy of Sciences,undefined
来源
The Visual Computer | 2020年 / 36卷
关键词
Saliency detection; Deep convolutional neural networks; Iterative error correction;
D O I
暂无
中图分类号
学科分类号
摘要
Salient object detection has received increasingly more attention and achieved significant progress lately due to the powerful features learned by deep convolutional neural networks (CNNs). In this work, we propose a multi-scale iterative CNN for salient object detection, which has two complementary subnetworks at different spatial scales. For each subnetwork, we augment the CNN structures with an iterative learning process to learn the saliency map, where early stages of the CNN give a rough estimate of the saliency map and the remaining errors are gradually learned to refine the saliency map. By merging predictions of the two subnetworks, the training error can be reduced significantly and the estimated saliency map becomes more accurate. Unlike some previous CNN-based methods which often rely on superpixel segmentations, the proposed model is fully CNN and hence can estimate the saliency map much more efficiently. Extensive experiments on standard benchmarks demonstrate that our method outperforms some of the state-of-the-art methods in terms of both accuracy and speed and achieves as good performance as some recent state-of-the-art end-to-end methods under fair settings.
引用
收藏
页码:1355 / 1367
页数:12
相关论文
共 50 条
  • [1] Image saliency detection via multi-scale iterative CNN
    Huang, Kun
    Gao, Shenghua
    [J]. VISUAL COMPUTER, 2020, 36 (07): : 1355 - 1367
  • [2] Saliency Detection Based on Multi-Scale Image Features
    Zheng, Chaoqun
    Zheng, Xiaozhi
    Wang, Guizhong
    Tian, Shuo
    Guo, Qiang
    [J]. 2016 IEEE 14TH INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, 14TH INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, 2ND INTL CONF ON BIG DATA INTELLIGENCE AND COMPUTING AND CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/DATACOM/CYBERSC, 2016, : 223 - 227
  • [3] Saliency Detection via Multi-Scale Global Cues
    Lin, Xiao
    Wang, Zhi-Jie
    Ma, Lizhuang
    Wu, Xiabao
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (07) : 1646 - 1659
  • [4] IMAGE SALIENCY DETECTION VIA MULTI-SCALE STATISTICAL NON-REDUNDANCY MODELING
    Scharfenberger, Christian
    Jain, Aanchal
    Wong, Alexander
    Fieguth, Paul
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 4294 - 4298
  • [5] Multi-scale Image Partitioning and Saliency Detection for Single Image Blind Deblurring
    Yan, Jiaqian
    Shi, Yu
    Hua, Xia
    Huang, Zhigao
    Li, Ruzhou
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PT IV, 2021, 13022 : 508 - 523
  • [6] Saliency Detection with Multi-Scale Superpixels
    Tong, Na
    Lu, Huchuan
    Zhang, Lihe
    Ruan, Xiang
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2014, 21 (09) : 1035 - 1039
  • [7] Accurate Multi-Scale License Plate Localization Via Image Saliency
    He, Tong
    Yao, Jian
    Zhang, Kao
    Hou, Yaolin
    Han, Shiyao
    [J]. 2014 IEEE 17TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2014, : 1567 - 1572
  • [8] Multi-focus image fusion using multi-scale image decomposition and saliency detection
    Bavirisetti, Durga Prasad
    Dhuli, Ravindra
    [J]. AIN SHAMS ENGINEERING JOURNAL, 2018, 9 (04) : 1103 - 1117
  • [9] Salient object detection via multi-scale attention CNN
    Ji, Yuzhu
    Zhang, Haijun
    Wu, Q. M. Jonathan
    [J]. NEUROCOMPUTING, 2018, 322 : 130 - 140
  • [10] Saliency Detection on Graph Manifold Ranking via Multi-scale Segmentation
    Yao, Yuxin
    Jin, Yucheng
    Xu, Zhengmei
    Wang, Huiling
    [J]. ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, BICS 2023, 2024, 14374 : 143 - 153