Multi-level and multi-scale deep saliency network for salient object detection

被引:6
|
作者
Zhang, Qing [1 ]
Lin, Jiajun [2 ]
Zhuge, Jingling [2 ]
Yuan, Wenhao [3 ]
机构
[1] Shanghai Inst Technol, Coll Comp Sci & Informat Engn, Shanghai 201418, Peoples R China
[2] East China Univ Sci & Technol, Coll Informat Sci & Engn, Shanghai 200237, Peoples R China
[3] Shandong Univ Technol, Coll Comp Sci & Technol, Zibo 255000, Peoples R China
基金
中国国家自然科学基金;
关键词
Saliency detection; Salient object detection; Fully convolutional neural network; Multi-scale features;
D O I
10.1016/j.jvcir.2019.01.034
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional saliency model usually utilize handcrafted image features and various prior knowledge to pop out salient regions from complex surroundings. In this paper, we propose a novel FCN-like deep convolutional neural network for pixel-wise salient object detection. Our deep network automatically learns multi-level feature from different convolutional layers of a pre-trained convolutional neural network. Moreover, deeper side outputs are connected to the shallower ones, which provides a better feature representation and helps shallow side outputs to accurately locate salient regions. In addition, we adopt a weighted-fusion module to combine different side outputs for utilizing multi-scale and multi-level features. Finally, a fully connected CRF model can be optimally incorporated to improve spatial coherence and contour localization in the fused saliency map. Both qualitative and quantitative evaluations on four publicly available datasets demonstrate the robustness and efficiency of our proposed approach against 17 state-of-the-art methods. (C) 2019 Elsevier Inc. All rights reserved.
引用
收藏
页码:415 / 424
页数:10
相关论文
共 50 条
  • [1] Multi-scale deep neural network for salient object detection
    Xiao, Fen
    Deng, Wenzheng
    Peng, Liangchan
    Cao, Chunhong
    Hu, Kai
    Gao, Xieping
    [J]. IET IMAGE PROCESSING, 2018, 12 (11) : 2036 - 2041
  • [2] Salient Object Detection Based on Deep Multi-level Cascade Network
    Sun, Dengdi
    Wu, Hang
    Ding, Zhuanlian
    Li, Sheng
    Luo, Bin
    [J]. ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, 2020, 11691 : 86 - 95
  • [3] Bmsmlet: boosting multi-scale information on multi-level aggregated features for salient object detection
    Wu, Ziwei
    Jia, Tong
    Wu, Yunhe
    Zeng, Zhikang
    Liang, Feng
    [J]. VISUAL COMPUTER, 2024, 40 (02): : 1131 - 1144
  • [4] A multi-scale multi-level deep descriptor with saliency for image retrieval
    Zebin Wu
    Junqing Yu
    [J]. Multimedia Tools and Applications, 2023, 82 : 37939 - 37958
  • [5] Bmsmlet: boosting multi-scale information on multi-level aggregated features for salient object detection
    Ziwei Wu
    Tong Jia
    Yunhe Wu
    Zhikang Zeng
    Feng Liang
    [J]. The Visual Computer, 2024, 40 (2) : 1131 - 1144
  • [6] Salient Object Detection Based on Multi-scale Feature Extraction and Multi-level Feature Fusion
    Li, Lingli
    Meng, Lingbing
    Li, Jinbao
    [J]. Gongcheng Kexue Yu Jishu/Advanced Engineering Sciences, 2021, 53 (01): : 170 - 177
  • [7] A multi-scale multi-level deep descriptor with saliency for image retrieval
    Wu, Zebin
    Yu, Junqing
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 82 (24) : 37939 - 37958
  • [8] Attention to the Scale : Deep Multi-Scale Salient Object Detection
    Zhang, Jing
    Dai, Yuchao
    Li, Bo
    He, Mingyi
    [J]. 2017 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING - TECHNIQUES AND APPLICATIONS (DICTA), 2017, : 105 - 111
  • [9] Multi-scale Interactive Network for Salient Object Detection
    Pang, Youwei
    Zhao, Xiaoqi
    Zhang, Lihe
    Lu, Huchuan
    [J]. arXiv, 2020,
  • [10] Multi-Scale Cascade Network for Salient Object Detection
    Li, Xin
    Yang, Fan
    Cheng, Hong
    Chen, Junyu
    Guo, Yuxiao
    Chen, Leiting
    [J]. PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, : 439 - 447