Webly-supervised learning for salient object detection

被引:18
|
作者
Luo, Ao [1 ]
Li, Xin [2 ]
Yang, Fan [2 ]
Jiao, Zhicheng [3 ]
Cheng, Hong [1 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu 611731, Peoples R China
[2] Incept Inst Artificial Intelligence, Abu Dhabi, U Arab Emirates
[3] Univ N Carolina, Chapel Hill, NC 27599 USA
关键词
Salient object detection; Webly-supervised learning; Deep learning; OPTIMIZATION; FRAMEWORK; FUSION;
D O I
10.1016/j.patcog.2020.107308
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
End-to-end training of a deep CNN-Based model for salient object detection usually requires a huge number of training samples with pixel-level annotations, which are costly and time-consuming to obtain. In this paper, we propose an approach that can utilize large amounts of web data for learning a deep salient object detection model. With thousands of images collected from the Web, we first employ several bottom-up saliency detection techniques to generate salient object masks for all images, and then use a novel quality evaluation method to pick out a subset of images with reliable masks for training. After that, we develop a self-training approach to boost the performance of our initial network, which iterates between the network training process and the training set updating process. Importantly, different from existing webly-supervised or weakly-supervised methods, our approach is able to automatically select reliable images for network training without requiring any human intervention (e.g., dividing images into different difficulty levels). Results of extensive experiments on several widely-used benchmarks demonstrate that our method has achieved state-of-the-art performance. It significantly outperforms existing unsupervised and weakly-supervised salient object detection methods, and achieves competitive or even better performance than fully supervised approaches. (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Weakly supervised salient object detection via double object proposals guidance
    Zhou, Zhiheng
    Guo, Yongfan
    Dai, Ming
    Huang, Junchu
    Li, Xiangwei
    IET IMAGE PROCESSING, 2021, 15 (09) : 1957 - 1970
  • [42] Weakly-Supervised Salient Object Detection on Light Fields
    Liang, Zijian
    Wang, Pengjie
    Xu, Ke
    Zhang, Pingping
    Lau, Rynson W. H.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6295 - 6305
  • [43] A mix-supervised unified framework for salient object detection
    Jia, Fengwei
    Guan, Jian
    Qi, Shuhan
    Li, Huale
    Wang, Xuan
    APPLIED INTELLIGENCE, 2020, 50 (09) : 2945 - 2958
  • [44] A mix-supervised unified framework for salient object detection
    Fengwei Jia
    Jian Guan
    Shuhan Qi
    Huale Li
    Xuan Wang
    Applied Intelligence, 2020, 50 : 2945 - 2958
  • [45] Weakly Supervised Salient Object Detection Based on Image Semantics
    Zhao S.
    Wang P.
    Cao Q.
    Song H.
    Li W.
    Wang, Pengjie (pengjiewang@gmail.com), 1600, Institute of Computing Technology (33): : 270 - 277
  • [46] Weakly Supervised Salient Object Detection Using Image Labels
    Li, Guanbin
    Xie, Yuan
    Lin, Liang
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 7024 - 7031
  • [47] Weakly Supervised Salient Object Detection by Hierarchically Enhanced Scribbles
    Wang, Xiongying
    Al-Huda, Zaid
    Peng, Bo
    Tang, Xin
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (02)
  • [48] DNA: Deeply Supervised Nonlinear Aggregation for Salient Object Detection
    Liu, Yun
    Cheng, Ming-Ming
    Zhang, Xin-Yu
    Nie, Guang-Yu
    Wang, Meng
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (07) : 6131 - 6142
  • [49] Learning discriminative context for salient object detection
    Zhu, Ge
    Wang, Lei
    Tang, Jinping
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 131
  • [50] Salient Object Detection Using Reciprocal Learning
    Wu, Junjie
    Xia, Changqun
    Yu, Tianshu
    He, Zhentao
    Li, Jia
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IX, 2024, 14433 : 281 - 293