To Be Critical: Self-calibrated Weakly Supervised Learning for Salient Object Detection

被引:0
|
作者
Wang, Jian [1 ]
Liu, Tingwei [1 ]
Zhang, Miao [1 ,2 ]
Piao, Yongri [1 ]
机构
[1] Dalian Univ Technol, Dalian, Peoples R China
[2] Key Lab Ubiquitous Network & Serv Software Liaoni, Dalian, Peoples R China
基金
中国国家自然科学基金;
关键词
Salient object detection; Weakly supervised learning; Deep learning;
D O I
10.1007/978-981-99-8552-4_15
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly-supervised salient object detection (WSOD) aims to develop saliency models using image-level annotations. Despite of the success of previous works, explorations on an effective training strategy for the saliency network and accurate matches between image-level annotations and salient objects are still inadequate. In this work, 1) we propose a self-calibrated training strategy by explicitly establishing a mutual calibration loop between pseudo labels and network predictions, liberating the saliency network from error-prone propagation caused by pseudo labels. 2) we prove that even a much smaller dataset (merely 1.8% of ImageNet) with well-matched annotations can facilitate models to achieve better performance as well as generalizability. This sheds new light on the development of WSOD and encourages more contributions to the community. Comprehensive experiments demonstrate that our method outperforms all the existing WSOD methods by adopting the self-calibrated strategy only. Steady improvements are further achieved by training on the proposed dataset. Additionally, our method achieves 94.7% of the performance of fully-supervised methods on average. And what is more, the fully supervised models adopting our predicted results as "ground truths" achieve successful results (95.6% for BASNet and 97.3% for ITSD on F-measure), while costing only 0.32% of labeling time for pixel-level annotation. The code and dataset are available at https://github.com/DUTyimmy/SCW.
引用
收藏
页码:184 / 198
页数:15
相关论文
共 50 条
  • [1] Self-progress aggregate learning for weakly supervised salient object detection
    Sun, Wanchun
    Feng, Xin
    Liu, Jingyao
    Ma, Hui
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (06)
  • [2] Weakly Supervised Video Salient Object Detection
    Zhao, Wangbo
    Zhang, Jing
    Li, Long
    Barnes, Nick
    Liu, Nian
    Han, Junwei
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 16821 - 16830
  • [3] A novel seminar learning framework for weakly supervised salient object detection
    Liu, Yan
    Zhang, Yunzhou
    Wang, Zhenyu
    Yang, Fei
    Qiu, Feng
    Coleman, Sonya
    Kerr, Dermot
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [4] WUSL–SOD: Joint weakly supervised, unsupervised and supervised learning for salient object detection
    Yan Liu
    Yunzhou Zhang
    Zhenyu Wang
    Rong Ma
    Feng Qiu
    Sonya Coleman
    Dermot Kerr
    Neural Computing and Applications, 2023, 35 : 15837 - 15856
  • [5] Weakly Supervised Salient Object Detection with Box Annotation
    Jiang, Zhentao
    Chen, Qiang
    Jiang, Bo
    Leng, Cong
    Cheng, Jian
    PATTERN RECOGNITION, ACPR 2021, PT I, 2022, 13188 : 197 - 211
  • [6] A Weakly Supervised Learning Framework for Salient Object Detection via Hybrid Labels
    Cong, Runmin
    Qin, Qi
    Zhang, Chen
    Jiang, Qiuping
    Wang, Shiqi
    Zhao, Yao
    Kwong, Sam
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (02) : 534 - 548
  • [7] Noise-Sensitive Adversarial Learning for Weakly Supervised Salient Object Detection
    Piao, Yongri
    Wu, Wei
    Zhang, Miao
    Jiang, Yongyao
    Lu, Huchuan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 2888 - 2897
  • [8] WUSL-SOD: Joint weakly supervised, unsupervised and supervised learning for salient object detection
    Liu, Yan
    Zhang, Yunzhou
    Wang, Zhenyu
    Ma, Rong
    Qiu, Feng
    Coleman, Sonya
    Kerr, Dermot
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (21): : 15837 - 15856
  • [9] Self Paced Deep Learning for Weakly Supervised Object Detection
    Sangineto, Enver
    Nabi, Moin
    Culibrk, Dubravko
    Sebe, Nicu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (03) : 712 - 725
  • [10] Weakly Supervised Salient Object Detection by Learning A Classifier-Driven Map Generator
    Hsu, Kuang-Jui
    Lin, Yen-Yu
    Chuang, Yung-Yu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (11) : 5435 - 5449