Salvage of Supervision in Weakly Supervised Object Detection

被引:10
|
作者
Sui, Lin [1 ]
Zhang, Chen-Lin [1 ,2 ]
Wu, Jianxin [1 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
[2] 4Paradigm Inc, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52688.2022.01383
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly supervised object detection (WSOD) has recently attracted much attention. However, the lack of bounding-box supervision makes its accuracy much lower than fully supervised object detection (FSOD), and currently modern FSOD techniques cannot be applied to WSOD. To bridge the performance and technical gaps between WSOD and FSOD, this paper proposes a new framework, Salvage of Supervision (SoS), with the key idea being to harness every potentially useful supervisory signal in WSOD: the weak image-level labels, the pseudo-labels, and the power of semi-supervised object detection. This paper proposes new approaches to utilize these weak and noisy signals effectively, and shows that each type of supervisory signal brings in notable improvements, outperforms existing WSOD methods (which mainly use only the weak labels) by large margins. The proposed SoS-WSOD method also has the ability to freely use modern FSOD techniques. SoSWSOD achieves 64.4 mAP(50) on VOC2007, 61.9 mAP(50) on VOC2012 and 16.6 mAP(50:95) on MS-COCO, and also has fast inference speed. Ablations and visualization further verify the effectiveness of SoS.
引用
收藏
页码:14207 / 14216
页数:10
相关论文
共 50 条
  • [41] Weakly-Supervised Salient Object Detection on Light Fields
    Liang, Zijian
    Wang, Pengjie
    Xu, Ke
    Zhang, Pingping
    Lau, Rynson W. H.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6295 - 6305
  • [42] Forget and Diversify: Regularized Refinement for Weakly Supervised Object Detection
    Son, Jeany
    Kim, Daniel
    Lee, Solae
    Kwak, Suha
    Cho, Minsu
    Han, Bohyung
    [J]. COMPUTER VISION - ACCV 2018, PT IV, 2019, 11364 : 632 - 648
  • [43] Weakly Supervised Object Detector Learning with Model Drift Detection
    Siva, Parthipan
    Xiang, Tao
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2011, : 343 - 350
  • [44] Enhanced Spatial Feature Learning for Weakly Supervised Object Detection
    Wu, Zhihao
    Wen, Jie
    Xu, Yong
    Yang, Jian
    Li, Xuelong
    Zhang, David
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) : 961 - 972
  • [45] Attention Erasing and Instance Sampling for Weakly Supervised Object Detection
    Xie, Xuan
    Cheng, Gong
    Feng, Xiaoxu
    Yao, Xiwen
    Qian, Xiaoliang
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 10
  • [46] Learning an Invariant and Equivariant Network for Weakly Supervised Object Detection
    Feng, Xiaoxu
    Yao, Xiwen
    Shen, Hui
    Cheng, Gong
    Xiao, Bin
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (10) : 11977 - 11992
  • [47] Activity and Relationship Modeling Driven Weakly Supervised Object Detection
    Li, Yinlin
    Qian, Yang
    Yang, Xu
    Zhang, Yuren
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 9628 - 9634
  • [48] Cyclic-Bootstrap Labeling for Weakly Supervised Object Detection
    Yin, Yufei
    Deng, Jiajun
    Zhou, Wengang
    Li, Li
    Li, Houqiang
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 6985 - 6995
  • [49] Self Paced Deep Learning for Weakly Supervised Object Detection
    Sangineto, Enver
    Nabi, Moin
    Culibrk, Dubravko
    Sebe, Nicu
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (03) : 712 - 725
  • [50] Weakly-supervised Human-object Interaction Detection
    Sugimoto, Masaki
    Furuta, Ryosuke
    Taniguchi, Yukinobu
    [J]. VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 293 - 300