Salvage of Supervision in Weakly Supervised Object Detection

被引:11
|
作者
Sui, Lin [1 ]
Zhang, Chen-Lin [1 ,2 ]
Wu, Jianxin [1 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
[2] 4Paradigm Inc, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52688.2022.01383
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly supervised object detection (WSOD) has recently attracted much attention. However, the lack of bounding-box supervision makes its accuracy much lower than fully supervised object detection (FSOD), and currently modern FSOD techniques cannot be applied to WSOD. To bridge the performance and technical gaps between WSOD and FSOD, this paper proposes a new framework, Salvage of Supervision (SoS), with the key idea being to harness every potentially useful supervisory signal in WSOD: the weak image-level labels, the pseudo-labels, and the power of semi-supervised object detection. This paper proposes new approaches to utilize these weak and noisy signals effectively, and shows that each type of supervisory signal brings in notable improvements, outperforms existing WSOD methods (which mainly use only the weak labels) by large margins. The proposed SoS-WSOD method also has the ability to freely use modern FSOD techniques. SoSWSOD achieves 64.4 mAP(50) on VOC2007, 61.9 mAP(50) on VOC2012 and 16.6 mAP(50:95) on MS-COCO, and also has fast inference speed. Ablations and visualization further verify the effectiveness of SoS.
引用
收藏
页码:14207 / 14216
页数:10
相关论文
共 50 条
  • [31] Dynamic sample weighting for weakly supervised object detection
    Li, Xuewei
    Yi, Song
    Zhang, Ruixuan
    Fu, Xuzhou
    Jiang, Han
    Wang, Chenhan
    Liu, Zhiqiang
    Gao, Jie
    Yu, Jian
    Yu, Mei
    Yu, Ruiguo
    IMAGE AND VISION COMPUTING, 2022, 122
  • [32] Weakly Supervised Salient Object Detection with Box Annotation
    Jiang, Zhentao
    Chen, Qiang
    Jiang, Bo
    Leng, Cong
    Cheng, Jian
    PATTERN RECOGNITION, ACPR 2021, PT I, 2022, 13188 : 197 - 211
  • [33] Objectness Consistent Representation for Weakly Supervised Object Detection
    Yang, Ke
    Zhang, Peng
    Qiao, Peng
    Wang, Zhiyuan
    Li, Dongsheng
    Dou, Yong
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 1688 - 1696
  • [34] Weakly Supervised Object Detection Based on Active Learning
    Wang, Xiao
    Xiang, Xiang
    Zhang, Baochang
    Liu, Xuhui
    Zheng, Jianying
    Hu, Qinglei
    NEURAL PROCESSING LETTERS, 2022, 54 (06) : 5169 - 5183
  • [35] Object Discovery via Contrastive Learning for Weakly Supervised Object Detection
    Seo, Jinhwan
    Bae, Wonho
    Sutherland, Danica J.
    Noh, Junhyug
    Kim, Daijin
    COMPUTER VISION, ECCV 2022, PT XXXI, 2022, 13691 : 312 - 329
  • [36] Weakly Supervised Object Detection via Object-Specific Pixel Gradient
    Shen, Yunhang
    Ji, Rongrong
    Wang, Changhu
    Li, Xi
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (12) : 5960 - 5970
  • [37] Weakly supervised salient object detection via double object proposals guidance
    Zhou, Zhiheng
    Guo, Yongfan
    Dai, Ming
    Huang, Junchu
    Li, Xiangwei
    IET IMAGE PROCESSING, 2021, 15 (09) : 1957 - 1970
  • [38] Refining and reweighting pseudo labels for weakly supervised object detection
    Feng, Yongchao
    Zeng, Hao
    Li, Shiwei
    Liu, Qingjie
    Wang, Yunhong
    NEUROCOMPUTING, 2024, 577
  • [39] High-Quality Proposals for Weakly Supervised Object Detection
    Cheng, Gong
    Yang, Junyu
    Gao, Decheng
    Guo, Lei
    Han, Junwei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 5794 - 5804
  • [40] Weakly-Supervised Salient Object Detection on Light Fields
    Liang, Zijian
    Wang, Pengjie
    Xu, Ke
    Zhang, Pingping
    Lau, Rynson W. H.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6295 - 6305