Salvage of Supervision in Weakly Supervised Object Detection

被引:10
|
作者
Sui, Lin [1 ]
Zhang, Chen-Lin [1 ,2 ]
Wu, Jianxin [1 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
[2] 4Paradigm Inc, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52688.2022.01383
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly supervised object detection (WSOD) has recently attracted much attention. However, the lack of bounding-box supervision makes its accuracy much lower than fully supervised object detection (FSOD), and currently modern FSOD techniques cannot be applied to WSOD. To bridge the performance and technical gaps between WSOD and FSOD, this paper proposes a new framework, Salvage of Supervision (SoS), with the key idea being to harness every potentially useful supervisory signal in WSOD: the weak image-level labels, the pseudo-labels, and the power of semi-supervised object detection. This paper proposes new approaches to utilize these weak and noisy signals effectively, and shows that each type of supervisory signal brings in notable improvements, outperforms existing WSOD methods (which mainly use only the weak labels) by large margins. The proposed SoS-WSOD method also has the ability to freely use modern FSOD techniques. SoSWSOD achieves 64.4 mAP(50) on VOC2007, 61.9 mAP(50) on VOC2012 and 16.6 mAP(50:95) on MS-COCO, and also has fast inference speed. Ablations and visualization further verify the effectiveness of SoS.
引用
收藏
页码:14207 / 14216
页数:10
相关论文
共 50 条
  • [21] Cascade Attentive Dropout for Weakly Supervised Object Detection
    Wenlong Gao
    Ying Chen
    Yong Peng
    [J]. Neural Processing Letters, 2023, 55 : 6907 - 6923
  • [22] Weakly Supervised Group Mask Network for Object Detection
    Song, Lingyun
    Liu, Jun
    Sun, Mingxuan
    Shang, Xuequn
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (03) : 681 - 702
  • [23] Rethinking Segmentation Guidance for Weakly Supervised Object Detection
    Yang, Ke
    Zhang, Peng
    Qiao, Peng
    Wang, Zhiyuan
    Dai, Huadong
    Shen, Tianlong
    Li, Dongsheng
    Dou, Yong
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 4069 - 4073
  • [24] Dissimilarity Coefficient based Weakly Supervised Object Detection
    Arun, Aditya
    Jawahar, C., V
    Kumar, M. Pawan
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9424 - 9433
  • [25] Cascade Attentive Dropout for Weakly Supervised Object Detection
    Gao, Wenlong
    Chen, Ying
    Peng, Yong
    [J]. NEURAL PROCESSING LETTERS, 2023, 55 (06) : 6907 - 6923
  • [26] Weakly Supervised Object Detection With Class Prototypical Network
    Li, Huifang
    Li, Yidong
    Cao, Yuanzhouhan
    Han, Yushan
    Jin, Yi
    Wei, Yunchao
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1868 - 1878
  • [27] Weakly Supervised Group Mask Network for Object Detection
    Lingyun Song
    Jun Liu
    Mingxuan Sun
    Xuequn Shang
    [J]. International Journal of Computer Vision, 2021, 129 : 681 - 702
  • [28] Dynamic sample weighting for weakly supervised object detection
    Li, Xuewei
    Yi, Song
    Zhang, Ruixuan
    Fu, Xuzhou
    Jiang, Han
    Wang, Chenhan
    Liu, Zhiqiang
    Gao, Jie
    Yu, Jian
    Yu, Mei
    Yu, Ruiguo
    [J]. IMAGE AND VISION COMPUTING, 2022, 122
  • [29] CaT: Weakly Supervised Object Detection with Category Transfer
    Cao, Tianyue
    Du, Lianyu
    Zhang, Xiaoyun
    Chen, Siheng
    Zhang, Ya
    Wang, Yan-Feng
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 3050 - 3059
  • [30] Exploiting Web Images for Weakly Supervised Object Detection
    Tao, Qingyi
    Yang, Hao
    Cai, Jianfei
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (05) : 1135 - 1146