Salvage of Supervision in Weakly Supervised Object Detection

被引:11
|
作者
Sui, Lin [1 ]
Zhang, Chen-Lin [1 ,2 ]
Wu, Jianxin [1 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
[2] 4Paradigm Inc, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52688.2022.01383
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly supervised object detection (WSOD) has recently attracted much attention. However, the lack of bounding-box supervision makes its accuracy much lower than fully supervised object detection (FSOD), and currently modern FSOD techniques cannot be applied to WSOD. To bridge the performance and technical gaps between WSOD and FSOD, this paper proposes a new framework, Salvage of Supervision (SoS), with the key idea being to harness every potentially useful supervisory signal in WSOD: the weak image-level labels, the pseudo-labels, and the power of semi-supervised object detection. This paper proposes new approaches to utilize these weak and noisy signals effectively, and shows that each type of supervisory signal brings in notable improvements, outperforms existing WSOD methods (which mainly use only the weak labels) by large margins. The proposed SoS-WSOD method also has the ability to freely use modern FSOD techniques. SoSWSOD achieves 64.4 mAP(50) on VOC2007, 61.9 mAP(50) on VOC2012 and 16.6 mAP(50:95) on MS-COCO, and also has fast inference speed. Ablations and visualization further verify the effectiveness of SoS.
引用
收藏
页码:14207 / 14216
页数:10
相关论文
共 50 条
  • [21] Cascade Attentive Dropout for Weakly Supervised Object Detection
    Wenlong Gao
    Ying Chen
    Yong Peng
    Neural Processing Letters, 2023, 55 : 6907 - 6923
  • [22] Weakly Supervised Group Mask Network for Object Detection
    Song, Lingyun
    Liu, Jun
    Sun, Mingxuan
    Shang, Xuequn
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (03) : 681 - 702
  • [23] Cascade Attentive Dropout for Weakly Supervised Object Detection
    Gao, Wenlong
    Chen, Ying
    Peng, Yong
    NEURAL PROCESSING LETTERS, 2023, 55 (06) : 6907 - 6923
  • [24] Weakly Supervised Object Detection With Class Prototypical Network
    Li, Huifang
    Li, Yidong
    Cao, Yuanzhouhan
    Han, Yushan
    Jin, Yi
    Wei, Yunchao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1868 - 1878
  • [25] Weakly Supervised Group Mask Network for Object Detection
    Lingyun Song
    Jun Liu
    Mingxuan Sun
    Xuequn Shang
    International Journal of Computer Vision, 2021, 129 : 681 - 702
  • [26] Exploiting Web Images for Weakly Supervised Object Detection
    Tao, Qingyi
    Yang, Hao
    Cai, Jianfei
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (05) : 1135 - 1146
  • [27] Weakly Supervised Open-Vocabulary Object Detection
    Lin, Jianghang
    Shen, Yunhang
    Wang, Bingquan
    Lin, Shaohui
    Li, Ke
    Cao, Liujuan
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 3404 - 3412
  • [28] Rethinking Segmentation Guidance for Weakly Supervised Object Detection
    Yang, Ke
    Zhang, Peng
    Qiao, Peng
    Wang, Zhiyuan
    Dai, Huadong
    Shen, Tianlong
    Li, Dongsheng
    Dou, Yong
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 4069 - 4073
  • [29] Dissimilarity Coefficient based Weakly Supervised Object Detection
    Arun, Aditya
    Jawahar, C., V
    Kumar, M. Pawan
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9424 - 9433
  • [30] CaT: Weakly Supervised Object Detection with Category Transfer
    Cao, Tianyue
    Du, Lianyu
    Zhang, Xiaoyun
    Chen, Siheng
    Zhang, Ya
    Wang, Yan-Feng
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 3050 - 3059