Salvage of Supervision in Weakly Supervised Object Detection

被引:10
|
作者
Sui, Lin [1 ]
Zhang, Chen-Lin [1 ,2 ]
Wu, Jianxin [1 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
[2] 4Paradigm Inc, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52688.2022.01383
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly supervised object detection (WSOD) has recently attracted much attention. However, the lack of bounding-box supervision makes its accuracy much lower than fully supervised object detection (FSOD), and currently modern FSOD techniques cannot be applied to WSOD. To bridge the performance and technical gaps between WSOD and FSOD, this paper proposes a new framework, Salvage of Supervision (SoS), with the key idea being to harness every potentially useful supervisory signal in WSOD: the weak image-level labels, the pseudo-labels, and the power of semi-supervised object detection. This paper proposes new approaches to utilize these weak and noisy signals effectively, and shows that each type of supervisory signal brings in notable improvements, outperforms existing WSOD methods (which mainly use only the weak labels) by large margins. The proposed SoS-WSOD method also has the ability to freely use modern FSOD techniques. SoSWSOD achieves 64.4 mAP(50) on VOC2007, 61.9 mAP(50) on VOC2012 and 16.6 mAP(50:95) on MS-COCO, and also has fast inference speed. Ablations and visualization further verify the effectiveness of SoS.
引用
收藏
页码:14207 / 14216
页数:10
相关论文
共 50 条
  • [1] Salvage of Supervision in Weakly Supervised Object Detection and Segmentation
    Sui, Lin
    Zhang, Chen-Lin
    Wu, Jianxin
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (08) : 10394 - 10408
  • [2] Weakly Supervised Video Salient Object Detection via Point Supervision
    Gao, Shuyong
    Xing, Haozhe
    Zhang, Wei
    Wang, Yan
    Guo, Qianyu
    Zhang, Wenqiang
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3656 - 3665
  • [3] Weakly Supervised Object Detection in Artworks
    Gonthier, Nicolas
    Gousseau, Yann
    Ladjal, Said
    Bonfait, Olivier
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT II, 2019, 11130 : 692 - 709
  • [4] Misclassification in Weakly Supervised Object Detection
    Wu, Zhihao
    Xu, Yong
    Yang, Jian
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 3413 - 3427
  • [5] Object Instance Mining for Weakly Supervised Object Detection
    Lin, Chenhao
    Wang, Siwen
    Xu, Dongqi
    Lu, Yu
    Zhang, Wayne
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11482 - 11489
  • [6] Weakly Supervised Video Salient Object Detection
    Zhao, Wangbo
    Zhang, Jing
    Li, Long
    Barnes, Nick
    Liu, Nian
    Han, Junwei
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 16821 - 16830
  • [7] Zigzag Learning for Weakly Supervised Object Detection
    Zhang, Xiaopeng
    Feng, Jiashi
    Xiong, Hongkai
    Tian, Qi
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 4262 - 4270
  • [8] Weakly Supervised Object Localization and Detection: A Survey
    Zhang, Dingwen
    Han, Junwei
    Cheng, Gong
    Yang, Ming-Hsuan
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 5866 - 5885
  • [9] Weakly Supervised Object Detection with Convex Clustering
    Bilen, Hakan
    Pedersoli, Marco
    Tuytelaars, Tinne
    [J]. 2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 1081 - 1089
  • [10] Weakly Supervised Object Detection With Segmentation Collaboration
    Li, Xiaoyan
    Kan, Meina
    Shan, Shiguang
    Chen, Xilin
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 9734 - 9743