Unsupervised Object Detection Pretraining with Joint Object Priors Generation and Detector Learning

被引:0
|
作者
Wang, Yizhou [1 ,3 ]
Chen, Meilin [1 ,3 ]
Tang, Shixiang [2 ]
Zhu, Feng [3 ]
Yang, Haiyang [5 ]
Bai, Lei [4 ]
Zhao, Rui [3 ,6 ]
Yan, Yunfeng [1 ]
Qi, Donglian [1 ]
Ouyang, Wanli [2 ,4 ]
机构
[1] Zhejiang Univ, Hangzhou, Peoples R China
[2] Univ Sydney, Sydney, NSW, Australia
[3] SenseTime Res, Hong Kong, Peoples R China
[4] Shanghai AI Lab, Shanghai, Peoples R China
[5] Nanjing Univ, Nanjing, Peoples R China
[6] Shanghai Jiao Tong Univ, Qing Yuan Res Inst, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised pretraining methods for object detection aim to learn object discrimination and localization ability from large amounts of images. Typically, recent works design pretext tasks that supervise the detector to predict the defined object priors. They normally leverage heuristic methods to produce object priors, e.g., selective search, which separates the prior generation and detector learning and leads to sub-optimal solutions. In this work, we propose a novel object detection pretraining framework that could generate object priors and learn detectors jointly by generating accurate object priors from the model itself. Specifically, region priors are extracted by attention maps from the encoder, which highlights foregrounds. Instance priors are the selected high-quality output bounding boxes of the detection decoder. By assuming objects as instances in the foreground, we can generate object priors with both region and instance priors. Moreover, our object priors are jointly refined along with the detector optimization. With better object priors as supervision, the model could achieve better detection capability, which in turn promotes the object priors generation. Our method improves the competitive approaches by +1.3 AP, +1.7 AP in 1% and 10% COCO low-data regimes object detection.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] DETReg: Unsupervised Pretraining with Region Priors for Object Detection
    Bar, Amir
    Wang, Xin
    Kantorov, Vadim
    Reed, Colorado J.
    Herzig, Roei
    Chechik, Gal
    Rohrbach, Anna
    Darrell, Trevor
    Globerson, Amir
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14585 - 14595
  • [2] DetCo: Unsupervised Contrastive Learning for Object Detection
    Xie, Enze
    Ding, Jian
    Wang, Wenhai
    Zhan, Xiaohang
    Xu, Hang
    Sun, Peize
    Li, Zhenguo
    Luo, Ping
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8372 - 8381
  • [3] Unsupervised Joint Salient Region Detection and Object Segmentation
    Zou, Wenbin
    Liu, Zhi
    Kpalma, Kidiyo
    Ronsin, Joseph
    Zhao, Yong
    Komodakis, Nikos
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (11) : 3858 - 3873
  • [4] Object proposal generation for unsupervised object localization
    Guo, Wenzhong
    Lin, Renjie
    Wang, Shiping
    Xiong, Neal N.
    2018 9TH INTERNATIONAL CONFERENCE ON PARALLEL ARCHITECTURES, ALGORITHMS AND PROGRAMMING (PAAP 2018), 2018, : 235 - 242
  • [5] WUSL–SOD: Joint weakly supervised, unsupervised and supervised learning for salient object detection
    Yan Liu
    Yunzhou Zhang
    Zhenyu Wang
    Rong Ma
    Feng Qiu
    Sonya Coleman
    Dermot Kerr
    Neural Computing and Applications, 2023, 35 : 15837 - 15856
  • [6] Aligning Pretraining for Detection via Object-Level Contrastive Learning
    Wei, Fangyun
    Gao, Yue
    Wu, Zhirong
    Hu, Han
    Lin, Stephen
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [7] Unsupervised Incremental Learning for Improved Object Detection in a Video
    Sharma, Pramod
    Huang, Chang
    Nevatia, Ram
    2012 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2012, : 3298 - 3305
  • [8] An unsupervised, online learning framework for moving object detection
    Nair, V
    Clark, JJ
    PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, 2004, : 317 - 324
  • [9] Supervision by Fusion: Towards Unsupervised Learning of Deep Salient Object Detector
    Zhang, Dingwen
    Han, Junwei
    Zhang, Yu
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 4068 - 4076
  • [10] Salient Object Detection with Semantic Priors
    Nguyen, Tam, V
    Liu, Luoqi
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 4499 - 4505