Self-supervised Prototype Conditional Few-Shot Object Detection

被引:4
|
作者
Kobayashi, Daisuke [1 ]
机构
[1] Toshiba Co Ltd, Corp Res & Dev Ctr, Kawasaki, Kanagawa, Japan
关键词
Few-shot object detection; Few-shot learning; Object detection;
D O I
10.1007/978-3-031-06430-2_57
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Traditional deep learning-based object detection methods require a large amount of annotation for training, and creating such a dataset is expensive. Few-shot object detection which detects a new category of objects with a small amount of data is a difficult task. Many previous methods have been applied to detect new categories with few data by fine-tuning. However, fine-tuning methods cannot be sufficiently adapted quickly to new environments because of time-consuming training. In this study, we develop methods that can be adapted to new categories without fine-tuning. A prototype conditional detection module built on prototypes for each category is intended to be conditioned and detected by prototypes. Moreover, a self-supervised conditional detection module improves the representational capability for detecting new categories by a self-supervised task that uses embeddings outside the annotation region to detect the same regions before and after image transformation. The results of extensive experiments on the PASCAL VOC and MS COCO show the effectiveness of the proposed method.
引用
收藏
页码:681 / 692
页数:12
相关论文
共 50 条
  • [1] A Survey of Self-Supervised and Few-Shot Object Detection
    Huang, Gabriel
    Laradji, Issam
    Vazquez, David
    Lacoste-Julien, Simon
    Rodriguez, Pau
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) : 4071 - 4089
  • [2] Conditional Self-Supervised Learning for Few-Shot Classification
    An, Yuexuan
    Xue, Hui
    Zhao, Xingyu
    Zhang, Lu
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 2140 - 2146
  • [3] Few-shot object detection based on self-supervised feature pyramid network
    Lv, Wen
    Qi, Xinwei
    Shi, Hongbo
    Tan, Shuai
    Song, Bing
    Tao, Yang
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)
  • [4] A Self-supervised GAN for Unsupervised Few-shot Object Recognition
    Nguyen, Khoi
    Todorovic, Sinisa
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 3225 - 3231
  • [5] Few-shot intent detection with self-supervised pretraining and prototype-aware attention
    Yang, Shun
    Du, YaJun
    Zheng, Xin
    Li, XianYong
    Chen, XiaoLiang
    Li, YanLi
    Xie, ChunZhi
    [J]. PATTERN RECOGNITION, 2024, 155
  • [6] Multi-task Self-supervised Few-Shot Detection
    Zhang, Guangyong
    Duan, Lijuan
    Wang, Wenjian
    Gong, Zhi
    Ma, Bian
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XII, 2024, 14436 : 107 - 119
  • [7] Self-Supervised Task Augmentation for Few-Shot Intent Detection
    Peng-Fei Sun
    Ya-Wen Ouyang
    Ding-Jie Song
    Xin-Yu Dai
    [J]. Journal of Computer Science and Technology, 2022, 37 : 527 - 538
  • [8] Self-Supervised Task Augmentation for Few-Shot Intent Detection
    Sun, Peng-Fei
    Ouyang, Ya-Wen
    Song, Ding-Jie
    Dai, Xin-Yu
    [J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2022, 37 (03) : 527 - 538
  • [9] Self-Supervised Tuning for Few-Shot Segmentation
    Zhu, Kai
    Zhai, Wei
    Cao, Yang
    [J]. PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 1019 - 1025
  • [10] Incremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learning
    Dong, Na
    Zhang, Yongqiang
    Ding, Mingli
    Lee, Gim Hee
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 543 - 551