I3DOD: Towards Incremental 3D Object Detection via Prompting

被引:1
|
作者
Liang, Wenqi [1 ,2 ,3 ]
Sun, Gan [1 ,2 ]
Liu, Chenxi [1 ,2 ,3 ]
Dong, Jiahua [1 ,2 ,3 ]
Wang, Kangru [4 ]
机构
[1] Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Inst Robot & Intelligent Mfg, Shenyang 110169, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Chinese Acad Sci, Inst Microsyst & Informat Technol, Shanghai 200050, Peoples R China
关键词
D O I
10.1109/IROS55552.2023.10341834
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D object detection have achieved significant performance in many fields, e.g., robotics system, autonomous driving, and augmented reality. However, most existing methods could cause catastrophic forgetting of old classes when performing on the class-incremental scenarios. Meanwhile, the current class-incremental 3D object detection methods neglect the relationships between the object localization information and category semantic information, and assume all the knowledge of old model is reliable. To address the above challenge, we present a novel Incremental 3D Object Detection framework with the guidance of prompting, i.e., I3DOD. Specifically, we propose a task-shared prompts mechanism to learn the matching relationships between the object localization information and category semantic information. After training on the current task, these prompts will be stored in our prompt pool, and perform the relationship of old classes in the next task. Moreover, we design a reliable distillation strategy to transfer knowledge from two aspects: a reliable dynamic distillation is developed to filter out the negative knowledge and transfer the reliable 3D knowledge to new detection model; the relation feature is proposed to capture the responses relation in feature space and protect plasticity of the model when learning novel 3D classes. To the end, we conduct comprehensive experiments on two benchmark datasets and our method outperforms the state-of-the-art object detection methods by 0.6% similar to 2.7% in terms of mAP@0.25.
引用
收藏
页码:5738 / 5743
页数:6
相关论文
共 50 条
  • [21] Joint Semi-Supervised and Active Learning via 3D Consistency for 3D Object Detection
    Hwang, Sihwan
    Kim, Sanmin
    Kim, Youngseok
    Kum, Dongsuk
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 4819 - 4825
  • [22] Towards Long-Range 3D Object Detection for Autonomous Vehicles
    Khoche, Ajinkya
    Sanchez, Laura Pereira
    Batool, Nazre
    Mansouri, Sina Sharif
    Jensfelt, Patric
    2024 35TH IEEE INTELLIGENT VEHICLES SYMPOSIUM, IEEE IV 2024, 2024, : 2206 - 2212
  • [23] Cross Modal Transformer: Towards Fast and Robust 3D Object Detection
    Yan, Junjie
    Liu, Yingfei
    Sun, Jianjian
    Jia, Fan
    Li, Shuailin
    Wang, Tiancai
    Zhang, Xiangyu
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18222 - 18232
  • [24] SparseDet: Towards efficient multi-view 3D object detection via sparse scene representation
    Li, Jingzhong
    Yang, Lin
    Shi, Zhen
    Chen, Yuxuan
    Jin, Yue
    Akiyama, Kanta
    Xu, Anze
    ADVANCED ENGINEERING INFORMATICS, 2024, 62
  • [25] Conflicts between Likelihood and Knowledge Distillation in Task Incremental Learning for 3D Object Detection
    Yun, Peng
    Cen, Jun
    Liu, Ming
    2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 575 - 585
  • [26] In Defense of Knowledge Distillation for Task Incremental Learning and Its Application in 3D Object Detection
    Yun, Peng
    Liu, Yuxuan
    Liu, Ming
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02) : 2012 - 2019
  • [27] Gradient-based Maximally Interfered Retrieval for Domain Incremental 3D Object Detection
    Nisar, Barza
    Anand, Hruday Vishal Kanna
    Waslander, Steven L.
    2023 20TH CONFERENCE ON ROBOTS AND VISION, CRV, 2023, : 304 - 311
  • [28] Accurate Monocular 3D Object Detection via Color-Embedded 3D Reconstruction for Autonomous Driving
    Ma, Xinzhu
    Wang, Zhihui
    Li, Haojie
    Zhang, Pengbo
    Ouyang, Wanli
    Fan, Xin
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6850 - 6859
  • [29] 3D object watermarking by a 3D hidden object
    Kishk, S
    Javidi, B
    OPTICS EXPRESS, 2003, 11 (08): : 874 - 888
  • [30] Focal Loss in 3D Object Detection
    Yun, Peng
    Tai, Lei
    Wang, Yuan
    Liu, Chengju
    Liu, Ming
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (02) : 1263 - 1270