I3DOD: Towards Incremental 3D Object Detection via Prompting

被引:1
|
作者
Liang, Wenqi [1 ,2 ,3 ]
Sun, Gan [1 ,2 ]
Liu, Chenxi [1 ,2 ,3 ]
Dong, Jiahua [1 ,2 ,3 ]
Wang, Kangru [4 ]
机构
[1] Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Inst Robot & Intelligent Mfg, Shenyang 110169, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Chinese Acad Sci, Inst Microsyst & Informat Technol, Shanghai 200050, Peoples R China
关键词
D O I
10.1109/IROS55552.2023.10341834
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D object detection have achieved significant performance in many fields, e.g., robotics system, autonomous driving, and augmented reality. However, most existing methods could cause catastrophic forgetting of old classes when performing on the class-incremental scenarios. Meanwhile, the current class-incremental 3D object detection methods neglect the relationships between the object localization information and category semantic information, and assume all the knowledge of old model is reliable. To address the above challenge, we present a novel Incremental 3D Object Detection framework with the guidance of prompting, i.e., I3DOD. Specifically, we propose a task-shared prompts mechanism to learn the matching relationships between the object localization information and category semantic information. After training on the current task, these prompts will be stored in our prompt pool, and perform the relationship of old classes in the next task. Moreover, we design a reliable distillation strategy to transfer knowledge from two aspects: a reliable dynamic distillation is developed to filter out the negative knowledge and transfer the reliable 3D knowledge to new detection model; the relation feature is proposed to capture the responses relation in feature space and protect plasticity of the model when learning novel 3D classes. To the end, we conduct comprehensive experiments on two benchmark datasets and our method outperforms the state-of-the-art object detection methods by 0.6% similar to 2.7% in terms of mAP@0.25.
引用
收藏
页码:5738 / 5743
页数:6
相关论文
共 50 条
  • [1] Towards Stable 3D Object Detection
    Wang, Jiabao
    Meng, Qiang
    Liu, Guochao
    Yang, Liujiang
    Wang, Ke
    Cheng, Ming-Ming
    Hou, Qibin
    COMPUTER VISION - ECCV 2024, PT L, 2025, 15108 : 197 - 213
  • [2] Towards Robust 3D Object Detection In Rainy Conditions
    Piroli, Aldi
    Dallabetta, Vinzenz
    Kopp, Johannes
    Walessa, Marc
    Meissner, Daniel
    Dietmayer, Klaus
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 3471 - 3477
  • [3] Towards 3D Object Recognition via Classification of Arbitrary Object Tracks
    Teichman, Alex
    Levinson, Jesse
    Thrun, Sebastian
    2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011,
  • [4] Towards Raw Sensor Fusion in 3D Object Detection
    Rovid, Andras
    Remeli, Viktor
    2019 IEEE 17TH WORLD SYMPOSIUM ON APPLIED MACHINE INTELLIGENCE AND INFORMATICS (SAMI 2019), 2019, : 293 - 298
  • [5] Towards Efficient 3D Object Detection with Knowledge Distillation
    Yang, Jihan
    Shi, Shaoshuai
    Ding, Runyu
    Wang, Zhe
    Qi, Xiaojuan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [6] I3DOL: Incremental 3D Object Learning without Catastrophic Forgetting
    Dong, Jiahua
    Cong, Yang
    Sun, Gan
    Ma, Bingtao
    Wang, Lichen
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 6066 - 6074
  • [7] RoboFusion: Towards Robust Multi-Modal 3D Object Detection via SAM
    Song, Ziying
    Zhang, Guoxing
    Liu, Lin
    Yang, Lei
    Xu, Shaoqing
    Jia, Caiyan
    Jia, Feiyang
    Wang, Li
    PROCEEDINGS OF THE THIRTY-THIRD INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2024, 2024, : 1272 - 1280
  • [8] LiDAR-Based All-Weather 3D Object Detection via Prompting and Distilling 4D Radar
    Chae, Yujeong
    Kim, Hyeonseong
    Oh, Changgyoon
    Kim, Minseok
    Yoon, Kuk-Jin
    COMPUTER VISION - ECCV 2024, PT LVI, 2025, 15114 : 368 - 385
  • [9] DeepInteraction: 3D Object Detection via Modality Interaction
    Yang, Zeyu
    Chen, Jiaqi
    Miao, Zhenwei
    Li, Wei
    Zhu, Xiatian
    Zhang, Li
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [10] Improving 3D Object Detection via Joint Attribute-oriented 3D Loss
    Ye, Zhen
    Xue, Jianru
    Dou, Jian
    Pan, Yuxin
    Fang, Jianwu
    Wang, Di
    Zheng, Nanning
    2020 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2020, : 951 - 956