ATF-3D: Semi-Supervised 3D Object Detection With Adaptive Thresholds Filtering Based on Confidence and Distance

被引:8
|
作者
Zhang, Zehan [1 ,2 ]
Ji, Yang [1 ]
Cui, Wei [1 ]
Wang, Yulong [1 ]
Li, Hao [1 ]
Zhao, Xian [1 ]
Li, Duo [1 ]
Tang, Sanli [1 ]
Yang, Ming [2 ]
Tan, Wenming [1 ]
Pu, Shiliang [1 ]
机构
[1] Hangzhou Hikvis Digital Technol Co Ltd, Hikvis Res Inst, Hangzhou 310052, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
基金
国家重点研发计划;
关键词
Object detection; segmentation and categorization; autonomous agents; localization; semi-supervised learning; POINT CLOUD;
D O I
10.1109/LRA.2022.3187496
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Performance of current point cloud-based outdoor 3D object detection relies heavily on large-scale high-quality 3D annotations. However, such annotations are usually expensive to collect and outdoor scenes easily accumulate massive unlabeled data containing rich scenes. Semi-supervised learning is a effective alternative to utilize both labeled and unlabeled data, but remains unexplored in outdoor 3D object detection. Inspired by indoor semi-supervised 3D detection methods, SESS and 3DIoUMatch, we propose ATF-3D, a semi-supervised 3D object detection framework for outdoor scenes. Specifically, we design a simple yet effective adaptive thresholds search method based on distances and categories for obtaining high-quality pseudo labels. Concurrently, we propose an iterative training mechanism with pseudo-label training and self-ensembling learning to combine the advantages of both schemes. Furthermore, we adopt point cloud data augmentations in the self-ensembling learning stage to further improve the performance. Our ATF-3D ranks first among all single-model methods in the ONCE benchmark. Results on both ONCE and Waymo datasets demonstrate substatial improvements over the supervised baseline.
引用
收藏
页码:10573 / 10580
页数:8
相关论文
共 50 条
  • [1] Semi-supervised 3D Object Detection with PatchTeacher and PillarMix
    Wu, Xiaopei
    Peng, Liang
    Xie, Liang
    Hou, Yuenan
    Lin, Binbin
    Huang, Xiaoshui
    Liu, Haifeng
    Cai, Deng
    Ouyang, Wanli
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 6, 2024, : 6153 - 6161
  • [2] Semi-supervised 3D Object Detection with Proficient Teachers
    Yin, Junbo
    Fang, Jin
    Zhou, Dingfu
    Zhang, Liangjun
    Xu, Cheng-Zhong
    Shen, Jianbing
    Wang, Wenguan
    [J]. COMPUTER VISION, ECCV 2022, PT XXXVIII, 2022, 13698 : 727 - 743
  • [3] SEMI-SUPERVISED 3D OBJECT DETECTION VIA ADAPTIVE PSEUDO-LABELING
    Xu, Hongyi
    Liu, Fengqi
    Zhou, Qianyu
    Hao, Jinkun
    Cao, Zhijie
    Feng, Zhengyang
    Ma, Lizhuang
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3183 - 3187
  • [4] PE-MCAT: Leveraging Image Sensor Fusion and Adaptive Thresholds for Semi-Supervised 3D Object Detection
    Li, Bohao
    Song, Shaojing
    Ai, Luxia
    [J]. Sensors, 2024, 24 (21)
  • [5] A semi-supervised 3D object detection method for autonomous driving
    Zhang, Jiacheng
    Liu, Huafeng
    Lu, Jianfeng
    [J]. DISPLAYS, 2022, 71
  • [6] Learning with Noisy Data for Semi-Supervised 3D Object Detection
    Chen, Zehui
    Li, Zhenyu
    Wang, Shuo
    Fu, Dengpan
    Zhao, Feng
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 6906 - 6916
  • [7] Joint Semi-Supervised and Active Learning via 3D Consistency for 3D Object Detection
    Hwang, Sihwan
    Kim, Sanmin
    Kim, Youngseok
    Kum, Dongsuk
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 4819 - 4825
  • [8] Diffusion-SS3D: Diffusion Model for Semi-supervised 3D Object Detection
    Ho, Cheng-Ju
    Tai, Chen-Hsuan
    Lin, Yen-Yu
    Yang, Ming-Hsuan
    Tsai, Yi-Hsuan
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [9] A Simple Vision Transformer for Weakly Semi-supervised 3D Object Detection
    Zhang, Dingyuan
    Liang, Dingkang
    Zou, Zhikang
    Li, Jingyu
    Ye, Xiaoqing
    Liu, Zhe
    Tan, Xiao
    Bai, Xiang
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 8339 - 8349
  • [10] Class-Level Confidence Based 3D Semi-Supervised Learning
    Chen, Zhimin
    Jing, Longlong
    Yang, Liang
    Li, Yingwei
    Li, Bing
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 633 - 642