Dynamic Multitarget Detection Algorithm of Voxel Point Cloud Fusion Based on PointRCNN

被引:11
|
作者
Luo, Xizhao [1 ]
Zhou, Feng [2 ]
Tao, Chongben [2 ,3 ]
Yang, Anjia [4 ,5 ]
Zhang, Peiyun [6 ]
Chen, Yonghua [1 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215006, Peoples R China
[2] Suzhou Univ Sci & Technol, Sch Elect & Informat Engn, Suzhou 215009, Peoples R China
[3] Tsinghua Univ, Suzhou Automobile Res Inst, Suzhou 215134, Peoples R China
[4] Jinan Univ, Sch Informat Sci & Technol, Guangzhou 510632, Peoples R China
[5] Jinan Univ, Sch Cyber Secur, Guangzhou 510632, Peoples R China
[6] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Feature extraction; Three-dimensional displays; Point cloud compression; Object detection; Cameras; Heuristic algorithms; Autonomous vehicles; 3D target detection; autonomous driving; PointRCNN; multi-feature fusion; OBJECT DETECTION; VEHICLE; NETWORK; VISION;
D O I
10.1109/TITS.2022.3176390
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Current 3D target detection methods used in the field of autonomous driving generally have low real-time performance and insufficient target context feature to detect dynamic multi-target accurately. In order to solve these problems, a dynamic multi-target detection algorithm of voxel point cloud fusion based on PointRCNN is proposed, which adopts a two-stage detection structure. The first stage directly processes the point cloud to extract key point features and divides voxel space. A novel submanifold sparse convolution is used to extract voxel features. Then key point features and voxel features of the point cloud are merged to generate pre-selection boxes. In the second stage, reference points are set based on the voxel features. The features of key points around reference points are merged for the second time to achieve optimized detection boxes. Finally, for the problem of inconsistent confidence, a mandatory consistency loss function is proposed to improve the accuracy of the detection box. The proposed algorithm was compared with other algorithms in three different datasets, and further tested on a self-made dataset from an actual vehicle platform. Results showed that the proposed algorithm had higher accuracy, better robustness, stronger generalization ability for dynamic multi-target detection.
引用
收藏
页码:20707 / 20720
页数:14
相关论文
共 50 条
  • [1] 3D Dynamic Target Detection Algorithm Based on Voxel Point Cloud Fusion
    Zhou F.
    Tao C.
    Zhang Z.
    Gao H.
    Xu F.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (06): : 901 - 912
  • [2] Multitarget Detection Algorithm Based on Multimodal Information Fusion
    Liu Tong
    Gao Sijie
    Nie Weizhi
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (08)
  • [3] Dynamic Downsampling Algorithm for 3D Point Cloud Map Based on Voxel Filtering
    Lyu, Wenqi
    Ke, Wei
    Sheng, Hao
    Ma, Xiao
    Zhang, Huayun
    APPLIED SCIENCES-BASEL, 2024, 14 (08):
  • [4] Road Falling Objects Detection Algorithm Based on Image and Point Cloud Fusion
    Liang Haolin
    Cai Huaiyu
    Liu Bochong
    Wang Yi
    Chen Xiaodong
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (10)
  • [5] Point Cloud Registration Algorithm Based on NDT with Variable Size Voxel
    Lu Jun
    Liu Wei
    Dong Donglai
    Shao Qiang
    2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 3707 - 3712
  • [6] 3-D Dynamic Multitarget Detection Algorithm Based on Cross-View Feature Fusion
    Zhou F.
    Tao C.
    Gao Z.
    Zhang Z.
    Zheng S.
    Zhu Y.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (06): : 3146 - 3159
  • [7] PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud
    Shi, Shaoshuai
    Wang, Xiaogang
    Li, Hongsheng
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 770 - 779
  • [8] PVF-NET: Point & Voxel Fusion 3D Object Detection Framework for Point Cloud
    Cui, Zhihao
    Zhang, Zhenhua
    2020 17TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV 2020), 2020, : 125 - 133
  • [9] Robust Point Cloud Registration Method with Voxel Feature Fusion
    Qian, Liangliang
    Nie, Wen
    Zhang, Haosheng
    Zhu, Tianqiang
    LASER & OPTOELECTRONICS PROGRESS, 2025, 62 (04)
  • [10] Point cloud 3D object detection algorithm based on local information fusion
    Zhang, Linjie
    Chai, Zhilei
    Wang, Ning
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2024, 58 (11): : 2219 - 2229