Spatial information enhancement network for 3D object detection from point cloud

被引:30
|
作者
Li, Ziyu [1 ,2 ]
Yao, Yuncong [1 ,2 ]
Quan, Zhibin [1 ,2 ]
Xie, Jin [3 ]
Yang, Wankou [1 ,2 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
[2] Minist Educ, Key Lab Measurement & Control Complex Syst Engn, Nanjing 210096, Peoples R China
[3] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
关键词
3D object detection; Autonomous vehicles; Point cloud; LiDAR sensor; 3D shape completion;
D O I
10.1016/j.patcog.2022.108684
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
LiDAR-based 3D object detection pushes forward an immense influence on autonomous vehicles. Due to the limitation of the intrinsic properties of LiDAR, fewer points are collected at the objects farther away from the sensor. This imbalanced density of point clouds degrades the detection accuracy but is generally neglected by previous works. To address the challenge, we propose a novel two-stage 3D object detection framework, named SIENet. Specifically, we design the Spatial Information Enhancement (SIE) module to predict the spatial shapes of the foreground points within proposals, and extract the structure information to learn the representative features for further box refinement. The predicted spatial shapes are complete and dense point sets, thus the extracted structure information contains more semantic representation. Besides, we design the Hybrid-Paradigm Region Proposal Network (HP-RPN) which includes multiple branches to learn discriminate features and generate accurate proposals for the SIE module. Extensive experiments on the KITTI 3D object detection benchmark show that our elaborately designed SIENet outperforms the state-of-the-art methods by a large margin. Codes will be publicly available at https://github.com/Liz66666/SIENet .(c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] 3D OBJECT DETECTION NETWORK COMBINED WITH POINT CLOUD COMPLETION
    Zhou, Jing
    Yu, Chao
    Zhang, Junchi
    Hu, Yiyu
    [J]. JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2024, 25 (05) : 789 - 809
  • [2] Spatial and Semantic Information Enhancement for Indoor 3D Object Detection
    Chen, Chunmei
    Liang, Zhiqiang
    Liu, Haitao
    Liu, Xin
    [J]. INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, 2023, 20 (05) : 831 - 839
  • [3] VIC-Net: Voxelization Information Compensation Network for Point Cloud 3D Object Detection
    Jiang, Tianyuan
    Song, Nan
    Liu, Huanyu
    Yin, Ruihao
    Gong, Ye
    Yao, Jian
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 13408 - 13414
  • [4] HRNet: 3D object detection network for point cloud with hierarchical refinement
    Lu, Bin
    Sun, Yang
    Yang, Zhenyu
    Song, Ran
    Jiang, Haiyan
    Liu, Yonghuai
    [J]. PATTERN RECOGNITION, 2024, 149
  • [5] PLOT: a 3D point cloud object detection network for autonomous driving
    Zhang, Yihuan
    Wang, Liang
    Dai, Yifan
    [J]. ROBOTICA, 2023, 41 (05) : 1483 - 1499
  • [6] PPMGNet: A Neural Network Algorithm for Point Cloud 3D Object Detection
    Peng, Xiaohong
    Wang, Sen
    Geng, Shuqin
    Zhang, Zhe
    Tang, Haonan
    Wang, Yu
    Wang, Jie
    Li, Xuefeng
    Du, Jianing
    [J]. 2020 IEEE 14TH INTERNATIONAL CONFERENCE ON ANTI-COUNTERFEITING, SECURITY, AND IDENTIFICATION (ASID), 2020, : 53 - 56
  • [7] GNet: 3D Object Detection from Point Cloud with Geometry-Aware Network
    Ruan, Hao
    Xu, Bingrong
    Gao, Junbin
    Liu, Lianguang
    Lv, Junting
    Sheng, Yin
    Zeng, Zhigang
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON CYBORG AND BIONIC SYSTEMS, CBS, 2022, : 190 - 195
  • [8] Offboard 3D Object Detection from Point Cloud Sequences
    Qi, Charles R.
    Zhou, Yin
    Najibi, Mahyar
    Sun, Pei
    Khoa Vo
    Deng, Boyang
    Anguelov, Dragomir
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 6130 - 6140
  • [9] Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloud
    Shi, Weijing
    Rajkumar, Ragunathan
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1708 - 1716
  • [10] CenterTransFuser: radar point cloud and visual information fusion for 3D object detection
    Yan Li
    Kai Zeng
    Tao Shen
    [J]. EURASIP Journal on Advances in Signal Processing, 2023