Stereo CenterNet-based 3D object detection for autonomous driving

被引:15
|
作者
Shi, Yuguang [1 ,2 ,3 ]
Guo, Yu [1 ,4 ]
Mi, Zhenqiang [1 ]
Li, Xinjie [1 ]
机构
[1] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing, Peoples R China
[2] Univ Sci & Technol Beijing, Beijing Key Lab Knowledge Engn Mat Sci, Beijing, Peoples R China
[3] Univ Sci & Technol Beijing, Beijing Adv Innovat Ctr Mat Genome Engn, Beijing, Peoples R China
[4] Univ Sci & Technol, Shunde Grad Sch, Dongguan, Guangdong, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
3D object detection; Stereo imagery; Photometric alignment;
D O I
10.1016/j.neucom.2021.11.048
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, three-dimensional (3D) detection based on stereo images has progressed remarkably; however, most advanced methods adopt anchor-based two-dimensional (2D) detection or depth estimation to address this problem. Nevertheless, high computational cost inhibits these methods from achieving real-time performance. In this study, we propose a 3D object detection method, Stereo CenterNet (SC), using geometric information in stereo imagery. SC predicts the four semantic key points of the 3D bound-ing box of the object in space and utilizes 2D left and right boxes, 3D dimension, orientation, and key points to restore the bounding box of the object in the 3D space. Subsequently, we adopt an improved photometric alignment module to further optimize the position of the 3D bounding box. Experiments conducted on the KITTI dataset indicate that the proposed SC exhibits the best speed-accuracy trade -off among advanced methods without using extra data. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:219 / 229
页数:11
相关论文
共 50 条
  • [1] Stereo R-CNN based 3D Object Detection for Autonomous Driving
    Li, Peiliang
    Chen, Xiaozhi
    Shen, Shaojie
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7636 - 7644
  • [2] RCBi-CenterNet: An Absolute Pose Policy for 3D Object Detection in Autonomous Driving
    An, Kang
    Chen, Yixin
    Wang, Suhong
    Xiao, Zhifeng
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (12):
  • [3] Pseudo-Stereo for Monocular 3D Object Detection in Autonomous Driving
    Chen, Yi-Nan
    Dai, Hang
    Ding, Yong
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 877 - 887
  • [4] A review of 3D object detection based on autonomous driving
    Wang, Huijuan
    Chen, Xinyue
    Yuan, Quanbo
    Liu, Peng
    [J]. VISUAL COMPUTER, 2024,
  • [5] Stereo RGB and Deeper LIDAR-Based Network for 3D Object Detection in Autonomous Driving
    He, Qingdong
    Wang, Zhengning
    Zeng, Hao
    Zeng, Yi
    Liu, Yijun
    Liu, Shuaicheng
    Zeng, Bing
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (01) : 152 - 162
  • [6] LiDAR-based 3D Object Detection for Autonomous Driving
    Li, Zirui
    [J]. 2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 507 - 512
  • [7] Monocular 3D Object Detection for Autonomous Driving
    Chen, Xiaozhi
    Kundu, Kaustav
    Zhang, Ziyu
    Ma, Huimin
    Fidler, Sanja
    Urtasun, Raquel
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2147 - 2156
  • [8] 3D Object Detection for Autonomous Driving: A Survey
    Qian, Rui
    Lai, Xin
    Li, Xirong
    [J]. PATTERN RECOGNITION, 2022, 130
  • [9] MSL3D: 3D object detection from monocular, stereo and point cloud for autonomous driving
    Chen, Wenyu
    Li, Peixuan
    Zhao, Huaici
    [J]. NEUROCOMPUTING, 2022, 494 : 23 - 32
  • [10] 3D object detection based on image and LIDAR fusion for autonomous driving
    Chen, Guoqiang
    Yi, Huailong
    Mao, Zhuangzhuang
    [J]. International Journal of Vehicle Information and Communication Systems, 2023, 8 (03) : 237 - 251