Multiattention Mechanism 3D Object Detection Algorithm Based on RGB and LiDAR Fusion for Intelligent Driving

被引:5
|
作者
Zhang, Xiucai [1 ]
He, Lei [1 ]
Chen, Junyi [1 ]
Wang, Baoyun [1 ]
Wang, Yuhai [1 ]
Zhou, Yuanle [1 ]
机构
[1] Jilin Univ, State Key Lab Automot Simulat & Control, Changchun 130022, Peoples R China
关键词
multimodal fusion; attention mechanism; 3D target detection; deep learning; REPRESENTATION;
D O I
10.3390/s23218732
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper proposes a multimodal fusion 3D target detection algorithm based on the attention mechanism to improve the performance of 3D target detection. The algorithm utilizes point cloud data and information from the camera. For image feature extraction, the ResNet50 + FPN architecture extracts features at four levels. Point cloud feature extraction employs the voxel method and FCN to extract point and voxel features. The fusion of image and point cloud features is achieved through regional point fusion and voxel fusion methods. After information fusion, the Coordinate and SimAM attention mechanisms extract fusion features at a deep level. The algorithm's performance is evaluated using the DAIR-V2X dataset. The results show that compared to the Part-A2 algorithm; the proposed algorithm improves the mAP value by 7.9% in the BEV view and 7.8% in the 3D view at IOU = 0.5 (cars) and IOU = 0.25 (pedestrians and cyclists). At IOU = 0.7 (cars) and IOU = 0.5 (pedestrians and cyclists), the mAP value of the SECOND algorithm is improved by 5.4% in the BEV view and 4.3% in the 3D view, compared to other comparison algorithms.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Transformer-Based Optimized Multimodal Fusion for 3D Object Detection in Autonomous Driving
    Alaba, Simegnew Yihunie
    Ball, John E.
    IEEE ACCESS, 2024, 12 : 50165 - 50176
  • [42] LiDAR-Based 3D Temporal Object Detection via Motion-Aware LiDAR Feature Fusion
    Park, Gyuhee
    Koh, Junho
    Kim, Jisong
    Moon, Jun
    Choi, Jun Won
    SENSORS, 2024, 24 (14)
  • [43] Retraction Note: Moving object detection algorithm and motion capture based on 3D LiDAR
    Jian Jiang
    Optical and Quantum Electronics, 56 (10)
  • [44] 3D Vehicle Detection Based on LiDAR and Camera Fusion
    Cai, Yingfeng
    Zhang, Tiantian
    Wang, Hai
    Li, Yicheng
    Liu, Qingchao
    Chen, Xiaobo
    AUTOMOTIVE INNOVATION, 2019, 2 (04) : 276 - 283
  • [45] 3D Vehicle Detection Based on LiDAR and Camera Fusion
    Yingfeng Cai
    Tiantian Zhang
    Hai Wang
    Yicheng Li
    Qingchao Liu
    Xiaobo Chen
    Automotive Innovation, 2019, 2 : 276 - 283
  • [46] Center-Aware 3D Object Detection with Attention Mechanism Based on Roadside LiDAR
    Shi, Haobo
    Hou, Dezao
    Li, Xiyao
    SUSTAINABILITY, 2023, 15 (03)
  • [47] InterFusion: Interaction-based 4D Radar and LiDAR Fusion for 3D Object Detection
    Wang, Li
    Zhang, Xinyu
    Xv, Baowei
    Zhang, Jinzhao
    Fu, Rong
    Wang, Xiaoyu
    Zhu, Lei
    Ren, Haibing
    Lu, Pingping
    Li, Jun
    Liu, Huaping
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 12247 - 12253
  • [48] CrossFusion net: Deep 3D object detection based on RGB images and point clouds in autonomous driving
    Hong, Dza-Shiang
    Chen, Hung-Hao
    Hsiao, Pei-Yung
    Fu, Li-Chen
    Siao, Siang-Min
    IMAGE AND VISION COMPUTING, 2020, 100
  • [49] Point cloud 3D object detection algorithm based on local information fusion
    Zhang, Linjie
    Chai, Zhilei
    Wang, Ning
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2024, 58 (11): : 2219 - 2229
  • [50] Boosting CNN-Based Pedestrian Detection via 3D LiDAR Fusion in Autonomous Driving
    Dou, Jian
    Fang, Jianwu
    Li, Tao
    Xue, Jianru
    IMAGE AND GRAPHICS (ICIG 2017), PT II, 2017, 10667 : 3 - 13