Radar and Vision Deep Multi-Level Feature Fusion Based on Deep Learning

被引:0
|
作者
Zhang Zhouping [1 ,2 ]
Yu Qin [3 ]
Wang Xiaoliang [3 ]
Zhang Qiancheng [2 ]
Bin Xin [2 ]
机构
[1] Nanchang Automot Inst Intelligence & New Energy, Nanchang, Jiangxi, Peoples R China
[2] Tongji Univ, Shanghai, Peoples R China
[3] Jiangxi Isuzu Motors Co Ltd, Nanchang, Jiangxi, Peoples R China
关键词
intelligent driving; deep learning; radar; vision; multi-level feature fusion;
D O I
10.1109/ICCCR61138.2024.10585567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Based on deep learning, a perception network structure of radar and vision depth multi-level feature fusion is designed to realize the effective perception of intelligent driving in foggy scenes. Aiming at the problem of low efficiency when traditional feature fusion methods are applied to heterogeneous sensors with asymmetric feature information, spatial attention fusion is used to realize asymmetric feature fusion of radar and vision. Aiming at the problem that the fusion level of radar and vision low-level single features is shallow, and the fusion features are difficult to transfer to the deep network, a deep multi-level feature fusion structure is constructed to realize the multi-stage fusion of radar and vision features. At the same time, the attention mechanism module is introduced to integrate the fusion features and extract key information. Finally, the validity of the network is verified by testing. The obtained defogging results are sent to the network for testing, which further verifies the effectiveness of the fusion defogging algorithm. Through comparative experiments, it is proved that the fusion perception network can effectively improve the detection accuracy and recall rate of the intelligent vehicle perception system in foggy scenes.
引用
收藏
页码:81 / 88
页数:8
相关论文
共 50 条
  • [1] A deep clustering by multi-level feature fusion
    Hou, Haiwei
    Ding, Shifei
    Xu, Xiao
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (10) : 2813 - 2823
  • [2] A deep clustering by multi-level feature fusion
    Haiwei Hou
    Shifei Ding
    Xiao Xu
    [J]. International Journal of Machine Learning and Cybernetics, 2022, 13 : 2813 - 2823
  • [3] Video splicing detection and localization based on multi-level deep feature fusion and reinforcement learning
    Xiao Jin
    Zhen He
    Jing Xu
    Yongwei Wang
    Yuting Su
    [J]. Multimedia Tools and Applications, 2022, 81 : 40993 - 41011
  • [4] Video splicing detection and localization based on multi-level deep feature fusion and reinforcement learning
    Jin, Xiao
    He, Zhen
    Xu, Jing
    Wang, Yongwei
    Su, Yuting
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (28) : 40993 - 41011
  • [5] Product Evaluation Prediction Model Based on Multi-Level Deep Feature Fusion
    Zhou, Qingyan
    Li, Hao
    Zhang, Youhua
    Zheng, Junhong
    [J]. FUTURE INTERNET, 2023, 15 (01):
  • [6] Multi-Level Drowsiness Detection Based on Deep Feature Fusion of Eye and Head Pose
    Ye, Fang
    Li, Shunxin
    Yuan, Xin
    Li, Longfei
    [J]. PROCEEDINGS OF THE 2021 IEEE INTERNATIONAL CONFERENCE ON PROGRESS IN INFORMATICS AND COMPUTING (PIC), 2021, : 107 - 111
  • [7] Multi-level Feature Fusion SAR Automatic Target Recognition Based on Deep Forest
    Li Lu
    Du Lan
    He Haonan
    Li Chen
    Deng Shen
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2021, 43 (03) : 606 - 614
  • [8] Feature Level Information Fusion Based Deep Learning
    Wang, Kejun
    Hao, Xuesen
    Xing, Xianglei
    [J]. PROCEEDINGS OF 2017 CHINESE INTELLIGENT AUTOMATION CONFERENCE, 2018, 458 : 501 - 511
  • [9] Point Cloud Deep Learning Network Based on Local Domain Multi-Level Feature
    Han, Xianquan
    Chen, Xijiang
    Deng, Hui
    Wan, Peng
    Li, Jianzhou
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (19):
  • [10] A deep learning based algorithm with multi-level feature extraction for automatic modulation recognition
    Zhang, Hang
    Nie, Ruihua
    Lin, Minghui
    Wu, Ruijuan
    Xian, Guo
    Gong, Xiaofeng
    Yu, Qin
    Luo, Ruisen
    [J]. WIRELESS NETWORKS, 2021, 27 (07) : 4665 - 4676