Radar and Vision Deep Multi-Level Feature Fusion Based on Deep Learning

被引:0
|
作者
Zhang Zhouping [1 ,2 ]
Yu Qin [3 ]
Wang Xiaoliang [3 ]
Zhang Qiancheng [2 ]
Bin Xin [2 ]
机构
[1] Nanchang Automot Inst Intelligence & New Energy, Nanchang, Jiangxi, Peoples R China
[2] Tongji Univ, Shanghai, Peoples R China
[3] Jiangxi Isuzu Motors Co Ltd, Nanchang, Jiangxi, Peoples R China
关键词
intelligent driving; deep learning; radar; vision; multi-level feature fusion;
D O I
10.1109/ICCCR61138.2024.10585567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Based on deep learning, a perception network structure of radar and vision depth multi-level feature fusion is designed to realize the effective perception of intelligent driving in foggy scenes. Aiming at the problem of low efficiency when traditional feature fusion methods are applied to heterogeneous sensors with asymmetric feature information, spatial attention fusion is used to realize asymmetric feature fusion of radar and vision. Aiming at the problem that the fusion level of radar and vision low-level single features is shallow, and the fusion features are difficult to transfer to the deep network, a deep multi-level feature fusion structure is constructed to realize the multi-stage fusion of radar and vision features. At the same time, the attention mechanism module is introduced to integrate the fusion features and extract key information. Finally, the validity of the network is verified by testing. The obtained defogging results are sent to the network for testing, which further verifies the effectiveness of the fusion defogging algorithm. Through comparative experiments, it is proved that the fusion perception network can effectively improve the detection accuracy and recall rate of the intelligent vehicle perception system in foggy scenes.
引用
收藏
页码:81 / 88
页数:8
相关论文
共 50 条
  • [41] Head Pose Estimation Based on Multi-Level Feature Fusion
    Yan, Chunman
    Zhang, Xiao
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024, 38 (02)
  • [42] Human Action Recognition Based On Multi-level Feature Fusion
    Xu, Y. Y.
    Xiao, G. Q.
    Tang, X. Q.
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTER INFORMATION SYSTEMS AND INDUSTRIAL APPLICATIONS (CISIA 2015), 2015, 18 : 353 - 355
  • [43] MULTI-WAY MULTI-VIEW DEEP AUTOENCODER FOR IMAGE FEATURE LEARNING WITH MULTI-LEVEL GRAPH REGULARIZATION
    Fang, Zheng
    Zhou, Sen
    Li, Xi
    Zhu, Haoqi
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2093 - 2097
  • [45] Multi-level fusion with deep neural networks for multimodal sentiment classification
    Zhang Guangwei
    Zhao Bing
    Li Ruifan
    TheJournalofChinaUniversitiesofPostsandTelecommunications, 2022, 29 (03) : 25 - 33
  • [46] A Multi-level Internet Traffic Classifier Using Deep Learning
    Salman, Ola
    Elhajj, Imad H.
    Chehab, Ali
    Kayssi, Ayman
    PROCEEDINGS OF THE 2018 9TH INTERNATIONAL CONFERENCE ON THE NETWORK OF THE FUTURE (NOF), 2018, : 68 - 75
  • [47] Multimodal Feature Level Fusion based on Particle Swarm Optimization with Deep Transfer Learning
    Silva, Pedro H.
    Luz, Eduardo
    Zanlorensi, Luiz A., Jr.
    Menotti, David
    Moreira, Gladston
    2018 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2018, : 2036 - 2043
  • [48] Learning Multi-level Deep Representations for Image Emotion Classification
    Tianrong Rao
    Xiaoxu Li
    Min Xu
    Neural Processing Letters, 2020, 51 : 2043 - 2061
  • [49] Learning Multi-level Deep Representations for Image Emotion Classification
    Rao, Tianrong
    Li, Xiaoxu
    Xu, Min
    NEURAL PROCESSING LETTERS, 2020, 51 (03) : 2043 - 2061
  • [50] Protein multi-level structure feature-integrated deep learning method for mutational effect prediction
    Pang, Ai-Ping
    Luo, Yongsheng
    Zhou, Junping
    Cai, Xue
    Huang, Lianggang
    Zhang, Bo
    Liu, Zhi-Qiang
    Zheng, Yu-Guo
    BIOTECHNOLOGY JOURNAL, 2024, 19 (08)