Radar and Vision Deep Multi-Level Feature Fusion Based on Deep Learning

被引:0
|
作者
Zhang Zhouping [1 ,2 ]
Yu Qin [3 ]
Wang Xiaoliang [3 ]
Zhang Qiancheng [2 ]
Bin Xin [2 ]
机构
[1] Nanchang Automot Inst Intelligence & New Energy, Nanchang, Jiangxi, Peoples R China
[2] Tongji Univ, Shanghai, Peoples R China
[3] Jiangxi Isuzu Motors Co Ltd, Nanchang, Jiangxi, Peoples R China
关键词
intelligent driving; deep learning; radar; vision; multi-level feature fusion;
D O I
10.1109/ICCCR61138.2024.10585567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Based on deep learning, a perception network structure of radar and vision depth multi-level feature fusion is designed to realize the effective perception of intelligent driving in foggy scenes. Aiming at the problem of low efficiency when traditional feature fusion methods are applied to heterogeneous sensors with asymmetric feature information, spatial attention fusion is used to realize asymmetric feature fusion of radar and vision. Aiming at the problem that the fusion level of radar and vision low-level single features is shallow, and the fusion features are difficult to transfer to the deep network, a deep multi-level feature fusion structure is constructed to realize the multi-stage fusion of radar and vision features. At the same time, the attention mechanism module is introduced to integrate the fusion features and extract key information. Finally, the validity of the network is verified by testing. The obtained defogging results are sent to the network for testing, which further verifies the effectiveness of the fusion defogging algorithm. Through comparative experiments, it is proved that the fusion perception network can effectively improve the detection accuracy and recall rate of the intelligent vehicle perception system in foggy scenes.
引用
收藏
页码:81 / 88
页数:8
相关论文
共 50 条
  • [21] An image super-resolution deep learning network based on multi-level feature extraction module
    Xin Yang
    Yifan Zhang
    Yingqing Guo
    Dake Zhou
    Multimedia Tools and Applications, 2021, 80 : 7063 - 7075
  • [22] An image super-resolution deep learning network based on multi-level feature extraction module
    Yang, Xin
    Zhang, Yifan
    Guo, Yingqing
    Zhou, Dake
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (05) : 7063 - 7075
  • [23] Clinical-inspired skin lesions recognition based on deep hair removal with multi-level feature fusion
    Tan, Ling
    Wu, Hui
    Zhu, Jining
    Liang, Ying
    Xia, Jingming
    PATTERN RECOGNITION, 2025, 161
  • [24] Deep Multi-Scale Feature Fusion Target Detection Algorithm Based on Deep Learning
    Liu Xin
    Chen Siyi
    Chen Xiaolong
    Du Xinhao
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (12)
  • [25] Deep Learning-Based Speech Emotion Recognition Using Multi-Level Fusion of Concurrent Features
    Kakuba, Samuel
    Poulose, Alwin
    Han, Dong Seog
    IEEE ACCESS, 2022, 10 : 125538 - 125551
  • [26] BLIND STEREOSCOPIC IMAGE QUALITY ASSESSMENT BY DEEP NEURAL NETWORK OF MULTI-LEVEL FEATURE FUSION
    Yan, Jiebin
    Fang, Yuming
    Huang, Liping
    Min, Xiongkuo
    Yao, Yiru
    Zhai, Guangtao
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [27] Feature radiance fields (FeRF): A multi-level feature fusion method with deep neural network for image synthesis
    Chen, Jubo
    Yu, Xiaosheng
    Wu, Chengdong
    Tian, Xiaolei
    Xu, Ke
    APPLIED SOFT COMPUTING, 2024, 167
  • [28] A Multi-Level Plagiarism Detection System Based on Deep Learning Algorithms
    Hambi, El Mostafa
    Benabbou, Faouzia
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2019, 19 (10): : 110 - 117
  • [29] LPI Radar Waveform Recognition Based on Multi-Resolution Deep Feature Fusion
    Ni, Xue
    Wang, Huali
    Meng, Fan
    Hu, Jing
    Tong, Changkai
    IEEE ACCESS, 2021, 9 : 26138 - 26146
  • [30] Work Mode Identification of Airborne Phased Array Radar Based on the Combination of Multi-Level Modeling and Deep Learning
    Li Hui
    Jin Wei Dong
    Liu Hao Dong
    Chen Tao Wei
    PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 7005 - 7010