Radar and Vision Deep Multi-Level Feature Fusion Based on Deep Learning

被引:0
|
作者
Zhang Zhouping [1 ,2 ]
Yu Qin [3 ]
Wang Xiaoliang [3 ]
Zhang Qiancheng [2 ]
Bin Xin [2 ]
机构
[1] Nanchang Automot Inst Intelligence & New Energy, Nanchang, Jiangxi, Peoples R China
[2] Tongji Univ, Shanghai, Peoples R China
[3] Jiangxi Isuzu Motors Co Ltd, Nanchang, Jiangxi, Peoples R China
关键词
intelligent driving; deep learning; radar; vision; multi-level feature fusion;
D O I
10.1109/ICCCR61138.2024.10585567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Based on deep learning, a perception network structure of radar and vision depth multi-level feature fusion is designed to realize the effective perception of intelligent driving in foggy scenes. Aiming at the problem of low efficiency when traditional feature fusion methods are applied to heterogeneous sensors with asymmetric feature information, spatial attention fusion is used to realize asymmetric feature fusion of radar and vision. Aiming at the problem that the fusion level of radar and vision low-level single features is shallow, and the fusion features are difficult to transfer to the deep network, a deep multi-level feature fusion structure is constructed to realize the multi-stage fusion of radar and vision features. At the same time, the attention mechanism module is introduced to integrate the fusion features and extract key information. Finally, the validity of the network is verified by testing. The obtained defogging results are sent to the network for testing, which further verifies the effectiveness of the fusion defogging algorithm. Through comparative experiments, it is proved that the fusion perception network can effectively improve the detection accuracy and recall rate of the intelligent vehicle perception system in foggy scenes.
引用
收藏
页码:81 / 88
页数:8
相关论文
共 50 条
  • [31] Multi-level Distance Regularization for Deep Metric Learning
    Kim, Yonghyun
    Park, Wonpyo
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 1827 - 1835
  • [32] A multi-level deep learning system for malware detection
    Zhong, Wei
    Gu, Feng
    EXPERT SYSTEMS WITH APPLICATIONS, 2019, 133 : 151 - 162
  • [33] Multi-Level Representation Learning for Deep Subspace Clustering
    Kheirandishfard, Mohsen
    Zohrizadeh, Fariba
    Kamangar, Farhad
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2028 - 2037
  • [34] Short-term Wind Power Prediction Based on Feature Selection and Multi-level Deep Transfer Learning
    Cheng K.
    Peng X.
    Xu Q.
    Wang B.
    Liu C.
    Che J.
    Gaodianya Jishu/High Voltage Engineering, 2022, 48 (02): : 497 - 503
  • [35] Multi-Level Layout Hotspot Detection based on Multi-Classification With Deep Learning
    Gai, Tianyang
    Qu, Tong
    Su, Xiaojing
    Wang, Shuhan
    Dong, Lisong
    Zhang, Libin
    Chen, Rui
    Su, Yajuan
    Wei, Yayi
    Ye, Tianchun
    DESIGN-PROCESS-TECHNOLOGY CO-OPTIMIZATION XV, 2021, 11614
  • [36] Vehicle Detection Method Based On Deep Learning and Multi -Layer Feature Fusion
    Zhao Min
    Jia Jian
    Sun Dihua
    Tang Yi
    PROCEEDINGS OF THE 30TH CHINESE CONTROL AND DECISION CONFERENCE (2018 CCDC), 2018, : 5862 - 5867
  • [37] Seal Recognition and Application Based on Multi-feature Fusion Deep Learning
    Zhang Z.
    Xia S.
    Liu Z.
    Data Analysis and Knowledge Discovery, 2024, 8 (03) : 143 - 155
  • [38] Multi-Level Gene/MiRNA Feature Selection using Deep Belief Nets and Active Learning
    Ibrahim, Rania
    Yousri, Noha A.
    Ismail, Mohamed A.
    El-Makky, Nagwa M.
    2014 36TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2014, : 3957 - 3960
  • [39] Deep Multi-level Feature Learning on Point Sets for 3D Object Recognition
    Xiao, Yang
    Ma, Yanxin
    Huang, Qianlan
    Zhang, Jun
    2018 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND SOFTWARE ENGINEERING (CSSE 2018), 2018, : 224 - 230
  • [40] Multi-level fault diagnosis of gearbox based on knowledge graph and deep learning
    Xu, Xinchen
    Sun, Beibei
    2024 15TH INTERNATIONAL CONFERENCE ON MECHANICAL AND INTELLIGENT MANUFACTURING TECHNOLOGIES, ICMIMT 2024, 2024, : 6 - 12