Radar and Vision Deep Multi-Level Feature Fusion Based on Deep Learning

被引:0
|
作者
Zhang Zhouping [1 ,2 ]
Yu Qin [3 ]
Wang Xiaoliang [3 ]
Zhang Qiancheng [2 ]
Bin Xin [2 ]
机构
[1] Nanchang Automot Inst Intelligence & New Energy, Nanchang, Jiangxi, Peoples R China
[2] Tongji Univ, Shanghai, Peoples R China
[3] Jiangxi Isuzu Motors Co Ltd, Nanchang, Jiangxi, Peoples R China
关键词
intelligent driving; deep learning; radar; vision; multi-level feature fusion;
D O I
10.1109/ICCCR61138.2024.10585567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Based on deep learning, a perception network structure of radar and vision depth multi-level feature fusion is designed to realize the effective perception of intelligent driving in foggy scenes. Aiming at the problem of low efficiency when traditional feature fusion methods are applied to heterogeneous sensors with asymmetric feature information, spatial attention fusion is used to realize asymmetric feature fusion of radar and vision. Aiming at the problem that the fusion level of radar and vision low-level single features is shallow, and the fusion features are difficult to transfer to the deep network, a deep multi-level feature fusion structure is constructed to realize the multi-stage fusion of radar and vision features. At the same time, the attention mechanism module is introduced to integrate the fusion features and extract key information. Finally, the validity of the network is verified by testing. The obtained defogging results are sent to the network for testing, which further verifies the effectiveness of the fusion defogging algorithm. Through comparative experiments, it is proved that the fusion perception network can effectively improve the detection accuracy and recall rate of the intelligent vehicle perception system in foggy scenes.
引用
收藏
页码:81 / 88
页数:8
相关论文
共 50 条
  • [31] Multi-Level Representation Learning for Deep Subspace Clustering
    Kheirandishfard, Mohsen
    Zohrizadeh, Fariba
    Kamangar, Farhad
    [J]. 2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2028 - 2037
  • [32] Short-term Wind Power Prediction Based on Feature Selection and Multi-level Deep Transfer Learning
    Cheng, Kai
    Peng, Xiaosheng
    Xu, Qiyou
    Wang, Bo
    Liu, Chun
    Che, Jianfeng
    [J]. Gaodianya Jishu/High Voltage Engineering, 2022, 48 (02): : 497 - 503
  • [33] Multi-Level Layout Hotspot Detection based on Multi-Classification With Deep Learning
    Gai, Tianyang
    Qu, Tong
    Su, Xiaojing
    Wang, Shuhan
    Dong, Lisong
    Zhang, Libin
    Chen, Rui
    Su, Yajuan
    Wei, Yayi
    Ye, Tianchun
    [J]. DESIGN-PROCESS-TECHNOLOGY CO-OPTIMIZATION XV, 2021, 11614
  • [34] Vehicle Detection Method Based On Deep Learning and Multi -Layer Feature Fusion
    Zhao Min
    Jia Jian
    Sun Dihua
    Tang Yi
    [J]. PROCEEDINGS OF THE 30TH CHINESE CONTROL AND DECISION CONFERENCE (2018 CCDC), 2018, : 5862 - 5867
  • [35] Seal Recognition and Application Based on Multi-feature Fusion Deep Learning
    Zhang, Zhijian
    Xia, Sudi
    Liu, Zhenghao
    [J]. Data Analysis and Knowledge Discovery, 2024, 8 (03) : 143 - 155
  • [36] Multi-Level Gene/MiRNA Feature Selection using Deep Belief Nets and Active Learning
    Ibrahim, Rania
    Yousri, Noha A.
    Ismail, Mohamed A.
    El-Makky, Nagwa M.
    [J]. 2014 36TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2014, : 3957 - 3960
  • [37] Deep Multi-level Feature Learning on Point Sets for 3D Object Recognition
    Xiao, Yang
    Ma, Yanxin
    Huang, Qianlan
    Zhang, Jun
    [J]. 2018 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND SOFTWARE ENGINEERING (CSSE 2018), 2018, : 224 - 230
  • [38] Multi-level fault diagnosis of gearbox based on knowledge graph and deep learning
    Xu, Xinchen
    Sun, Beibei
    [J]. 2024 15TH INTERNATIONAL CONFERENCE ON MECHANICAL AND INTELLIGENT MANUFACTURING TECHNOLOGIES, ICMIMT 2024, 2024, : 6 - 12
  • [39] Head Pose Estimation Based on Multi-Level Feature Fusion
    Yan, Chunman
    Zhang, Xiao
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024, 38 (02)
  • [40] Human Action Recognition Based On Multi-level Feature Fusion
    Xu, Y. Y.
    Xiao, G. Q.
    Tang, X. Q.
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTER INFORMATION SYSTEMS AND INDUSTRIAL APPLICATIONS (CISIA 2015), 2015, 18 : 353 - 355