An End-to-End solution to Autonomous Driving based on Xilinx FPGAd

被引:6
|
作者
Wu, Tianze [1 ]
Liu, Weiyi [2 ]
Jin, Yongwei [3 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Univ Chinese Acad Sci, Beijing, Peoples R China
[2] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[3] Xidian Univ, Xian, Peoples R China
关键词
Autonomous Driving; Machine Learning; Pynq-Z2; Field programmable gate arrays; Deep Learning Processing Unit;
D O I
10.1109/ICFPT47387.2019.00084
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Nowadays, the autonomous driving topic is very hot, many people are trying to provide a solution to this problem. This time we build our own auto-driving car based on Xilinx Pynq-Z2, it provides an end-to-end solution which inputs images from camera and outputs control instructions directly. The platform also uses the power of Deep learning Processing Unit(DPU) to accelerate the inference process and provides a simulator for training and testing in virtual environment. If the car meets some situations which cannot be handled by AI model, it's easy to add extra traditional computer vision functions to our control system. So our platform can help people who want to try autonomous driving build their own model and test it efficiently. We hope that our platform can be easy to use and extend.
引用
收藏
页码:427 / 430
页数:4
相关论文
共 50 条
  • [1] Multimodal End-to-End Autonomous Driving
    Xiao, Yi
    Codevilla, Felipe
    Gurram, Akhil
    Urfalioglu, Onay
    Lopez, Antonio M.
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (01) : 537 - 547
  • [2] Adversarial Driving: Attacking End-to-End Autonomous Driving
    Wu, Han
    Yunas, Syed
    Rowlands, Sareh
    Ruan, Wenjie
    Wahlstrom, Johan
    [J]. 2023 IEEE INTELLIGENT VEHICLES SYMPOSIUM, IV, 2023,
  • [3] End-to-end Autonomous Driving: Advancements and Challenges
    Chu, Duan-Feng
    Wang, Ru-Kang
    Wang, Jing-Yi
    Hua, Qiao-Zhi
    Lu, Li-Ping
    Wu, Chao-Zhong
    [J]. Zhongguo Gonglu Xuebao/China Journal of Highway and Transport, 2024, 37 (10): : 209 - 232
  • [4] End-to-End Autonomous Driving: Challenges and Frontiers
    OpenDriveLab, Shanghai Ai Lab, Shanghai
    200233, China
    不详
    不详
    72074, Germany
    不详
    72076, Germany
    [J]. IEEE Trans Pattern Anal Mach Intell, 2024, 12 (10164-10183):
  • [5] End-to-end autonomous driving based on the convolution neural network model
    Zhao, Yuanfang
    Chen, Yunli
    [J]. 2019 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2019, : 419 - 423
  • [6] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang, Zhiqing
    Zhang, Ji
    Tian, Rui
    Zhang, Yanxin
    [J]. CONFERENCE PROCEEDINGS OF 2019 5TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2019, : 658 - 662
  • [7] An Approach for Reliable End-to-End Autonomous Driving based on the Simplex Architecture
    Kwon, Seong Kyung
    Seo, Ji Hwan
    Lee, Jin-Woo
    Kim, Kyoung-Dae
    [J]. 2018 15TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV), 2018, : 1851 - 1856
  • [8] A Hierarchical Temporal Memory Based End-to-End Autonomous Driving System
    Le Mero, Luc
    Dianati, Mehrdad
    Lee, Graham
    [J]. Journal of Autonomous Vehicles and Systems, 2022, 2 (04):
  • [9] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang, Zhi-Qing
    Qu, Zhi-Wei
    Zhang, Ji
    Zhang, Yan-Xin
    Tian, Rui
    [J]. Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (09): : 1711 - 1719
  • [10] End-to-End Urban Autonomous Driving With Safety Constraints
    Hou, Changmeng
    Zhang, Wei
    [J]. IEEE ACCESS, 2024, 12 : 132198 - 132209