An End-to-End solution to Autonomous Driving based on Xilinx FPGAd

被引:6
|
作者
Wu, Tianze [1 ]
Liu, Weiyi [2 ]
Jin, Yongwei [3 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Univ Chinese Acad Sci, Beijing, Peoples R China
[2] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[3] Xidian Univ, Xian, Peoples R China
关键词
Autonomous Driving; Machine Learning; Pynq-Z2; Field programmable gate arrays; Deep Learning Processing Unit;
D O I
10.1109/ICFPT47387.2019.00084
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Nowadays, the autonomous driving topic is very hot, many people are trying to provide a solution to this problem. This time we build our own auto-driving car based on Xilinx Pynq-Z2, it provides an end-to-end solution which inputs images from camera and outputs control instructions directly. The platform also uses the power of Deep learning Processing Unit(DPU) to accelerate the inference process and provides a simulator for training and testing in virtual environment. If the car meets some situations which cannot be handled by AI model, it's easy to add extra traditional computer vision functions to our control system. So our platform can help people who want to try autonomous driving build their own model and test it efficiently. We hope that our platform can be easy to use and extend.
引用
下载
收藏
页码:427 / 430
页数:4
相关论文
共 50 条
  • [1] Multimodal End-to-End Autonomous Driving
    Xiao, Yi
    Codevilla, Felipe
    Gurram, Akhil
    Urfalioglu, Onay
    Lopez, Antonio M.
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (01) : 537 - 547
  • [2] Adversarial Driving: Attacking End-to-End Autonomous Driving
    Wu, Han
    Yunas, Syed
    Rowlands, Sareh
    Ruan, Wenjie
    Wahlstrom, Johan
    2023 IEEE INTELLIGENT VEHICLES SYMPOSIUM, IV, 2023,
  • [3] End-to-end Autonomous Driving: Advancements and Challenges
    Chu, Duan-Feng
    Wang, Ru-Kang
    Wang, Jing-Yi
    Hua, Qiao-Zhi
    Lu, Li-Ping
    Wu, Chao-Zhong
    Zhongguo Gonglu Xuebao/China Journal of Highway and Transport, 2024, 37 (10): : 209 - 232
  • [4] End-to-End Autonomous Driving: Challenges and Frontiers
    Chen, Li
    Wu, Penghao
    Chitta, Kashyap
    Jaeger, Bernhard
    Geiger, Andreas
    Li, Hongyang
    IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, 46 (12) : 10164 - 10183
  • [5] End-to-end autonomous driving based on the convolution neural network model
    Zhao, Yuanfang
    Chen, Yunli
    2019 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2019, : 419 - 423
  • [6] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang, Zhiqing
    Zhang, Ji
    Tian, Rui
    Zhang, Yanxin
    CONFERENCE PROCEEDINGS OF 2019 5TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2019, : 658 - 662
  • [7] A Hierarchical Temporal Memory Based End-to-End Autonomous Driving System
    Le Mero, Luc
    Dianati, Mehrdad
    Lee, Graham
    Journal of Autonomous Vehicles and Systems, 2022, 2 (04):
  • [8] An Approach for Reliable End-to-End Autonomous Driving based on the Simplex Architecture
    Kwon, Seong Kyung
    Seo, Ji Hwan
    Lee, Jin-Woo
    Kim, Kyoung-Dae
    2018 15TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV), 2018, : 1851 - 1856
  • [9] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang Z.-Q.
    Qu Z.-W.
    Zhang J.
    Zhang Y.-X.
    Tian R.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (09): : 1711 - 1719
  • [10] End-to-End Urban Autonomous Driving With Safety Constraints
    Hou, Changmeng
    Zhang, Wei
    IEEE ACCESS, 2024, 12 : 132198 - 132209