End-to-End Reinforcement Learning for Self-driving Car

被引:11
|
作者
Chopra, Rohan [1 ]
Roy, Sanjiban Sekhar [1 ]
机构
[1] VIT Univ, Sch Comp Sci & Engn, Vellore, Tamil Nadu, India
关键词
Deep learning; Reinforcement learning; TORCS; CNN; Deep Q network;
D O I
10.1007/978-981-15-1081-6_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most of the current self-driving cars make use of multiple algorithms to drive. Furthermore, most of the approaches use supervised learning to train a model to drive the car autonomously. This approach leads to human bias being incorporated into the model. We implement the Deep Q-Learning algorithm to control a simulated car, end-to-end, autonomously. The algorithm is based on reinforcement learning which teaches machines what to do through interactions with the environment. The application of reinforcement learning for driving is of high relevance as it is highly dependent on interactions with the environment. Our model incorporates a CNN as the deep Q network. The system was tested on an open-source car-racing simulator called TORCS. The Deep Q-Learning approach allows the system to be more efficient and robust than a system that has been trained solely through supervised training. Our simulation results show that the system is able to drive autonomously and maneuver complex curves.
引用
收藏
页码:53 / 61
页数:9
相关论文
共 50 条
  • [1] Deep Transfer Learning Enable End-to-End Steering Angles Prediction for Self-driving Car
    Jiang, Huatao
    Chang, Lin
    Li, Qing
    Chen, Dapeng
    2020 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2020, : 405 - 412
  • [2] End-to-End Learning for Lane Keeping of Self-Driving Cars
    Chen, Zhilu
    Huang, Xinming
    2017 28TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV 2017), 2017, : 1856 - 1860
  • [3] End-to-End Learning-based Self-Driving Control Imitating Human Driving
    Kim, Donghyun
    Kwon, Jaerock
    Nam, Haewoon
    12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, : 1763 - 1765
  • [4] Data Augmentation Technology Driven By Image Style Transfer in Self-Driving Car Based on End-to-End Learning
    Liu, Dongjie
    Zhao, Jin
    Xi, Axin
    Wang, Chao
    Huang, Xinnian
    Lai, Kuncheng
    Liu, Chang
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2020, 122 (02): : 593 - 617
  • [5] End-to-End Race Driving with Deep Reinforcement Learning
    Jaritz, Maximilian
    de Charette, Raoul
    Toromanoff, Marin
    Perot, Etienne
    Nashashibi, Fawzi
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 2070 - 2075
  • [6] End-to-end models for self-driving cars on LPB campus roads
    Mihalea, Andrei
    Samoilescu, Robert
    Nica, Andrei Cristian
    Trascau, Mihai
    Sorici, Alexandru
    Florea, Adina Magda
    2019 IEEE 15TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTER COMMUNICATION AND PROCESSING (ICCP 2019), 2019, : 35 - 40
  • [7] Visual Explanation by Attention Branch Network for End-to-end Learning-based Self-driving
    Mori, Keisuke
    Fukui, Hiroshi
    Murase, Takuya
    Hirakawa, Tsubasa
    Yamashita, Takayoshi
    Fujiyoshi, Hironobu
    2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 1577 - 1582
  • [8] End-to-End Ego Lane Estimation based on Sequential Transfer Learning for Self-Driving Cars
    Kim, Jiman
    Park, Chanjong
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1194 - 1202
  • [9] End-to-End Urban Driving by Imitating a Reinforcement Learning Coach
    Zhang, Zhejun
    Liniger, Alexander
    Dai, Dengxin
    Yu, Fisher
    Van Gool, Luc
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 15202 - 15212
  • [10] End to End Learning based Self-Driving using JacintoNet
    Viswanath, Prashanth
    Nagori, Soyeb
    Mody, Mihir
    Mathew, Manu
    Swami, Pramod
    2018 IEEE 8TH INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - BERLIN (ICCE-BERLIN), 2018,