A Deep Reinforcement Learning Method for Self-driving

被引:0
|
作者
Fang, Yong [1 ]
Gu, Jianfeng [1 ]
机构
[1] Shanghai Univ, Key Lab Specialty Fiber Opt & Opt Access Networks, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Self-driving; Deep reinforcement learning; Sparse rewards; Reward classification;
D O I
10.1007/978-3-319-95933-7_19
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Self-driving technology is an important issue of artificial intelligence. Basing on the end-to-end architecture, deep reinforcement learning has been applied to research for self-driving. However, self-driving environment yields sparse rewards when using deep reinforcement learning, resulting in local optimum to network training. As a result, the self-driving vehicle does not obtain correct actions from outputs of neural network. This paper proposes a deep reinforcement learning method for self-driving. According to the classification threshold value that is dynamically adjusted by reward distributions, the sparse rewards is divided into three groups. The experience information for different rewards is fully utilized and the local optimum problem in the network training process is avoided. By comparing with the traditional method, simulation results show that the proposed method significantly reduces the training time of network.
引用
收藏
页码:143 / 152
页数:10
相关论文
共 50 条
  • [1] Deep imitation reinforcement learning for self-driving by vision
    Zou, Qijie
    Xiong, Kang
    Fang, Qiang
    Jiang, Bohan
    [J]. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2021, 6 (04) : 493 - 503
  • [2] Self-driving network and service coordination using deep reinforcement learning
    Schneider, Stefan
    Manzoor, Adnan
    Qarawlus, Haydar
    Schellenberg, Rafael
    Karl, Holger
    Khalili, Ramin
    Hecker, Artur
    [J]. 16th International Conference on Network and Service Management, CNSM 2020, 2nd International Workshop on Analytics for Service and Application Management, AnServApp 2020 and 1st International Workshop on the Future Evolution of Internet Protocols, IPFuture 2020, 2020,
  • [3] Toward self-driving processes: A deep reinforcement learning approach to control
    Spielberg, Steven
    Tulsyan, Aditya
    Lawrence, Nathan P.
    Loewen, Philip D.
    Gopaluni, R. Bhushan
    [J]. AICHE JOURNAL, 2019, 65 (10)
  • [4] Deep Reinforcement Learning with external control: Self-driving car application
    Youssef, Fenjiro
    Houda, Benbrahim
    [J]. 4TH INTERNATIONAL CONFERENCE ON SMART CITY APPLICATIONS (SCA' 19), 2019,
  • [5] Self-Driving Network and Service Coordination Using Deep Reinforcement Learning
    Schneider, Stefan
    Manzoor, Adnan
    Qarawlus, Haydar
    Schellenberg, Rafael
    Karl, Holger
    Khalili, Ramin
    Hecker, Artur
    [J]. 2020 16TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT (CNSM), 2020,
  • [6] ICRAN: Intelligent Control for Self-Driving RAN Based on Deep Reinforcement Learning
    Ahmed, Azza H.
    Elmokashfi, Ahmed
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (03): : 2751 - 2766
  • [7] CoPace: Edge Computation Offloading and Caching for Self-Driving With Deep Reinforcement Learning
    Tian, Hao
    Xu, Xiaolong
    Qi, Lianyong
    Zhang, Xuyun
    Dou, Wanchun
    Yu, Shui
    Ni, Qiang
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (12) : 13281 - 13293
  • [8] Deep Reinforcement Learning based Planning for Urban Self-driving with Demonstration and Depth Completion
    Wang, Chuyao
    Aouf, Nabil
    [J]. 2021 21ST INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2021), 2021, : 962 - 967
  • [9] Hybrid Online POMDP Planning and Deep Reinforcement Learning for Safer Self-Driving Cars
    Pusse, Florian
    Klusch, Matthias
    [J]. 2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 1013 - 1020
  • [10] Parallel, Angular and Perpendicular Parking for Self-Driving Cars using Deep Reinforcement Learning
    Sousa, Bruno
    Ribeiro, Tiago
    Coelho, Joana
    Lopes, Gil
    Ribeiro, A. Fernando
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC), 2022, : 40 - 46