Adaptive Road Configurations for Improved Autonomous Vehicle-Pedestrian Interactions Using Reinforcement Learning

被引:1
|
作者
Ye, Qiming [1 ]
Feng, Yuxiang [1 ]
Macias, Jose Javier Escribano [1 ]
Stettler, Marc [1 ]
Angeloudis, Panagiotis [1 ]
机构
[1] Imperial Coll London, Ctr Transport Studies, Dept Civil & Environm Engn, London SW72AZ, England
关键词
Autonomous vehicles; pedestrians; smart city; intelligent transport system; reinforcement learning; infrastruc-ture management;
D O I
10.1109/TITS.2022.3220110
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The deployment of Autonomous Vehicles (AVs) poses considerable challenges and unique opportunities for the design and management of future urban road infrastructure. In light of this disruptive transformation, the Right-Of-Way (ROW) composition of road space has the potential to be renewed. Design approaches and intelligent control models have been proposed to address this problem, but we lack an operational framework that can dynamically generate ROW plans for AVs and pedestrians in response to real-time demand. Based on microscopic traffic simulation, this study explores Reinforcement Learning (RL) methods for evolving ROW compositions. We implement a centralised learning paradigm and a distributive learning paradigm to separately perform the dynamic control on several road network configurations. Experimental results indicate that the algorithms have the potential to improve traffic flow efficiency and allocate more space for pedestrians. Furthermore, the distributive learning algorithm outperforms its centralised counterpart regarding computational cost (49.55%), benchmark rewards (25.35%), best cumulative rewards (24.58%), optimal actions (13.49%) and rate of convergence. This novel road management technique could potentially contribute to the flow-adaptive and active mobility-friendly streets in the AVs era.
引用
收藏
页码:2024 / 2034
页数:11
相关论文
共 50 条
  • [21] Modeling Vehicle-Pedestrian Encountering Risks in the Natural Driving Environment Using Machine Learning Algorithms
    Gandhi, Priyanka
    Luo, Xiao
    Tian, Renran
    DIGITAL HUMAN MODELING AND APPLICATIONS IN HEALTH, SAFETY, ERGONOMICS AND RISK MANAGEMENT. HUMAN BODY AND MOTION, DHM 2019, PT I, 2019, 11581 : 382 - 393
  • [22] Designing Wearable Augmented Reality Concepts to Support Scalability in Autonomous Vehicle-Pedestrian Interaction
    Tram Thi Minh Tran
    Parker, Callum
    Wang, Yiyuan
    Tomitsch, Martin
    FRONTIERS IN COMPUTER SCIENCE, 2022, 4
  • [23] Autonomous Vehicle-Pedestrian Interaction Modeling Platform: A Case Study in Four Major Cities
    Shoman, Maged
    Lanzaro, Gabriel
    Sayed, Tarek
    Gargoum, Suliman
    JOURNAL OF TRANSPORTATION ENGINEERING PART A-SYSTEMS, 2024, 150 (09)
  • [24] Game theory modeling for vehicle-pedestrian interactions and simulation based on cellular automata
    Wu, WenJing
    Chen, RunChao
    Jia, Hongfei
    Li, Yongxing
    Liang, ZhiKang
    INTERNATIONAL JOURNAL OF MODERN PHYSICS C, 2019, 30 (04):
  • [25] Docking Control of an Autonomous Underwater Vehicle Using Reinforcement Learning
    Anderlini, Enrico
    Parker, Gordon G.
    Thomas, Giles
    APPLIED SCIENCES-BASEL, 2019, 9 (17):
  • [26] Autonomous Vehicle for Obstacle Detection and Avoidance Using Reinforcement Learning
    Arvind, C. S.
    Senthilnath, J.
    SOFT COMPUTING FOR PROBLEM SOLVING, SOCPROS 2018, VOL 1, 2020, 1048 : 55 - 66
  • [27] Wireless Control of Autonomous Guided Vehicle Using Reinforcement Learning
    Ana, Pedro M. de Sant
    Marchenko, Nikolaj
    Popovski, Petar
    Soret, Beatriz
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [28] Reinforcement Learning for Autonomous Vehicle using MPC in Highway Situation
    Kim, Yujin
    Pae, Dong-Sung
    Jang, Sun-Ho
    Kang, Seong-Woo
    Lim, Myo-Taeg
    2022 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2022,
  • [29] Deep reinforcement learning for adaptive path planning and control of an autonomous underwater vehicle
    Hadi, Behnaz
    Khosravi, Alireza
    Sarhadi, Pouria
    APPLIED OCEAN RESEARCH, 2022, 129
  • [30] An improved vehicle-pedestrian near-crash identification method with a roadside LiDAR sensor
    Wu, Jianqing
    Xu, Hao
    Zhang, Yongsheng
    Sun, Renjuan
    JOURNAL OF SAFETY RESEARCH, 2020, 73 : 211 - 224