Leveraging vehicle connectivity and autonomy for highway bottleneck congestion mitigation using reinforcement learning

被引:8
|
作者
Ha, Paul [1 ,2 ]
Chen, Sikai [3 ,4 ]
Dong, Jiqian [1 ,2 ]
Labi, Samuel [1 ,2 ]
机构
[1] Purdue Univ, Ctr Connected & Automated Transportat CCAT, W Lafayette, IN USA
[2] Purdue Univ, Lyles Sch Civil Engn, W Lafayette, IN USA
[3] Univ Wisconsin, Dept Civil & Environm Engn, Madison, WI USA
[4] Univ Wisconsin, Dept Civil & Environm Engn, Madison, WI 53706 USA
关键词
Speed harmonisation; congestion; bottleneck; deep reinforcement learning; connected and autonomous vehicles; active traffic management; VARIABLE-SPEED LIMITS; GRAPH NEURAL-NETWORK; SPATIOTEMPORAL ANALYSIS; OPERATIONAL IMPACTS; TRAFFIC MANAGEMENT; SAFETY; HARMONIZATION; MODEL;
D O I
10.1080/23249935.2023.2215338
中图分类号
U [交通运输];
学科分类号
08 ; 0823 ;
摘要
Automation and connectivity based platforms have great potential for managing highway traffic congestion including bottlenecks. Speed harmonisation (SH), one of such platforms, is an Active Traffic Management (ATM) strategy that addresses flow breakdown in real-time by adjusting upstream traffic speeds. However, SH has limitations including the need for supporting roadway infrastructure that is immovable and has limited coverage; the inability to enact control beyond its range; and the dependence on human driver compliance. These issues could be addressed by leveraging connected and automated vehicles (CAVs), which can collect information and execute control along their trajectories, irrespective of drivers' awareness or compliance. In addressing this objective, this study utilises reinforcement learning to present a CAV control model to achieve efficient speed harmonisation. The results suggest that even at low market penetration, CAVs can significantly mitigate traffic congestion bottlenecks to a greater extent compared to traditional SH approaches.
引用
收藏
页数:26
相关论文
共 50 条
  • [21] A reinforcement learning scheme for the equilibrium of the in-vehicle route choice problem based on congestion game
    Zhou, Bo
    Song, Qiankun
    Zhao, Zhenjiang
    Liu, Tangzhi
    APPLIED MATHEMATICS AND COMPUTATION, 2020, 371
  • [22] Autonomous vehicle navigation using evolutionary reinforcement learning
    Stafylopatis, A
    Blekas, K
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1998, 108 (02) : 306 - 318
  • [23] LEVERAGING CONVENTIONAL CONTROL TO IMPROVE PERFORMANCE OF SYSTEMS USING REINFORCEMENT LEARNING
    Eaglin, Gerald
    Vaughan, Joshua
    PROCEEDINGS OF THE ASME DYNAMIC SYSTEMS AND CONTROL CONFERENCE, DSCC2020, VOL 2, 2020,
  • [24] Overtaking Maneuvers in Simulated Highway Driving using Deep Reinforcement Learning
    Kaushik, Meha
    Prasad, Vignesh
    Krishna, K. Madhava
    Ravindran, Balaraman
    2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 1885 - 1890
  • [25] Highway Merging Control Using Multi-Agent Reinforcement Learning
    Irshayyid, Ali
    Chen, Jun
    2024 IEEE 3RD INTERNATIONAL CONFERENCE ON COMPUTING AND MACHINE INTELLIGENCE, ICMI 2024, 2024,
  • [26] Model-based deep reinforcement learning for CACC in mixed-autonomy vehicle platoons
    Chu, Tianshu
    Kalabic, Uros
    2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 4079 - 4084
  • [27] Probabilistic Policy Blending for Shared Autonomy using Deep Reinforcement Learning
    Singh, Saurav
    Heard, Jamison
    2023 32ND IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, RO-MAN, 2023, : 1537 - 1544
  • [28] SPACECRAFT DECISION-MAKING AUTONOMY USING DEEP REINFORCEMENT LEARNING
    Harris, Andrew
    Teil, Thibaud
    Schaub, Hanspeter
    SPACEFLIGHT MECHANICS 2019, VOL 168, PTS I-IV, 2019, 168 : 1757 - 1775
  • [29] Planning and prioritization strategies for phased highway mitigation using wildlife-vehicle collision data
    Ford, Adam T.
    Clevenger, Anthony P.
    Huijser, Marcel P.
    Dibb, Alan
    WILDLIFE BIOLOGY, 2011, 17 (03) : 253 - 265
  • [30] Using chains of bottleneck transitions to decompose and solve reinforcement learning tasks with hidden states
    Aydin, Huseyin
    Cilden, Erkin
    Polat, Faruk
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 133 : 153 - 168