Leveraging vehicle connectivity and autonomy for highway bottleneck congestion mitigation using reinforcement learning

被引:8
|
作者
Ha, Paul [1 ,2 ]
Chen, Sikai [3 ,4 ]
Dong, Jiqian [1 ,2 ]
Labi, Samuel [1 ,2 ]
机构
[1] Purdue Univ, Ctr Connected & Automated Transportat CCAT, W Lafayette, IN USA
[2] Purdue Univ, Lyles Sch Civil Engn, W Lafayette, IN USA
[3] Univ Wisconsin, Dept Civil & Environm Engn, Madison, WI USA
[4] Univ Wisconsin, Dept Civil & Environm Engn, Madison, WI 53706 USA
关键词
Speed harmonisation; congestion; bottleneck; deep reinforcement learning; connected and autonomous vehicles; active traffic management; VARIABLE-SPEED LIMITS; GRAPH NEURAL-NETWORK; SPATIOTEMPORAL ANALYSIS; OPERATIONAL IMPACTS; TRAFFIC MANAGEMENT; SAFETY; HARMONIZATION; MODEL;
D O I
10.1080/23249935.2023.2215338
中图分类号
U [交通运输];
学科分类号
08 ; 0823 ;
摘要
Automation and connectivity based platforms have great potential for managing highway traffic congestion including bottlenecks. Speed harmonisation (SH), one of such platforms, is an Active Traffic Management (ATM) strategy that addresses flow breakdown in real-time by adjusting upstream traffic speeds. However, SH has limitations including the need for supporting roadway infrastructure that is immovable and has limited coverage; the inability to enact control beyond its range; and the dependence on human driver compliance. These issues could be addressed by leveraging connected and automated vehicles (CAVs), which can collect information and execute control along their trajectories, irrespective of drivers' awareness or compliance. In addressing this objective, this study utilises reinforcement learning to present a CAV control model to achieve efficient speed harmonisation. The results suggest that even at low market penetration, CAVs can significantly mitigate traffic congestion bottlenecks to a greater extent compared to traditional SH approaches.
引用
收藏
页数:26
相关论文
共 50 条
  • [21] Overtaking Maneuvers in Simulated Highway Driving using Deep Reinforcement Learning
    Kaushik, Meha
    Prasad, Vignesh
    Krishna, K. Madhava
    Ravindran, Balaraman
    [J]. 2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 1885 - 1890
  • [22] Highway Merging Control Using Multi-Agent Reinforcement Learning
    Irshayyid, Ali
    Chen, Jun
    [J]. 2024 IEEE 3RD INTERNATIONAL CONFERENCE ON COMPUTING AND MACHINE INTELLIGENCE, ICMI 2024, 2024,
  • [23] LEVERAGING CONVENTIONAL CONTROL TO IMPROVE PERFORMANCE OF SYSTEMS USING REINFORCEMENT LEARNING
    Eaglin, Gerald
    Vaughan, Joshua
    [J]. PROCEEDINGS OF THE ASME DYNAMIC SYSTEMS AND CONTROL CONFERENCE, DSCC2020, VOL 2, 2020,
  • [24] Model-based deep reinforcement learning for CACC in mixed-autonomy vehicle platoons
    Chu, Tianshu
    Kalabic, Uros
    [J]. 2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 4079 - 4084
  • [25] Probabilistic Policy Blending for Shared Autonomy using Deep Reinforcement Learning
    Singh, Saurav
    Heard, Jamison
    [J]. 2023 32ND IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, RO-MAN, 2023, : 1537 - 1544
  • [26] SPACECRAFT DECISION-MAKING AUTONOMY USING DEEP REINFORCEMENT LEARNING
    Harris, Andrew
    Teil, Thibaud
    Schaub, Hanspeter
    [J]. SPACEFLIGHT MECHANICS 2019, VOL 168, PTS I-IV, 2019, 168 : 1757 - 1775
  • [27] Planning and prioritization strategies for phased highway mitigation using wildlife-vehicle collision data
    Ford, Adam T.
    Clevenger, Anthony P.
    Huijser, Marcel P.
    Dibb, Alan
    [J]. WILDLIFE BIOLOGY, 2011, 17 (03) : 253 - 265
  • [28] Using chains of bottleneck transitions to decompose and solve reinforcement learning tasks with hidden states
    Aydin, Huseyin
    Cilden, Erkin
    Polat, Faruk
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 133 : 153 - 168
  • [29] Ramp Metering for a Distant Downstream Bottleneck Using Reinforcement Learning with Value Function Approximation
    Zhou, Yue
    Ozbay, Kaan
    Kachroo, Pushkin
    Zuo, Fan
    [J]. JOURNAL OF ADVANCED TRANSPORTATION, 2020, 2020
  • [30] REINFORCEMENT LEARNING USING MONTE CARLO POLICY ESTIMATION FOR DISASTER MITIGATION
    Khouj, Mohammed Talat
    Sarkaria, Sarbjit
    Lopez, Cesar
    Marti, Jose
    [J]. CRITICAL INFRASTRUCTURE PROTECTION VIII, 2014, 441 : 155 - +