Multimodal Vehicular Trajectory Prediction With Inverse Reinforcement Learning and Risk Aversion at Urban Unsignalized Intersections

被引:5
|
作者
Geng, Maosi [1 ]
Cai, Zeen [1 ]
Zhu, Yizhang [2 ,3 ]
Chen, Xiqun [1 ,4 ,5 ]
Lee, Der-Horng [4 ]
机构
[1] Zhejiang Univ, Inst Intelligent Transportat Syst, Coll Civil Engn & Architecture, Hangzhou 310058, Peoples R China
[2] Zhejiang Univ, Polytech Inst, Hangzhou 310058, Peoples R China
[3] Zhejiang Univ, Inst Intelligent Transportat Syst, Hangzhou 310058, Peoples R China
[4] Zhejiang Univ Univ Illinois Urbana Champaign Inst, Haining 314400, Peoples R China
[5] Zhejiang Prov Engn Res Ctr Intelligent Transportat, Hangzhou 310058, Peoples R China
基金
中国国家自然科学基金;
关键词
Multimodal trajectory prediction; spatial and temporal transformers; inverse reinforcement learning; risk aversion; unsignalized urban intersection; GAME-THEORY;
D O I
10.1109/TITS.2023.3285891
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Understanding human drivers' intentions and predicting their future motions are significant to connected and autonomous vehicles and traffic safety and surveillance systems. Predicting multimodal vehicular trajectories at urban unsignalized intersections remains challenging due to dynamic traffic flow and uncertainty of human drivers' maneuvers. In this paper, we propose a comprehensive trajectory prediction framework that combines a multimodal trajectory generation network with inverse reinforcement learning (IRL) and risk aversion (RA) modules. Specifically, we first construct a multimodal spatial-temporal Transformer network (mmSTTN) to generate multiple trajectory candidates, using trajectory coordinates as inputs. Accounting for spatio-temporal features, we formulate the IRL reward function for evaluating all candidate trajectories. The optimal trajectory is then selected based on the computed rewards, a process that mimics human drivers' decision-making. We further develop the RA module based on the driving risk field for optimal risk-averse trajectory prediction. We conduct experiments and ablation studies using the inD dataset at an urban unsignalized intersection, demonstrating impressive human trajectory alignment, prediction accuracy, and the ability to generate risk-averse trajectories. Our proposed framework reduces prediction errors and driving risks by 25% and 30% compared to baseline methods. Results validate vehicles' human-like risk-averse diverging-and-concentrating behavior as they traverse the intersection. The proposed framework presents a novel approach for forecasting multimodal vehicular trajectories by imitating human drivers and incorporating physics-based risk information derived from the driving field. This research offers a promising direction for enhancing the safety and efficiency of connected and autonomous vehicles navigating urban environments.
引用
下载
收藏
页码:12227 / 12240
页数:14
相关论文
共 50 条
  • [1] An Improved Multimodal Trajectory Prediction Method Based on Deep Inverse Reinforcement Learning
    Chen, Ting
    Guo, Changxin
    Li, Hao
    Gao, Tao
    Chen, Lei
    Tu, Huizhao
    Yang, Jiangtian
    ELECTRONICS, 2022, 11 (24)
  • [2] Dynamic-learning spatial-temporal Transformer network for vehicular trajectory prediction at urban intersections
    Geng, Maosi
    Chen, Yong
    Xia, Yingji
    Chen, Xiqun
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2023, 156
  • [3] Deep Reinforcement Learning for Autonomous Vehicles Collaboration at Unsignalized Intersections
    Zheng, Jian
    Zhu, Kun
    Wang, Ran
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 1115 - 1120
  • [4] Multiagent reinforcement learning for autonomous driving in traffic zones with unsignalized intersections
    Spatharis, Christos
    Blekas, Konstantinos
    JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 28 (01) : 103 - 119
  • [5] A Multi-Task Reinforcement Learning Approach for Navigating Unsignalized Intersections
    Kai, Shixiong
    Wang, Bin
    Chen, Dong
    Hao, Jianye
    Zhang, Hongbo
    Liu, Wulong
    2020 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2020, : 1682 - 1687
  • [6] Courteous Behavior of Automated Vehicles at Unsignalized Intersections Via Reinforcement Learning
    Yan, Shengchao
    Welschehold, Tim
    Buescher, Daniel
    Burgard, Wolfram
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (01): : 191 - 198
  • [7] Trajectory Prediction at Unsignalized Intersections using Social Conditional Generative Adversarial Network
    Hsieh, Tsu-Jan
    Shih, Chi-Sheng
    Lin, Chung-Wei
    Chen, Chih-Wei
    Tsung, Pei-Kuei
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 844 - 851
  • [8] IRLSOT: Inverse reinforcement learning for scene-oriented trajectory prediction
    He, Caizhen
    Chen, Lanping
    Xu, Liming
    Yang, Changchun
    Liu, Xiaofeng
    Yang, Biao
    IET INTELLIGENT TRANSPORT SYSTEMS, 2022, 16 (06) : 769 - 781
  • [9] Learning to Drive at Unsignalized Intersections using Attention-based Deep Reinforcement Learning
    Seong, Hyunki
    Jung, Chanyoung
    Lee, Seungwook
    Shim, David Hyunchul
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 559 - 566
  • [10] Real-Time Vehicle Trajectory Prediction for Traffic Conflict Detection at Unsignalized Intersections
    Cao, Qianxia
    Zhao, Zhongxing
    Zeng, Qiaoqiong
    Wang, Zhengwu
    Long, Kejun
    JOURNAL OF ADVANCED TRANSPORTATION, 2021, 2021