Multimodal Vehicular Trajectory Prediction With Inverse Reinforcement Learning and Risk Aversion at Urban Unsignalized Intersections

被引:5
|
作者
Geng, Maosi [1 ]
Cai, Zeen [1 ]
Zhu, Yizhang [2 ,3 ]
Chen, Xiqun [1 ,4 ,5 ]
Lee, Der-Horng [4 ]
机构
[1] Zhejiang Univ, Inst Intelligent Transportat Syst, Coll Civil Engn & Architecture, Hangzhou 310058, Peoples R China
[2] Zhejiang Univ, Polytech Inst, Hangzhou 310058, Peoples R China
[3] Zhejiang Univ, Inst Intelligent Transportat Syst, Hangzhou 310058, Peoples R China
[4] Zhejiang Univ Univ Illinois Urbana Champaign Inst, Haining 314400, Peoples R China
[5] Zhejiang Prov Engn Res Ctr Intelligent Transportat, Hangzhou 310058, Peoples R China
基金
中国国家自然科学基金;
关键词
Multimodal trajectory prediction; spatial and temporal transformers; inverse reinforcement learning; risk aversion; unsignalized urban intersection; GAME-THEORY;
D O I
10.1109/TITS.2023.3285891
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Understanding human drivers' intentions and predicting their future motions are significant to connected and autonomous vehicles and traffic safety and surveillance systems. Predicting multimodal vehicular trajectories at urban unsignalized intersections remains challenging due to dynamic traffic flow and uncertainty of human drivers' maneuvers. In this paper, we propose a comprehensive trajectory prediction framework that combines a multimodal trajectory generation network with inverse reinforcement learning (IRL) and risk aversion (RA) modules. Specifically, we first construct a multimodal spatial-temporal Transformer network (mmSTTN) to generate multiple trajectory candidates, using trajectory coordinates as inputs. Accounting for spatio-temporal features, we formulate the IRL reward function for evaluating all candidate trajectories. The optimal trajectory is then selected based on the computed rewards, a process that mimics human drivers' decision-making. We further develop the RA module based on the driving risk field for optimal risk-averse trajectory prediction. We conduct experiments and ablation studies using the inD dataset at an urban unsignalized intersection, demonstrating impressive human trajectory alignment, prediction accuracy, and the ability to generate risk-averse trajectories. Our proposed framework reduces prediction errors and driving risks by 25% and 30% compared to baseline methods. Results validate vehicles' human-like risk-averse diverging-and-concentrating behavior as they traverse the intersection. The proposed framework presents a novel approach for forecasting multimodal vehicular trajectories by imitating human drivers and incorporating physics-based risk information derived from the driving field. This research offers a promising direction for enhancing the safety and efficiency of connected and autonomous vehicles navigating urban environments.
引用
收藏
页码:12227 / 12240
页数:14
相关论文
共 50 条
  • [21] Multi-agent reinforcement learning for vehicular task offloading with multi-step trajectory prediction
    Zhang, Xinyi
    Zhu, Yanmin
    Wang, Chunyang
    Cao, Jian
    Chen, Yirong
    Wang, Jie
    CCF TRANSACTIONS ON PERVASIVE COMPUTING AND INTERACTION, 2024, 6 (02) : 101 - 114
  • [22] Travel Time-dependent Maximum Entropy Inverse Reinforcement Learning for Seabird Trajectory Prediction
    Hirakawa, Tsubasa
    Yamashita, Takayoshi
    Yoda, Ken
    Tamaki, Toru
    Fujiyoshi, Hironobu
    PROCEEDINGS 2017 4TH IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), 2017, : 430 - 435
  • [23] Research on Trajectory Prediction of Vehicle Lane Change for Autonomous Driving Based on Inverse Reinforcement Learning
    Zhan, Ming
    Fan, Jingjing
    Jin, Linhao
    SEVENTH INTERNATIONAL CONFERENCE ON TRAFFIC ENGINEERING AND TRANSPORTATION SYSTEM, ICTETS 2023, 2024, 13064
  • [24] Predictive trajectory planning for autonomous vehicles at intersections using reinforcement learning
    Zhang, Ethan
    Zhang, Ruixuan
    Masoud, Neda
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2023, 149
  • [25] Reasoning graph-based reinforcement learning to cooperate mixed connected and autonomous traffic at unsignalized intersections
    Zhou, Donghao
    Hang, Peng
    Sun, Jian
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2024, 167
  • [26] Trajectory Planning of Multiple Dronecells in Vehicular Networks: A Reinforcement Learning Approach
    Samir, Moataz
    Ebrahimi, Dariush
    Assi, Chadi
    Sharafeddine, Sanaa
    Ghrayeb, Ali
    IEEE Networking Letters, 2020, 2 (01): : 14 - 18
  • [27] Multiagent Deep Reinforcement Learning for Dynamic Avatar Migration in AIoT-Enabled Vehicular Metaverses With Trajectory Prediction
    Chen, Junlong
    Kang, Jiawen
    Xu, Minrui
    Xiong, Zehui
    Niyato, Dusit
    Chen, Chuan
    Jamalipour, Abbas
    Xie, Shengli
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (01) : 70 - 83
  • [28] Behavior Planning at Urban Intersections through Hierarchical Reinforcement Learning
    Qiao, Zhiqian
    Schneider, Jeff
    Dolan, John M.
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 2667 - 2673
  • [29] Multidimensional graph transformer networks for trajectory prediction in urban road intersections
    Quan, Xuefeng
    Luo, Dening
    Yang, Qiang
    Xia, Tianfei
    Zhang, Gexiang
    JOURNAL OF MEMBRANE COMPUTING, 2024, : 1 - 13
  • [30] Trajectory Prediction of Traffic Agents at Urban Intersections Through Learned Interactions
    Sarkar, A.
    Czarnecki, Krzysztof
    Angus, Matt
    Li, Changjian
    Waslander, Steven
    2017 IEEE 20TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2017,