Risk assessment and interactive motion planning with visual occlusion using graph attention networks and reinforcement learning

被引:0
|
作者
Hou, Xiaohui [1 ,2 ]
Gan, Minggang [1 ,2 ]
Wu, Wei [1 ,2 ]
Zhao, Tiantong [1 ,2 ]
Chen, Jie [2 ,3 ]
机构
[1] Beijing Inst Technol, Sch Automat, Beijing, Peoples R China
[2] Beijing Inst Technol, Natl Key Lab Autonomous Intelligent Unmanned Syst, Beijing, Peoples R China
[3] Tongji Univ, Dept Control Sci & Engn, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Risk assessment; Interactive motion planning; Autonomous vehicles; Reinforcement learning; Uncertain environment; AWARE; PREDICTION;
D O I
10.1016/j.aei.2024.102941
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes an innovative framework that integrates risk assessment and interactive planning for autonomous vehicles (AVs) navigating unprotected left turns at occluded intersections. The upper risk assessment module of this framework synergizes Expert-Informed Graph Attention Networks (EIGAT) with Mixture Density Network (MDN) to predict the probabilistic distributions of the potential risk of the occluded zone. And the lower interactive planning module, utilizing Adaptive Loss Enhanced Reinforcement Learning (ALERL), further develops an interactive policy that integrates additional considerations for prediction accuracy of blind zones, potential risk measure of conditional value at risk (CVaR), and encourage of exploratory interaction. Simulation tests are conducted in occluded intersection scenarios with various traffic density level. Both qualitative and quantitative performance validate the effectiveness and adaptability of our proposed controller in risk assessment and interactive planning for AVs compared with other baseline methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Cross-Observability Optimistic-Pessimistic Safe Reinforcement Learning for Interactive Motion Planning With Visual Occlusion
    Hou, Xiaohui
    Gan, Minggang
    Wu, Wei
    Ji, Yuan
    Zhao, Shiyue
    Chen, Jie
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (11) : 17602 - 17613
  • [2] Learning Structure-from-Motion with Graph Attention Networks
    Brynte, Lucas
    Iglesias, Jose Pedro
    Olsson, Carl
    Kahl, Fredrik
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 4808 - 4817
  • [3] Action Recognition Using Visual Attention with Reinforcement Learning
    Li, Hongyang
    Chen, Jun
    Hu, Ruimin
    Yu, Mei
    Chen, Huafeng
    Xu, Zengmin
    MULTIMEDIA MODELING, MMM 2019, PT II, 2019, 11296 : 365 - 376
  • [4] VGN: Value Decomposition With Graph Attention Networks for Multiagent Reinforcement Learning
    Wei, Qinglai
    Li, Yugu
    Zhang, Jie
    Wang, Fei-Yue
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) : 182 - 195
  • [5] Motion Planning for Industrial Robots using Reinforcement Learning
    Meyes, Richard
    Tercan, Hasan
    Roggendorf, Simon
    Thiele, Thomas
    Buescher, Christian
    Obdenbusch, Markus
    Brecher, Christian
    Jeschke, Sabina
    Meisen, Tobias
    MANUFACTURING SYSTEMS 4.0, 2017, 63 : 107 - 112
  • [6] A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly
    Liu, Zhenyu
    Wang, Ke
    Liu, Daxin
    Wang, Qide
    Tan, Jianrong
    IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2023, 28 (06) : 3513 - 3524
  • [7] Graph neural networks-based scheduler for production planning problems using reinforcement learning
    Hameed, Mohammed Sharafath Abdul
    Schwung, Andreas
    JOURNAL OF MANUFACTURING SYSTEMS, 2023, 69 : 91 - 102
  • [8] Enterprise risk assessment model based on graph attention networks
    Bi, Kejun
    Liu, Chuanjie
    Guo, Bing
    APPLIED INTELLIGENCE, 2025, 55 (03)
  • [9] Equipping With Cognition: Interactive Motion Planning Using Metacognitive-Attribution Inspired Reinforcement Learning for Autonomous Vehicles
    Hou, Xiaohui
    Gan, Minggang
    Wu, Wei
    Ji, Yuan
    Zhao, Shiyue
    Chen, Jie
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 26 (03) : 4178 - 4191
  • [10] DRL-GAT-SA: Deep reinforcement learning for autonomous driving planning based on graph attention networks and simplex architecture
    Peng, Yanfei
    Tan, Guozhen
    Si, Huaiwei
    Li, Jianping
    JOURNAL OF SYSTEMS ARCHITECTURE, 2022, 126