Risk assessment and interactive motion planning with visual occlusion using graph attention networks and reinforcement learning

被引:0
|
作者
Hou, Xiaohui [1 ,2 ]
Gan, Minggang [1 ,2 ]
Wu, Wei [1 ,2 ]
Zhao, Tiantong [1 ,2 ]
Chen, Jie [2 ,3 ]
机构
[1] Beijing Inst Technol, Sch Automat, Beijing, Peoples R China
[2] Beijing Inst Technol, Natl Key Lab Autonomous Intelligent Unmanned Syst, Beijing, Peoples R China
[3] Tongji Univ, Dept Control Sci & Engn, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Risk assessment; Interactive motion planning; Autonomous vehicles; Reinforcement learning; Uncertain environment; AWARE; PREDICTION;
D O I
10.1016/j.aei.2024.102941
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes an innovative framework that integrates risk assessment and interactive planning for autonomous vehicles (AVs) navigating unprotected left turns at occluded intersections. The upper risk assessment module of this framework synergizes Expert-Informed Graph Attention Networks (EIGAT) with Mixture Density Network (MDN) to predict the probabilistic distributions of the potential risk of the occluded zone. And the lower interactive planning module, utilizing Adaptive Loss Enhanced Reinforcement Learning (ALERL), further develops an interactive policy that integrates additional considerations for prediction accuracy of blind zones, potential risk measure of conditional value at risk (CVaR), and encourage of exploratory interaction. Simulation tests are conducted in occluded intersection scenarios with various traffic density level. Both qualitative and quantitative performance validate the effectiveness and adaptability of our proposed controller in risk assessment and interactive planning for AVs compared with other baseline methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Solving uncapacitated P-Median problem with reinforcement learning assisted by graph attention networks
    Wang, Chenguang
    Han, Congying
    Guo, Tiande
    Ding, Man
    APPLIED INTELLIGENCE, 2023, 53 (02) : 2010 - 2025
  • [32] Learning From Crowds Using Graph Neural Networks With Attention Mechanism
    Zhang, Jing
    Wu, Ming
    Sun, Zeyi
    Zhou, Cangqi
    IEEE TRANSACTIONS ON BIG DATA, 2025, 11 (01) : 86 - 98
  • [33] Resource Allocation in Visual Sensor Networks Using a Reinforcement Learning Framework
    Pandremmenou, Katerina
    Tziortziotis, Nikolaos
    Kondi, Lisimachos P.
    Blekas, Konstantinos
    2013 18TH INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2013,
  • [34] Generation of Adversarial Trajectories using Reinforcement Learning to Test Motion Planning Algorithms
    Ransiek, Joshua
    Schutt, Barbara
    Hof, Adrian
    Sax, Eric
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 2819 - 2826
  • [35] Robot Motion Planning Under Uncertain Condition Using Deep Reinforcement Learning
    Chen, Zhuang
    Zhou, Lin
    Guo, Min
    PROCEEDINGS OF THE 2018 INTERNATIONAL CONFERENCE ON MECHANICAL, ELECTRONIC, CONTROL AND AUTOMATION ENGINEERING (MECAE 2018), 2018, 149 : 94 - 100
  • [36] Bimanual Regrasping for Suture Needles using Reinforcement Learning for Rapid Motion Planning
    Chiu, Zih-Yun
    Richter, Florian
    Funk, Emily K.
    Orosco, Ryan K.
    Yip, Michael C.
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 7737 - 7743
  • [37] Continuous Motion Planning for Mobile Robots Using Fuzzy Deep Reinforcement Learning
    Wu, Fenghua
    Tang, Wenbing
    Zhou, Yuan
    Lin, Shang-Wei
    Liu, Yang
    Ding, Zuohua
    2024 WRC SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION, WRC SARA, 2024, : 15 - 21
  • [38] Motion Planning using Reinforcement Learning for Electric Vehicle Battery Optimization(EVBO)
    Soni, Himanshu
    Gupta, Vishu
    Kumar, Rajesh
    2019 INTERNATIONAL CONFERENCE ON POWER ELECTRONICS, CONTROL AND AUTOMATION (ICPECA-2019), 2019, : 11 - 16
  • [39] Planning Swift Maneuvers of Quadcopter Using Motion Primitives Explored by Reinforcement Learning
    Camci, Efe
    Kayacan, Erdal
    2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 279 - 285
  • [40] Deep Reinforcement Learning for Motion Planning of Quadrotors Using Raw Depth Images
    Camci, Efe
    Campolo, Domenico
    Kayacan, Erdal
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,