Human-Like Decision Making and Planning for Autonomous Driving with Reinforcement Learning

被引:0
|
作者
Zong, Ziqi [1 ,2 ,3 ]
Shi, Jiamin [1 ,2 ]
Wang, Runsheng [1 ,2 ]
Chen, Shitao [1 ,2 ,3 ]
Zheng, Nanning [1 ,2 ]
机构
[1] Xi An Jiao Tong Univ, Nation Engn Res Ctr Visual Informat & Applicat, Natl Key Lab Human Machine Hybrid Augmented Intel, Xian 710049, Shaanxi, Peoples R China
[2] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian 710049, Shaanxi, Peoples R China
[3] Shunan Acad Artificial Intelligence, Ningbo, Zhejiang, Peoples R China
基金
国家重点研发计划;
关键词
D O I
10.1109/ITSC57777.2023.10421908
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
One of the main challenges faced by autonomous vehicles operating in mixed traffic scenarios pertains to ensuring safe and efficient navigation, particularly adhering to the implicit rules obeyed by human drivers. In this study, an Adaptive Socially-Compatible Hierarchical Behavior and Motion Planning (ASC-HBMP) framework is proposed to tackle the issue of socially-compatible navigation. ASC-HBMP comprehensively captures the attributes of other traffic participants to guide autonomous vehicles in devising human-like, safe, and efficient trajectories in a socially-compatible manner, striking a balance between safety and efficiency within complex multiscenarios. Hierarchical Behavior and Motion Planning (HBMP) establishes driving tasks as high-level behavioral decision-making processes that emphasize efficiency, as well as low-level motion planning methods that prioritize safety. HBMP accepts the guidance provided by Adaptive Socially-Compatible Module (ASCM) to generate trajectories with diverse driving style characteristics. Finally, cross-platform simulation experiments are conducted on the SUMO and ROS simulators to validate the navigation performance and generalization capability of our approach in comparison to other baseline methods.
引用
收藏
页码:3922 / 3929
页数:8
相关论文
共 50 条
  • [1] Conditional Predictive Behavior Planning With Inverse Reinforcement Learning for Human-Like Autonomous Driving
    Huang, Zhiyu
    Liu, Haochen
    Wu, Jingda
    Lv, Chen
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (07) : 7244 - 7258
  • [2] Human-Like Decision Making for Autonomous Driving With Social Skills
    Zhao, Chenyang
    Chu, Duanfeng
    Deng, Zejian
    Lu, Liping
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (09) : 1 - 16
  • [3] Human-like Decision Making for Autonomous Vehicles at the Intersection Using Inverse Reinforcement Learning
    Wu, Zheng
    Qu, Fangbing
    Yang, Lin
    Gong, Jianwei
    SENSORS, 2022, 22 (12)
  • [4] An open framework for human-like autonomous driving using Inverse Reinforcement Learning
    Vasquez, Dizan
    Yu, Yufeng
    Kumar, Suryansh
    Laugier, Christian
    2014 IEEE VEHICLE POWER AND PROPULSION CONFERENCE (VPPC), 2014,
  • [5] Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approach
    Hang, Peng
    Lv, Chen
    Xing, Yang
    Huang, Chao
    Hu, Zhongxu
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (04) : 2076 - 2087
  • [6] Combining Planning and Deep Reinforcement Learning in Tactical Decision Making for Autonomous Driving
    Hoel, Carl-Johan
    Driggs-Campbell, Katherine
    Wolff, Krister
    Laine, Leo
    Kochenderfer, Mykel J.
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2020, 5 (02): : 294 - 305
  • [7] Autonomous driving planning and decision making based on game theory and reinforcement learning
    Duan, Weiping
    Tang, Zhongyi
    Liu, Wei
    Zhou, Hongbiao
    EXPERT SYSTEMS, 2023, 40 (05)
  • [8] Interaction-Aware Planning With Deep Inverse Reinforcement Learning for Human-Like Autonomous Driving in Merge Scenarios
    Nan, Jiangfeng
    Deng, Weiwen
    Zhang, Ruzheng
    Wang, Ying
    Zhao, Rui
    Ding, Juan
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01): : 2714 - 2726
  • [9] Interaction-Aware Planning with Deep Inverse Reinforcement Learning for Human-Like Autonomous Driving in Merge Scenarios
    Nan, Jiangfeng
    Deng, Weiwen
    Zhang, Ruzheng
    Wang, Ying
    Zhao, Rui
    Ding, Juan
    Zhang, Ruzheng (ruzheng01.zhang@horizon.ai), 1600, Institute of Electrical and Electronics Engineers Inc. (09): : 2714 - 2726
  • [10] Driving Behavior Modeling and Characteristic Learning for Human-like Decision-Making in Highway
    Xu, Can
    Zhao, Wanzhong
    Wang, Chunyan
    Cui, Taowen
    Lv, Chen
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (02): : 1994 - 2005