Navigation in Urban Environments amongst pedestrians using Multi-Objective Deep Reinforcement Learning

被引:4
|
作者
Deshpande, Niranjan [1 ]
Vaufreydaz, Dominique [2 ]
Spalanzani, Anne [1 ]
机构
[1] Univ Grenoble Alpes, INRIA, F-38000 Grenoble, France
[2] Univ Grenoble Alpes, LIG, Grenoble INP, CNRS,INRIA, F-38000 Grenoble, France
关键词
D O I
10.1109/ITSC48978.2021.9564601
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Urban autonomous driving in the presence of pedestrians as vulnerable road users is still a challenging and less examined research problem. This work formulates navigation in urban environments as a multi objective reinforcement learning problem. A deep learning variant of thresholded lexicographic Q-learning is presented for autonomous navigation amongst pedestrians. The multi objective DQN agent is trained on a custom urban environment developed in CARLA simulator. The proposed method is evaluated by comparing it with a single objective DQN variant on known and unknown environments. Evaluation results show that the proposed method outperforms the single objective DQN variant with respect to all aspects.
引用
收藏
页码:923 / 928
页数:6
相关论文
共 50 条
  • [1] Urban Driving with Multi-Objective Deep Reinforcement Learning
    Li, Changjian
    Czarnecki, Krzysztof
    [J]. AAMAS '19: PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2019, : 359 - 367
  • [2] Multi-Objective Reinforcement Learning for Autonomous Drone Navigation in Urban Area
    Wu, Jiahao
    Ye, Yang
    Du, Jing
    [J]. CONSTRUCTION RESEARCH CONGRESS 2024: ADVANCED TECHNOLOGIES, AUTOMATION, AND COMPUTER APPLICATIONS IN CONSTRUCTION, 2024, : 707 - 716
  • [3] A Multi-Objective Reinforcement Learning Based Controller for Autonomous Navigation in Challenging Environments
    Dooraki, Amir Ramezani
    Lee, Deok-Jin
    [J]. MACHINES, 2022, 10 (07)
  • [4] Multi-objective crowd-aware robot navigation system using deep reinforcement learning
    Cheng, Chien-Lun
    Hsu, Chen-Chien
    Saeedvand, Saeed
    Jo, Jun-Hyung
    [J]. APPLIED SOFT COMPUTING, 2024, 151
  • [5] Evolutionary Multi-Objective Deep Reinforcement Learning for Autonomous UAV Navigation in Large-Scale Complex Environments
    An, Guangyan
    Wu, Ziyu
    Shen, Zhilong
    Shang, Ke
    Ishibuchi, Hisao
    [J]. PROCEEDINGS OF THE 2023 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, GECCO 2023, 2023, : 633 - 641
  • [6] A multi-objective deep reinforcement learning framework
    Thanh Thi Nguyen
    Ngoc Duy Nguyen
    Vamplew, Peter
    Nahavandi, Saeid
    Dazeley, Richard
    Lim, Chee Peng
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2020, 96
  • [7] Multi-objective reinforcement learning for autonomous drone navigation in urban areas with wind zones
    Wu, Jiahao
    Ye, Yang
    Du, Jing
    [J]. AUTOMATION IN CONSTRUCTION, 2024, 158
  • [8] Multi-Objective Reinforcement Learning for Designing Ethical Environments
    Rodriguez-Soto, Manel
    Lopez-Sanchez, Maite
    Rodriguez-Aguilar, Juan A.
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 545 - 551
  • [9] Multi-condition multi-objective optimization using deep reinforcement learning
    Kim, Sejin
    Kim, Innyoung
    You, Donghyun
    [J]. JOURNAL OF COMPUTATIONAL PHYSICS, 2022, 462
  • [10] Deep Reinforcement Learning based Vehicle Navigation amongst pedestrians using a Grid-based state representation
    Deshpande, Niranjan
    Spalanzani, Anne
    [J]. 2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 2081 - 2086