Effects of a Social Force Model Reward in Robot Navigation Based on Deep Reinforcement Learning

被引:0
|
作者
Gil, Oscar [1 ]
Sanfeliu, Alberto [1 ]
机构
[1] CSIC UPC, Inst Robat & Informat Ind, Barcelona, Spain
关键词
Robot navigation; Deep Reinforcement Learning; Social Force Model; Dense reward function;
D O I
10.1007/978-3-030-36150-1_18
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper is proposed an inclusion of the Social Force Model (SFM) into a concrete Deep Reinforcement Learning (RL) framework for robot navigation. These types of techniques have demonstrated to be useful to deal with different types of environments to achieve a goal. In Deep RL, a description of the world to describe the states and a reward adapted to the environment are crucial elements to get the desire behaviour and achieve a high performance. For this reason, this work adds a dense reward function based on SFM and uses the forces in the states like an additional description. Furthermore, obstacles are added to improve the behaviour of works that only consider moving agents. This SFM inclusion can offer a better description of the obstacles for the navigation. Several simulations have been done to check the effects of these modifications in the average performance.
引用
收藏
页码:213 / 224
页数:12
相关论文
共 50 条
  • [1] Modular deep reinforcement learning from reward and punishment for robot navigation
    Wang, Jiexin
    Elfwing, Stefan
    Uchibe, Eiji
    [J]. NEURAL NETWORKS, 2021, 135 : 115 - 126
  • [2] Robot Navigation in Crowd Based on Dual Social Attention Deep Reinforcement Learning
    Zeng, Hui
    Hu, Rong
    Huang, Xiaohui
    Peng, Zhiying
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
  • [3] Growing Robot Navigation Based on Deep Reinforcement Learning
    Ataka, Ahmad
    Sandiwan, Andreas P.
    [J]. 2023 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS, ICCAR, 2023, : 115 - 120
  • [4] Mobile Robot Navigation based on Deep Reinforcement Learning
    Ruan, Xiaogang
    Ren, Dingqi
    Zhu, Xiaoqing
    Huang, Jing
    [J]. PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 6174 - 6178
  • [5] Deep Reinforcement Learning Based Mobile Robot Navigation: A Review
    Zhu, Kai
    Zhang, Tao
    [J]. TSINGHUA SCIENCE AND TECHNOLOGY, 2021, 26 (05) : 674 - 691
  • [6] Robot Navigation with Interaction-based Deep Reinforcement Learning
    Zhai, Yu
    Miao, Yanzi
    Wang, Hesheng
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE-ROBIO 2021), 2021, : 1974 - 1979
  • [7] Deep Reinforcement Learning Based Mobile Robot Navigation:A Review
    Kai Zhu
    Tao Zhang
    [J]. Tsinghua Science and Technology, 2021, 26 (05) : 674 - 691
  • [8] Deep Reinforcement Learning for Mobile Robot Navigation
    Gromniak, Martin
    Stenzel, Jonas
    [J]. 2019 4TH ASIA-PACIFIC CONFERENCE ON INTELLIGENT ROBOT SYSTEMS (ACIRS 2019), 2019, : 68 - 73
  • [9] Socially aware robot navigation in crowds via deep reinforcement learning with resilient reward functions
    Lu, Xiaojun
    Woo, Hanwool
    Faragasso, Angela
    Yamashita, Atsushi
    Asama, Hajime
    [J]. ADVANCED ROBOTICS, 2022, 36 (08) : 388 - 403
  • [10] Composite Reinforcement Learning for Social Robot Navigation
    Ciou, Pei-Huai
    Hsiao, Yu-Ting
    Wu, Zong-Ze
    Tseng, Shih-Huan
    Fu, Li-Chen
    [J]. 2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 2553 - 2558