Deep Deterministic Policy Gradient for Navigation of Mobile Robots

被引:7
|
作者
de Jesus, Junior Costa [1 ]
Bottega, Jair Augusto [2 ]
de Souza Leite Cuadros, Marco Antonio [3 ]
Tello Gamarra, Daniel Fernando [4 ]
机构
[1] Fed Univ Rio Grande, Rio Grande, RS, Brazil
[2] Univ Fed Santa Maria, Santa Maria, RS, Brazil
[3] Fed Inst Espirito Santo, Serra, ES, Brazil
[4] Univ Fed Santa Maria, Proc Dept Elect, Santa Maria, RS, Brazil
关键词
Deep Deterministic Policy Gradient; Deep Reinforcement Learning; Navigation for Mobile Robots;
D O I
10.3233/JIFS-191711
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article describes the use of the Deep Deterministic Policy Gradient network, a deep reinforcement learning algorithm, for mobile robot navigation. The neural network structure has as inputs laser range findings, angular and linear velocities of the robot, and position and orientation of the mobile robot with respect to a goal position. The outputs of the network will be the angular and linear velocities used as control signals for the robot. The experiments demonstrated that deep reinforcement learning's techniques that uses continuous actions, are efficient for decision-making in a mobile robot. Nevertheless, the design of the reward functions constitutes an important issue in the performance of deep reinforcement learning algorithms. In order to show the performance of the Deep Reinforcement Learning algorithm, we have applied successfully the proposed architecture in simulated environments and in experiments with a real robot.
引用
收藏
页码:349 / 361
页数:13
相关论文
共 50 条
  • [1] Deep Deterministic Policy Gradient for Navigation of Mobile Robots in Simulated Environments
    Jesus, Junior C.
    Bottega, Jair A.
    Cuadros, Marco A. S. L.
    Gamarra, Daniel F. T.
    2019 19TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR), 2019, : 362 - 367
  • [2] Deep Deterministic Policy Gradient-Based Autonomous Driving for Mobile Robots in Sparse Reward Environments
    Park, Minjae
    Lee, Seok Young
    Hong, Jin Seok
    Kwon, Nam Kyu
    SENSORS, 2022, 22 (24)
  • [3] Deep deterministic policy gradient with constraints for gait optimisation of biped robots
    Liu, Xingyang
    Rong, Haina
    Neri, Ferrante
    Yue, Peng
    Zhang, Gexiang
    INTEGRATED COMPUTER-AIDED ENGINEERING, 2024, 31 (02) : 139 - 156
  • [4] Robot arm navigation using deep deterministic policy gradient algorithms
    Farag, Wael
    JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 2023, 35 (05) : 617 - 627
  • [5] Local Path Planning with Turnabouts for Mobile Robot by Deep Deterministic Policy Gradient
    Nakamura, Tomoaki
    Kobayashi, Masato
    Motoi, Naoki
    2023 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS, ICM, 2023,
  • [6] Improved Deep Deterministic Policy Gradient for Dynamic Obstacle Avoidance of Mobile Robot
    Gao, Xiaoshan
    Yan, Liang
    Li, Zhijun
    Wang, Gang
    Chen, I-Ming
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (06): : 3675 - 3682
  • [7] Reinforcement Learning for Mobile Robot Obstacle Avoidance with Deep Deterministic Policy Gradient
    Chen, Miao
    Li, Wenna
    Fei, Shihan
    Wei, Yufei
    Tu, Mingyang
    Li, Jiangbo
    INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2022), PT III, 2022, 13457 : 197 - 204
  • [8] Efficient Path Planning for Mobile Robot Based on Deep Deterministic Policy Gradient
    Gong, Hui
    Wang, Peng
    Ni, Cui
    Cheng, Nuo
    SENSORS, 2022, 22 (09)
  • [9] Autonomous Driving of Mobile Robots in Dynamic Environments Based on Deep Deterministic Policy Gradient: Reward Shaping and Hindsight Experience Replay
    Park, Minjae
    Park, Chaneun
    Kwon, Nam Kyu
    BIOMIMETICS, 2024, 9 (01)
  • [10] Stability Analysis for Autonomous Vehicle Navigation Trained over Deep Deterministic Policy Gradient
    Cabezas-Olivenza, Mireya
    Zulueta, Ekaitz
    Sanchez-Chica, Ander
    Fernandez-Gamiz, Unai
    Teso-Fz-Betono, Adrian
    MATHEMATICS, 2023, 11 (01)