Neural networks based reinforcement learning for mobile robots obstacle avoidance

被引:122
|
作者
Duguleana, Mihai [1 ]
Mogan, Gheorghe [1 ]
机构
[1] Univ Transilvania Brasov, Fac Mech Engn, Dept Automot & Transport Engn, Str Univ 1, Brasov 500036, Romania
关键词
Obstacle avoidance; Neural networks; Q-learning; Virtual reality; MOVING OBSTACLES; NAVIGATION; ENVIRONMENTS;
D O I
10.1016/j.eswa.2016.06.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes a new approach for solving the problem of autonomous movement of robots in environments that contain both static and dynamic obstacles. The purpose of this research is to provide mobile robots a collision-free trajectory within an uncertain workspace which contains both stationary and moving entities. The developed solution uses Q-learning and a neural network planner to solve path planning problems. The algorithm presented proves to be effective in navigation scenarios where global information is available. The speed of the robot can be set prior to the computation of the trajectory, which provides a great advantage in time-constrained applications. The solution is deployed in both Virtual Reality (VR) for easier visualization and safer testing activities, and on a real mobile robot for experimental validation. The algorithm is compared with Powerbot's ARNL proprietary navigation algorithm. Results show that the proposed solution has a good conversion rate computed at a satisfying speed. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:104 / 115
页数:12
相关论文
共 50 条
  • [1] A reinforcement learning approach to obstacle avoidance of mobile robots
    Macek, K
    Petrovic, I
    Peric, N
    7TH INTERNATIONAL WORKSHOP ON ADVANCED MOTION CONTROL, PROCEEDINGS, 2002, : 462 - 466
  • [2] Obstacle avoidance of multi mobile robots based on hierarchical reinforcement learning
    Zu, Li-Nan
    Tian, Yan-Tao
    Mei, Hao
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2006, 36 (SUPPL. 2): : 108 - 112
  • [3] Obstacle avoidance of multi mobile robots based on behavior decomposition reinforcement learning
    Zu, Linan
    Yang, Peng
    Chen, Lingling
    Zhang, Xueping
    Tian, Yantao
    2007 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS, VOLS 1-5, 2007, : 1018 - +
  • [4] Obstacle avoidance of redundant manipulators using neural networks based reinforcement learning
    Duguleana, Mihai
    Barbuceanu, Florin Grigore
    Teirelbar, Ahmed
    Mogan, Gheorghe
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2012, 28 (02) : 132 - 146
  • [5] Toward Obstacle Avoidance for Mobile Robots Using Deep Reinforcement Learning Algorithm
    Gao, Xiaoshan
    Yan, Liang
    Wang, Gang
    Wang, Tiantian
    Du, Nannan
    Gerada, Chris
    PROCEEDINGS OF THE 2021 IEEE 16TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2021), 2021, : 2136 - 2139
  • [6] Reinforcement learning neural network to the problem of autonomous mobile robot obstacle avoidance
    Huang, BQ
    Cao, GY
    Guo, M
    PROCEEDINGS OF 2005 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-9, 2005, : 85 - 89
  • [7] Application of Reinforcement Learning Based on Neural Network to Dynamic Obstacle Avoidance
    Qiao, Junfei
    Hou, Zhanjun
    Ruan, Xiaogang
    2008 INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION, VOLS 1-4, 2008, : 784 - 788
  • [8] A Task of Miniature Mobile Robot Learning for Obstacle Avoidance through Neural Networks
    Zhang, Jin Xue
    Pan, Hai Zhu
    NEW TRENDS IN MECHATRONICS AND MATERIALS ENGINEERING, 2012, 151 : 498 - +
  • [9] Obstacle avoidance for mobile robots based on relative coordinates
    Zhang, F
    Tan, DL
    Wei, YZ
    2003 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS, INTELLIGENT SYSTEMS AND SIGNAL PROCESSING, VOLS 1 AND 2, PROCEEDINGS, 2003, : 616 - 621
  • [10] Obstacle avoidance control for mobile robots based on vision
    Nara, Shunsuke
    Takahashi, Satoru
    2006 SICE-ICASE INTERNATIONAL JOINT CONFERENCE, VOLS 1-13, 2006, : 3470 - +