Incremental Learning for Autonomous Navigation of Mobile Robots based on Deep Reinforcement Learning

被引:30
|
作者
Manh Luong [1 ]
Cuong Pham [2 ]
机构
[1] VinAI Res, Hanoi, Vietnam
[2] Posts & Telecommun Inst Technol, Fac Informat Technol 1, Hanoi, Vietnam
关键词
Robot navigation; Reinforcement learning; Autonomous robot;
D O I
10.1007/s10846-020-01262-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents an incremental learning method and system for autonomous robot navigation. The range finder laser sensor and online deep reinforcement learning are utilized for generating the navigation policy, which is effective for avoiding obstacles along the robot's trajectories as well as for robot's reaching the destination. An empirical experiment is conducted under simulation and real-world settings. Under the simulation environment, the results show that the proposed method can generate a highly effective navigation policy (more than 90% accuracy) after only 150k training iterations. Moreover, our system has slightly outperformed deep-Q, while having considerably surpassed Proximal Policy Optimization, two recent state-of-the art robot navigation systems. Finally, two experiments are performed to demonstrate the feasibility and effectiveness of our robot's proposed navigation system in real-time under real-world settings.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] GREY SYSTEM BASED REACTIVE NAVIGATION OF MOBILE ROBOTS USING REINFORCEMENT LEARNING
    Chen, Chunlin
    Dong, Daoyi
    [J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2010, 6 (02): : 789 - 800
  • [32] Navigation method for mobile robot based on hierarchical deep reinforcement learning
    Wang, Tong
    Li, Ao
    Song, Hai-Luo
    Liu, Wei
    Wang, Ming-Hui
    [J]. Kongzhi yu Juece/Control and Decision, 2022, 37 (11): : 2799 - 2807
  • [33] Deep Reinforcement Learning Based Mobile Robot Navigation in Crowd Environments
    Yang, Guang
    Guo, Yi
    [J]. 2024 21ST INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS, UR 2024, 2024, : 513 - 519
  • [34] A novel mobile robot navigation method based on deep reinforcement learning
    Quan, Hao
    Li, Yansheng
    Zhang, Yi
    [J]. INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (03):
  • [35] Deep reinforcement learning for motion planning of mobile robots
    Sun, Hui-Hui
    Hu, Chun-He
    Zhang, Jun-Guo
    [J]. Kongzhi yu Juece/Control and Decision, 2021, 36 (06): : 1281 - 1292
  • [36] Fuzzy situation based navigation of autonomous mobile robot using reinforcement learning
    Guanlao, R
    Musilek, P
    Ahmed, F
    Kaboli, A
    [J]. NAFIPS 2004: ANNUAL MEETING OF THE NORTH AMERICAN FUZZY INFORMATION PROCESSING SOCIETY, VOLS 1AND 2: FUZZY SETS IN THE HEART OF THE CANADIAN ROCKIES, 2004, : 820 - 825
  • [37] Deep reinforcement learning for shared control of mobile robots
    Tian, Chong
    Shaik, Shahil
    Wang, Yue
    [J]. IET CYBER-SYSTEMS AND ROBOTICS, 2021, 3 (04) : 315 - 330
  • [38] Deterministic and Stochastic Analysis of Deep Reinforcement Learning for Low Dimensional Sensing-based Navigation of Mobile Robots
    Grando, Ricardo B.
    de Jesus, Junior C.
    Kich, Victor A.
    Kolling, Alisson H.
    Pinheiro, Pedro M.
    Guerra, Rodrigo S.
    Drews-Jr, Paulo L. J.
    [J]. 2022 LATIN AMERICAN ROBOTICS SYMPOSIUM (LARS), 2022 BRAZILIAN SYMPOSIUM ON ROBOTICS (SBR), AND 2022 WORKSHOP ON ROBOTICS IN EDUCATION (WRE), 2022, : 193 - 198
  • [39] Mobile Robot Navigation Using Deep Reinforcement Learning
    Lee, Min-Fan Ricky
    Yusuf, Sharfiden Hassen
    [J]. PROCESSES, 2022, 10 (12)
  • [40] Virtual-to-real Deep Reinforcement Learning: Continuous Control of Mobile Robots for Mapless Navigation
    Tai, Lei
    Paolo, Giuseppe
    Liu, Ming
    [J]. 2017 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2017, : 31 - 36