Incremental Learning for Autonomous Navigation of Mobile Robots based on Deep Reinforcement Learning

被引:30
|
作者
Manh Luong [1 ]
Cuong Pham [2 ]
机构
[1] VinAI Res, Hanoi, Vietnam
[2] Posts & Telecommun Inst Technol, Fac Informat Technol 1, Hanoi, Vietnam
关键词
Robot navigation; Reinforcement learning; Autonomous robot;
D O I
10.1007/s10846-020-01262-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents an incremental learning method and system for autonomous robot navigation. The range finder laser sensor and online deep reinforcement learning are utilized for generating the navigation policy, which is effective for avoiding obstacles along the robot's trajectories as well as for robot's reaching the destination. An empirical experiment is conducted under simulation and real-world settings. Under the simulation environment, the results show that the proposed method can generate a highly effective navigation policy (more than 90% accuracy) after only 150k training iterations. Moreover, our system has slightly outperformed deep-Q, while having considerably surpassed Proximal Policy Optimization, two recent state-of-the art robot navigation systems. Finally, two experiments are performed to demonstrate the feasibility and effectiveness of our robot's proposed navigation system in real-time under real-world settings.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Incremental Learning for Autonomous Navigation of Mobile Robots based on Deep Reinforcement Learning
    Manh Luong
    Cuong Pham
    [J]. Journal of Intelligent & Robotic Systems, 2021, 101
  • [2] Reinforcement Learning based Method for Autonomous Navigation of Mobile Robots in Unknown Environments
    Roan Van Hoa
    Tran Duc Chuyen
    Nguyen Tung Lam
    Tran Ngoc Son
    Nguyen Duc Dien
    Vu Thi To Linh
    [J]. 2020 INTERNATIONAL CONFERENCE ON ADVANCED MECHATRONIC SYSTEMS (ICAMECHS), 2020, : 266 - 269
  • [3] Mapless Navigation for Autonomous Robots: A Deep Reinforcement Learning Approach
    Zhang, Pengpeng
    Wei, Changyun
    Cai, Boliang
    Ouyang, Yongping
    [J]. 2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 3141 - 3146
  • [4] Deep Reinforcement Learning For Visual Navigation of Wheeled Mobile Robots
    Nwaonumah, Ezebuugo
    Samanta, Biswanath
    [J]. IEEE SOUTHEASTCON 2020, 2020,
  • [5] Path Following for Autonomous Mobile Robots with Deep Reinforcement Learning
    Cao, Yu
    Ni, Kan
    Kawaguchi, Takahiro
    Hashimoto, Seiji
    [J]. SENSORS, 2024, 24 (02)
  • [6] An active pursuit strategy for autonomous mobile robots based on deep reinforcement learning
    Gao, Yingnan
    Cheng, Lei
    He, Yu
    Wang, Duanchu
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON CYBORG AND BIONIC SYSTEMS, CBS, 2022, : 326 - 331
  • [7] Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning
    Ou, Yang
    Cai, Yiyi
    Sun, Youming
    Qin, Tuanfa
    [J]. SENSORS, 2024, 24 (12)
  • [8] Learning Navigation Policies for Mobile Robots in Deep Reinforcement Learning with Random Network Distillation
    Pan, Lifan
    Li, Anyi
    Ma, Jun
    Ji, Jianmin
    [J]. 2021 5TH INTERNATIONAL CONFERENCE ON INNOVATION IN ARTIFICIAL INTELLIGENCE (ICIAI 2021), 2021, : 151 - 157
  • [9] Deep-Reinforcement-Learning-Based Semantic Navigation of Mobile Robots in Dynamic Environments
    Kaestner, Linh
    Marx, Cornelius
    Lambrecht, Jens
    [J]. 2020 IEEE 16TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2020, : 1110 - 1115
  • [10] A safe reinforcement learning approach for autonomous navigation of mobile robots in dynamic environments
    Zhou, Zhiqian
    Ren, Junkai
    Zeng, Zhiwen
    Xiao, Junhao
    Zhang, Xinglong
    Guo, Xian
    Zhou, Zongtan
    Lu, Huimin
    [J]. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2023,