A novel mobile robot navigation method based on deep reinforcement learning

被引:32
|
作者
Quan, Hao [1 ,2 ]
Li, Yansheng [1 ,2 ]
Zhang, Yi [1 ,2 ]
机构
[1] Chongqing Univ Posts & Telecommun, Res Ctr Intelligent Syst & Robot, Chongqing 400065, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Sch Adv Mfg Engn, Chongqing, Peoples R China
来源
INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS | 2020年 / 17卷 / 03期
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; robot exploration; recurrent neural network; DDQN;
D O I
10.1177/1729881420921672
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
At present, the application of mobile robots is more and more extensive, and the movement of mobile robots cannot be separated from effective navigation, especially path exploration. Aiming at navigation problems, this article proposes a method based on deep reinforcement learning and recurrent neural network, which combines double net and recurrent neural network modules with reinforcement learning ideas. At the same time, this article designed the corresponding parameter function to improve the performance of the model. In order to test the effectiveness of this method, based on the grid map model, this paper trains in a two-dimensional simulation environment, a three-dimensional TurtleBot simulation environment, and a physical robot environment, and obtains relevant data for peer-to-peer analysis. The experimental results show that the proposed algorithm has a good improvement in path finding efficiency and path length.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Mobile robot navigation control based on hierarchical reinforcement learning
    Department of Automation, University of Science and Technology of China, Hefei 230027, China
    Nanjing Hangkong Hangtian Daxue Xuebao, 2006, 1 (70-75):
  • [22] Autonomous Mobile Robot with Simple Navigation System Based on Deep Reinforcement Learning and a Monocular Camera
    Yokoyama, Koki
    Morioka, Kazuyuki
    2020 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION (SII), 2020, : 525 - 530
  • [23] Mobile Robot Path Planning Method Based on Deep Reinforcement Learning Algorithm
    Meng, Haitao
    Zhang, Hengrui
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2022, 31 (15)
  • [24] Robot Navigation with Interaction-based Deep Reinforcement Learning
    Zhai, Yu
    Miao, Yanzi
    Wang, Hesheng
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE-ROBIO 2021), 2021, : 1974 - 1979
  • [25] Asynchronous Deep Reinforcement Learning for the Mobile Robot Navigation with Supervised Auxiliary Tasks
    Tongloy, T.
    Chuwongin, S.
    Jaksukam, K.
    Chousangsuntorn, C.
    Boonsang, S.
    2017 2ND INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION ENGINEERING (ICRAE), 2017, : 68 - 72
  • [26] Mapless navigation based on deep reinforcement learning for mobile robots
    Hu G.-M.
    Cai K.-W.
    Wang F.
    Kang Y.-W.
    Zhang J.-X.
    Jin Z.
    Lin Y.-S.
    Kongzhi yu Juece/Control and Decision, 2024, 39 (03): : 985 - 993
  • [27] Research on Target-Driven Navigation of Mobile Robot Based on Deep Reinforcement Learning and Preprocessing Layer
    Yu, Gang
    Zhang, Chang
    Xu, Jiexiong
    Sun, Tongda
    5TH ANNUAL INTERNATIONAL CONFERENCE ON INFORMATION SYSTEM AND ARTIFICIAL INTELLIGENCE (ISAI2020), 2020, 1575
  • [28] Deep Reinforcement Learning-Based Mapless Navigation for Mobile Robot in Unknown Environment With Local Optima
    Hu, Yiming
    Wang, Shuting
    Xie, Yuanlong
    Zheng, Shiqi
    Shi, Peng
    Rudas, Imre
    Cheng, Xiang
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (01): : 628 - 635
  • [29] A Deep Reinforcement Learning Method for Mobile Robot Collision Avoidance based on Double DQN
    Xue, Xidi
    Li, Zhan
    Zhang, Dongsheng
    Yan, Yingxin
    2019 IEEE 28TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2019, : 2131 - 2136
  • [30] Tracking control for mobile robot based on deep reinforcement learning
    Zhang Shansi
    Wang Weiming
    2019 2ND INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS 2019), 2019, : 155 - 160