A Behavior-Based Mobile Robot Navigation Method with Deep Reinforcement Learning

被引:17
|
作者
Li, Juncheng [1 ]
Ran, Maopeng [1 ]
Wang, Han [1 ]
Xie, Lihua [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
关键词
Autonomous navigation; mobile robots; deep reinforcement learning;
D O I
10.1142/S2301385021410041
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep reinforcement learning-based mobile robot navigation has attracted some recent interest. In the single-agent case, a robot can learn to navigate autonomously without a map of the environment. In the multi-agent case, robots can learn to avoid collisions with each other. In this work, we propose a behavior-based mobile robot navigation method which directly maps the raw sensor data and goal information to the control command. The learned navigation policy can be applied in both single-agent and multi-agent scenarios. Two basic navigation behaviors are considered in our method, which are goal reaching and collision avoidance. The two behaviors are fused based on the risk-level estimation of the current state. The navigation task is decomposed using the behavior-based framework, which is capable of reducing the complexity of the learning process. The simulations and real-world experiments demonstrate that the proposed method can enable the collision-free autonomous navigation of multiple mobile robots in unknown environments.
引用
下载
收藏
页码:201 / 209
页数:9
相关论文
共 50 条
  • [21] Reinforcement learning based on backpropagation for mobile robot navigation
    Jaksa, R
    Majerník, P
    Sincák, P
    COMPUTATIONAL INTELLIGENCE FOR MODELLING, CONTROL & AUTOMATION - NEURAL NETWORKS & ADVANCED CONTROL STRATEGIES, 1999, 54 : 46 - 51
  • [22] Reinforcement Learning Based Approach For Mobile Robot Navigation
    Jaseem, Mohammed M.
    Mathew, Robins
    Hiremath, Somashekhar S.
    PROCEEDINGS OF 2019 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND KNOWLEDGE ECONOMY (ICCIKE' 2019), 2019, : 524 - 527
  • [23] Reinforcement learning-based mobile robot navigation
    Altuntas, Nihal
    Imal, Erkan
    Emanet, Nahit
    Ozturk, Ceyda Nur
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2016, 24 (03) : 1747 - 1767
  • [24] Behavior-based neuro-fuzzy controller for mobile robot navigation
    Rusu, P
    Petriu, EM
    Whalen, TE
    Cornell, A
    Spoelder, HJW
    IMTC 2002: PROCEEDINGS OF THE 19TH IEEE INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE, VOLS 1 & 2, 2002, : 1617 - 1622
  • [25] Behavior-based neuro-fuzzy controller for mobile robot navigation
    Rusu, P
    Petriu, EM
    Whalen, TE
    Cornell, A
    Spoelder, HJW
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2003, 52 (04) : 1335 - 1340
  • [26] Indoor Mobile Robot Path Planning and Navigation System Based on Deep Reinforcement Learning
    Pai, Neng-Sheng
    Tsai, Xiang-Yan
    Chen, Pi-Yun
    Lin, Hsu -Yung
    SENSORS AND MATERIALS, 2024, 36 (05) : 1959 - 1982
  • [27] Growing Robot Navigation Based on Deep Reinforcement Learning
    Ataka, Ahmad
    Sandiwan, Andreas P.
    2023 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS, ICCAR, 2023, : 115 - 120
  • [28] Deep Reinforcement Learning of Map-Based Obstacle Avoidance for Mobile Robot Navigation
    Chen G.
    Pan L.
    Chen Y.
    Xu P.
    Wang Z.
    Wu P.
    Ji J.
    Chen X.
    SN Computer Science, 2021, 2 (6)
  • [29] A Fuzzy Behavior-Based Architecture for Mobile Robot Navigation in Unknown Environments
    Bao Qing-yong
    Li Shun-ming
    Shang Wei-yan
    An Mu-jin
    2009 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTATIONAL INTELLIGENCE, VOL II, PROCEEDINGS, 2009, : 257 - +
  • [30] Experimental Research on Deep Reinforcement Learning in Autonomous navigation of Mobile Robot
    Yue, Pengyu
    Xin, Jing
    Zhao, Huan
    Liu, Ding
    Shan, Mao
    Zhang, Jian
    PROCEEDINGS OF THE 2019 14TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2019), 2019, : 1612 - 1616