Extended Q-Learning Algorithm for Path-Planning of a Mobile Robot

被引:0
|
作者
Goswami , Indrani [1 ]
Das, Pradipta Kumar [2 ]
Konar, Amit [1 ]
Janarthanan, R. [3 ]
机构
[1] Jadavpur Univ, ETCE Dept, Kolkata, India
[2] Dhaneswar Rath Inst Engn & Management Studies, Cuttack, Orissa, India
[3] Jaya Engn Coll, Madras, Tamil Nadu, India
来源
关键词
Q-learning; Reinforcement learning; Motion planning;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we study the path planning for Khepera II mobile robot in a grid map environment using an extended Q-learning algorithm. The extension offers an additional benefit of avoiding unnecessary computations involved to update the Q-table. A flag variable is used to keep track of the necessary updating in the entries of the Q-table. The validation of the algorithm is studied through real time execution on Khepera-II platform. An analysis reveals that there is a significant saving in time- and space- complexity of the proposed algorithm with respect to classical Q-learning.
引用
收藏
页码:379 / +
页数:2
相关论文
共 50 条
  • [41] A complete multi-robot path-planning algorithm
    Alotaibi, Ebtehal Turki Saho
    Al-Rawi, Hisham
    [J]. AUTONOMOUS AGENTS AND MULTI-AGENT SYSTEMS, 2018, 32 (05) : 693 - 740
  • [42] Development of a Robust Path-Planning Algorithm Using Virtual Obstacles for an Autonomous Mobile Robot
    Ueno, Kentaro
    Kinoshita, Tetsuo
    Kobayashi, Kazuyuki
    Watanabe, Kajiro
    [J]. JOURNAL OF ROBOTICS AND MECHATRONICS, 2015, 27 (03) : 286 - 292
  • [43] Sampling-based A* algorithm for robot path-planning
    Persson, Sven Mikael
    Sharf, Inna
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2014, 33 (13): : 1683 - 1708
  • [44] Dynamical path-planning algorithm of a mobile robot: Local minima problem and nonstationary environments
    Choi, CK
    Lee, JJ
    [J]. MECHATRONICS, 1996, 6 (01) : 81 - 100
  • [45] A complete multi-robot path-planning algorithm
    Ebtehal Turki Saho Alotaibi
    Hisham Al-Rawi
    [J]. Autonomous Agents and Multi-Agent Systems, 2018, 32 : 693 - 740
  • [46] A novel deep learning driven robot path planning strategy: Q-learning approach
    Hu, Junli
    [J]. INTERNATIONAL JOURNAL OF COMPUTER APPLICATIONS IN TECHNOLOGY, 2023, 71 (03) : 237 - 243
  • [47] An improved Q-learning algorithm for an autonomous mobile robot navigation problem
    Muhammad, Jawad
    Bucak, Ihsan Omur
    [J]. 2013 INTERNATIONAL CONFERENCE ON TECHNOLOGICAL ADVANCES IN ELECTRICAL, ELECTRONICS AND COMPUTER ENGINEERING (TAEECE), 2013, : 239 - 243
  • [48] Path planning of UAV using guided enhancement Q-learning algorithm
    Zhou, Bin
    Guo, Yan
    Li, Ning
    Zhong, Xijian
    [J]. Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2021, 42 (09):
  • [49] Indoor Emergency Path Planning Based on the Q-Learning Optimization Algorithm
    Xu, Shenghua
    Gu, Yang
    Li, Xiaoyan
    Chen, Cai
    Hu, Yingyi
    Sang, Yu
    Jiang, Wenxing
    [J]. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2022, 11 (01)
  • [50] Hybrid Path Planning of A Quadrotor UAV Based on Q-Learning Algorithm
    Zhang, Tianze
    Huo, Xin
    Chen, Songlin
    Yang, Baoqing
    Zhang, Guojiang
    [J]. 2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 5415 - 5419