Extended Q-Learning Algorithm for Path-Planning of a Mobile Robot

被引:0
|
作者
Goswami , Indrani [1 ]
Das, Pradipta Kumar [2 ]
Konar, Amit [1 ]
Janarthanan, R. [3 ]
机构
[1] Jadavpur Univ, ETCE Dept, Kolkata, India
[2] Dhaneswar Rath Inst Engn & Management Studies, Cuttack, Orissa, India
[3] Jaya Engn Coll, Madras, Tamil Nadu, India
来源
关键词
Q-learning; Reinforcement learning; Motion planning;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we study the path planning for Khepera II mobile robot in a grid map environment using an extended Q-learning algorithm. The extension offers an additional benefit of avoiding unnecessary computations involved to update the Q-table. A flag variable is used to keep track of the necessary updating in the entries of the Q-table. The validation of the algorithm is studied through real time execution on Khepera-II platform. An analysis reveals that there is a significant saving in time- and space- complexity of the proposed algorithm with respect to classical Q-learning.
引用
收藏
页码:379 / +
页数:2
相关论文
共 50 条
  • [21] Neural Q-learning in Motion Planning for Mobile Robot
    Qin, Zheng
    Gu, Jason
    [J]. 2009 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND LOGISTICS ( ICAL 2009), VOLS 1-3, 2009, : 1024 - 1028
  • [22] Modified Q-learning with distance metric and virtual target on path planning of mobile robot
    Low, Ee Soong
    Ong, Pauline
    Low, Cheng Yee
    Omar, Rosli
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 199
  • [23] Path planning of a mobile robot in a free-space environment using Q-learning
    Jiang, Jianxun
    Xin, Jianbin
    [J]. PROGRESS IN ARTIFICIAL INTELLIGENCE, 2019, 8 (01) : 133 - 142
  • [24] Path planning of a mobile robot in a free-space environment using Q-learning
    Jianxun Jiang
    Jianbin Xin
    [J]. Progress in Artificial Intelligence, 2019, 8 : 133 - 142
  • [25] Application of artificial neural network based on Q-learning for mobile robot path planning
    Li, Caihong
    Zhang, Jingyuan
    Li, Yibin
    [J]. 2006 IEEE INTERNATIONAL CONFERENCE ON INFORMATION ACQUISITION, VOLS 1 AND 2, CONFERENCE PROCEEDINGS, 2006, : 978 - 982
  • [26] A new path-planning algorithm for mobile robot based on neural network
    Zhu, YJ
    Chang, J
    Wang, SG
    [J]. 2002 IEEE REGION 10 CONFERENCE ON COMPUTERS, COMMUNICATIONS, CONTROL AND POWER ENGINEERING, VOLS I-III, PROCEEDINGS, 2002, : 1570 - 1573
  • [27] The Experience-Memory Q-Learning Algorithm for Robot Path Planning in Unknown Environment
    Zhao, Meng
    Lu, Hui
    Yang, Siyi
    Guo, Fengjuan
    [J]. IEEE ACCESS, 2020, 8 : 47824 - 47844
  • [28] A modified Q-learning algorithm for robot path planning in a digital twin assembly system
    Guo, Xiaowei
    Peng, Gongzhuang
    Meng, Yingying
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2022, 119 (5-6): : 3951 - 3961
  • [29] A modified Q-learning algorithm for robot path planning in a digital twin assembly system
    Xiaowei Guo
    Gongzhuang Peng
    Yingying Meng
    [J]. The International Journal of Advanced Manufacturing Technology, 2022, 119 : 3951 - 3961
  • [30] Predator-Prey Reward Based Q-Learning Coverage Path Planning for Mobile Robot
    Zhang, Meiyan
    Cai, Wenyu
    Pang, Lingfeng
    [J]. IEEE ACCESS, 2023, 11 : 29673 - 29683