Path planning for a statically stable biped robot using PRM and reinforcement learning

被引:12
|
作者
Kulkarni, Prasad
Goswami, Dip
Guha, Prithwijit
Dutta, Ashish
机构
[1] Nagoya Univ, Dept Engn Sci & Mech, Chikusa Ku, Nagoya, Aichi, Japan
[2] Tata Motors, Tata Motors Res Div, Pune, Maharashtra, India
[3] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 117576, Singapore
[4] Indian Inst Technol, Dept Elect Engn, Kanpur 208016, Uttar Pradesh, India
[5] Indian Inst Technol, Dept Mech Engn, Kanpur 208016, Uttar Pradesh, India
关键词
potential function; PRM; reinforcement learning; statically stable biped robot;
D O I
10.1007/s10846-006-9071-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper path planning and obstacle avoidance for a statically stable biped robot using PRM and reinforcement learning is discussed. The main objective of the paper is to compare these two methods of path planning for applications involving a biped robot. The statically stable biped robot under consideration is a 4-degree of freedom walking robot that can follow any given trajectory on flat ground and has a fixed step length of 200 mm. It is proved that the path generated by the first method produces the shortest smooth path but it also increases the computational burden on the controller, as the robot has to turn at almost all steps. However the second method produces paths that are composed of straight-line segments and hence requires less computation for trajectory following. Experiments were also conducted to prove the effectiveness of the reinforcement learning based path planning method.
引用
收藏
页码:197 / 214
页数:18
相关论文
共 50 条
  • [31] Improved Robot Path Planning Method Based on Deep Reinforcement Learning
    Han, Huiyan
    Wang, Jiaqi
    Kuang, Liqun
    Han, Xie
    Xue, Hongxin
    [J]. SENSORS, 2023, 23 (12)
  • [32] A Review of Deep Reinforcement Learning Algorithms for Mobile Robot Path Planning
    Singh, Ramanjeet
    Ren, Jing
    Lin, Xianke
    [J]. VEHICLES, 2023, 5 (04): : 1423 - 1451
  • [33] The Intelligent Path Planning System of Agricultural Robot via Reinforcement Learning
    Yang, Jiachen
    Ni, Jingfei
    Li, Yang
    Wen, Jiabao
    Chen, Desheng
    [J]. SENSORS, 2022, 22 (12)
  • [34] Reinforcement learning with modified exploration strategy for mobile robot path planning
    Khlif, Nesrine
    Nahla, Khraief
    Safya, Belghith
    [J]. ROBOTICA, 2023, 41 (09) : 2688 - 2702
  • [35] Path planning for mobile robot based on improved reinforcement learning algorithm
    Xu X.
    Yuan J.
    [J]. Zhongguo Guanxing Jishu Xuebao/Journal of Chinese Inertial Technology, 2019, 27 (03): : 314 - 320
  • [36] A case-based reinforcement learning for probe robot path planning
    Yang, L
    Chen, ZH
    Chen, F
    [J]. PROCEEDINGS OF THE 4TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-4, 2002, : 1161 - 1165
  • [37] The Path Planning of Mobile Robot by Neural Networks and Hierarchical Reinforcement Learning
    Yu, Jinglun
    Su, Yuancheng
    Liao, Yifan
    [J]. FRONTIERS IN NEUROROBOTICS, 2020, 14
  • [38] Research on path planning algorithm of mobile robot based on reinforcement learning
    Pan, Guoqian
    Xiang, Yong
    Wang, Xiaorui
    Yu, Zhongquan
    Zhou, Xinzhi
    [J]. SOFT COMPUTING, 2022, 26 (18) : 8961 - 8970
  • [39] Path planning for a robot manipulator based on probabilistic roadmap and reinforcement learning
    Department of Mechanical Engineering, Korea University, Anam-dong, Seongbuk-gu, Seoul 136-713, Korea, Republic of
    [J]. Int. J. Control Autom. Syst., 2007, 6 (674-680):
  • [40] Reinforcement learning for a biped robot to climb sloping surfaces
    Salatian, AW
    Yi, KY
    Zheng, YF
    [J]. JOURNAL OF ROBOTIC SYSTEMS, 1997, 14 (04): : 283 - 296