Robot Obstacle Avoidance Controller Based on Deep Reinforcement Learning

被引:0
|
作者
Tang, Yaokun [1 ]
Chen, Qingyu [2 ]
Wei, Yuxin [1 ]
机构
[1] Anhui Univ Technol, Anhui Engn Lab Intelligent Applicat & Secur Ind In, Maanshan 243032, Anhui, Peoples R China
[2] Anhui Univ Technol, Inst Intelligent Informat Proc, Sch Comp Sci & Technol, Maanshan 243032, Anhui, Peoples R China
关键词
D O I
10.1155/2022/4194747
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As the core technology in the field of mobile robots, the development of robot obstacle avoidance technology substantially enhances the running stability of robots. Built on path planning or guidance, most existing obstacle avoidance methods underperform with low efficiency in complicated and unpredictable environments. In this paper, we propose an obstacle avoidance method with a hierarchical controller based on deep reinforcement learning, which can realize more efficient adaptive obstacle avoidance without path planning. The controller, with multiple neural networks, contains an action selector and an action runner consisting of two neural network strategies and two single actions. Action selectors and each neural network strategy are separately trained in a simulation environment before being deployed on a robot. We validated the method on wheeled robots. More than 200 tests yield a success rate of up to 90%.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Robot obstacle avoidance system using deep reinforcement learning
    Zhu, Xiaojun
    Liang, Yinghao
    Sun, Hanxu
    Wang, Xueqian
    Ren, Bin
    [J]. INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2022, 49 (02): : 301 - 310
  • [2] MOBILE ROBOT OBSTACLE AVOIDANCE BASE ON DEEP REINFORCEMENT LEARNING
    Feng, Shumin
    Ren, Hailin
    Wang, Xinran
    Ben-Tzvi, Pinhas
    [J]. PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2019, VOL 5A, 2020,
  • [3] Obstacle Avoidance Algorithm for Mobile Robot Based on Deep Reinforcement Learning in Dynamic Environments
    Sun Xiaoxian
    Yao Chenpeng
    Zhou Haoran
    Liu Chengju
    Chen Qijun
    [J]. 2020 IEEE 16TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION (ICCA), 2020, : 366 - 372
  • [4] Deep Reinforcement Learning of Map-Based Obstacle Avoidance for Mobile Robot Navigation
    Chen G.
    Pan L.
    Chen Y.
    Xu P.
    Wang Z.
    Wu P.
    Ji J.
    Chen X.
    [J]. SN Computer Science, 2021, 2 (6)
  • [5] Obstacle Avoidance Planning of Virtual Robot Picking Path Based on Deep Reinforcement Learning
    Xiong, Juntao
    Li, Zhonghang
    Chen, Shumian
    Zheng, Zhenhui
    [J]. Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2020, 51 : 1 - 10
  • [6] Towards Dynamic Obstacle Avoidance for Robot Manipulators with Deep Reinforcement Learning
    Zindler, Friedemann
    Lucchi, Matteo
    Wohlhart, Lucas
    Pichler, Horst
    Hofbaur, Michael
    [J]. ADVANCES IN SERVICE AND INDUSTRIAL ROBOTICS, RAAD 2022, 2022, 120 : 89 - 96
  • [7] AUV Obstacle Avoidance Planning Based on Deep Reinforcement Learning
    Yuan, Jianya
    Wang, Hongjian
    Zhang, Honghan
    Lin, Changjian
    Yu, Dan
    Li, Chengfeng
    [J]. JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2021, 9 (11)
  • [8] Shared Control of Robot Manipulators With Obstacle Avoidance: A Deep Reinforcement Learning Approach
    Rubagotti, Matteo
    Sangiovanni, Bianca
    Nurbayeva, Aigerim
    Incremona, Gian Paolo
    Ferrara, Antonella
    Shintemirov, Almas
    [J]. IEEE CONTROL SYSTEMS MAGAZINE, 2023, 43 (01): : 44 - 63
  • [9] Reinforcement Learning for Mobile Robot Obstacle Avoidance with Deep Deterministic Policy Gradient
    Chen, Miao
    Li, Wenna
    Fei, Shihan
    Wei, Yufei
    Tu, Mingyang
    Li, Jiangbo
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2022), PT III, 2022, 13457 : 197 - 204
  • [10] Autonomous obstacle avoidance of UAV based on deep reinforcement learning
    Yang, Songyue
    Yu, Guizhen
    Meng, Zhijun
    Wang, Zhangyu
    Li, Han
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (04) : 3323 - 3335