A Deep Reinforcement Learning Method for Mobile Robot Collision Avoidance based on Double DQN

被引:0
|
作者
Xue, Xidi [1 ]
Li, Zhan [1 ]
Zhang, Dongsheng [1 ]
Yan, Yingxin [2 ]
机构
[1] Harbin Inst Technol, Sch Astronaut, Harbin, Heilongjiang, Peoples R China
[2] Sci & Technol Space Phys Lab, Beijing, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
DDQN; collision avoidance; deep reinforcement; local path planning; SLAM;
D O I
10.1109/isie.2019.8781522
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a deep reinforcement learning method based on Double Q-learning Network(DDQN) to enable mobile robots to learn collision avoidance and navigation capabilities autonomously. Information such as target position, obstacle size and position is taken as input, and the direction of movement of the robot is taken as an output. Traditional mobile robots usually requires real-time accurate and fast Simultaneous Localization And Mapping(SLAM) technology for global navigation. We aim at the scenario that after an initial globally feasible path is established, the path could be split into finite segments of sub-goals, and the proposed method focuses on using deep reinforcement learning to control the robots reaching the subgoals in sequence. Experiments show that the proposed method can navigate the mobile robots to desired target position without colliding with any obstacle and other moving robots, and the method is successfully implied on a physical robot platform. In addition, the method is a non-global path planning method, which greatly reduces the computational cost.
引用
收藏
页码:2131 / 2136
页数:6
相关论文
共 50 条
  • [1] A Collision Avoidance Method Based on Deep Reinforcement Learning
    Feng, Shumin
    Sebastian, Bijo
    Ben-Tzvi, Pinhas
    [J]. ROBOTICS, 2021, 10 (02)
  • [2] An Aircraft Collision Avoidance Method Based on Deep Reinforcement Learning
    Liu, Zuocheng
    Neretin, Evgeny
    Gao, Xiaoguang
    Wan, Kaifang
    [J]. 2024 9TH INTERNATIONAL CONFERENCE ON CONTROL AND ROBOTICS ENGINEERING, ICCRE 2024, 2024, : 241 - 246
  • [3] Biologically Inspired Reinforcement Learning for Mobile Robot Collision Avoidance
    Shim, Myung Seok
    Li, Peng
    [J]. 2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 3098 - 3105
  • [4] Deep Reinforcement Learning Based Collision Avoidance Algorithm for Differential Drive Robot
    Lu, Xinglong
    Cao, Yiwen
    Zhao, Zhonghua
    Yan, Yilin
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2018), PT I, 2018, 10984 : 186 - 198
  • [5] Multi-Robot Collision Avoidance with Map-based Deep Reinforcement Learning
    Yao, Shunyi
    Chen, Guangda
    Pan, Lifan
    Ma, Jun
    Ji, Jianmin
    Chen, Xiaoping
    [J]. 2020 IEEE 32ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2020, : 532 - 539
  • [6] MOBILE ROBOT OBSTACLE AVOIDANCE BASE ON DEEP REINFORCEMENT LEARNING
    Feng, Shumin
    Ren, Hailin
    Wang, Xinran
    Ben-Tzvi, Pinhas
    [J]. PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2019, VOL 5A, 2020,
  • [7] Research on Method of Collision Avoidance Planning for UUV Based on Deep Reinforcement Learning
    Gao, Wei
    Han, Mengxue
    Wang, Zhao
    Deng, Lihui
    Wang, Hongjian
    Ren, Jingfei
    [J]. JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (12)
  • [8] A learning method for AUV collision avoidance through deep reinforcement learning
    Xu, Jian
    Huang, Fei
    Wu, Di
    Cui, Yunfei
    Yan, Zheping
    Du, Xue
    [J]. OCEAN ENGINEERING, 2022, 260
  • [9] Mobile robot dynamic obstacle avoidance method based on improved reinforcement learning
    Xu, Jianhua
    Shao, Kangkang
    Wang, Jiahui
    Liu, Xuecong
    [J]. Zhongguo Guanxing Jishu Xuebao/Journal of Chinese Inertial Technology, 2023, 31 (01): : 92 - 99
  • [10] Obstacle Avoidance Algorithm for Mobile Robot Based on Deep Reinforcement Learning in Dynamic Environments
    Sun Xiaoxian
    Yao Chenpeng
    Zhou Haoran
    Liu Chengju
    Chen Qijun
    [J]. 2020 IEEE 16TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION (ICCA), 2020, : 366 - 372