Robot Navigation of Environments with Unknown Rough Terrain Using Deep Reinforcement Learning

被引:0
|
作者
Zhang, Kaicheng [1 ]
Niroui, Farzad [1 ]
Ficocelli, Maurizio [2 ]
Nejat, Goldie [1 ]
机构
[1] Univ Toronto, Dept Mech & Ind Engn, Autonomous Syst & Biomechatron Lab ASBLab, Toronto, ON, Canada
[2] Dettwiler & Associates MDA Inc, Guidance Nav & Control Grp MacDonald, Brampton, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
AUTONOMOUS NAVIGATION; PATH;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In Urban Search and Rescue (USAR) missions, mobile rescue robots need to search cluttered disaster environments in order to find victims. However, these environments can be very challenging due to the unknown rough terrain that the robots must be able to navigate. In this paper, we uniquely explore the first use of deep reinforcement learning (DRL) to address the robot navigation problem in such cluttered environments with unknown rough terrain. We have developed and trained a DRL network that uses raw sensory data from the robot's onboard sensors to determine a series of local navigation actions for a mobile robot to execute. The performance of our approach was successfully tested in several unique 3D simulated environments with varying sizes and levels of traversability.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Autonomous Navigation of Rescue Robot on International Standard Rough Terrain by Using Deep Reinforcement Learning
    Matsuo, Hayato
    Sato, Noritaka
    Morita, Yoshifumi
    [J]. 2023 IEEE INTERNATIONAL SYMPOSIUM ON SAFETY, SECURITY, AND RESCUE ROBOTICS, SSRR, 2023, : 153 - 158
  • [2] Robot Navigation in Crowded Environments Using Deep Reinforcement Learning
    Liu, Lucia
    Dugas, Daniel
    Cesari, Gianluca
    Siegwart, Roland
    Dube, Renaud
    [J]. 2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 5671 - 5677
  • [3] A Sim-to-Real Pipeline for Deep Reinforcement Learning for Autonomous Robot Navigation in Cluttered Rough Terrain
    Hu, Han
    Zhang, Kaicheng
    Tan, Aaron Hao
    Ruan, Michael
    Agia, Christopher
    Nejat, Goldie
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 6569 - 6576
  • [4] Navigation in Unknown Dynamic Environments Based on Deep Reinforcement Learning
    Zeng, Junjie
    Ju, Rusheng
    Qin, Long
    Hu, Yue
    Yin, Quanjun
    Hu, Cong
    [J]. SENSORS, 2019, 19 (18)
  • [5] Autonomous Motion Control Using Deep Reinforcement Learning for Exploration Robot on Rough Terrain
    Wang, Zijie
    Ji, Yonghoon
    Fujii, Hiromitsu
    Kono, Hitoshi
    [J]. 2022 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION (SII 2022), 2022, : 1021 - 1025
  • [6] Quadruped Robot Locomotion in Unknown Terrain Using Deep Reinforcement
    Pei, Muleilan
    Wu, Dongping
    Wang, Changhong
    [J]. PROCEEDINGS OF 2020 3RD INTERNATIONAL CONFERENCE ON UNMANNED SYSTEMS (ICUS), 2020, : 517 - 522
  • [7] All Aware Robot Navigation in Human Environments Using Deep Reinforcement Learning
    Lu, Xiaojun
    Faragasso, Angela
    Yamashita, Atsushi
    Asama, Hajime
    [J]. 2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 5989 - 5996
  • [8] Autonomous Navigation of a Humanoid Robot Over Unknown Rough Terrain
    Nishiwaki, Koichi
    Chestnutt, Joel
    Kagami, Satoshi
    [J]. ROBOTICS RESEARCH, ISRR, 2017, 100
  • [9] Control of Rough Terrain Vehicles Using Deep Reinforcement Learning
    Wiberg, Viktor
    Wallin, Erik
    Nordfjell, Tomas
    Servin, Martin
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (01) : 390 - 397
  • [10] Navigation of autonomous vehicles in unknown environments using reinforcement learning
    Martinez-Marin, Tomas
    Rodriguez, Rafael
    [J]. 2007 IEEE INTELLIGENT VEHICLES SYMPOSIUM, VOLS 1-3, 2007, : 964 - +