Improving Autonomous Robotic Navigation Using Imitation Learning

被引:4
|
作者
Cesar-Tondreau, Brian [1 ,2 ]
Warnell, Garrett [2 ]
Stump, Ethan [2 ]
Kochersberger, Kevin [1 ]
Waytowich, Nicholas R. [2 ]
机构
[1] Virginia Polytech Inst & State Univ, Unmanned Syst Lab, Mech Engn, Blacksburg, VA 24061 USA
[2] Army Res Lab, Adelphi, MD 20783 USA
来源
关键词
autonomous navigation; learning from demonstration; imitation learning; human in the loop; robot learning and behavior adaptation;
D O I
10.3389/frobt.2021.627730
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Autonomous navigation to a specified waypoint is traditionally accomplished with a layered stack of global path planning and local motion planning modules that generate feasible and obstacle-free trajectories. While these modules can be modified to meet task-specific constraints and user preferences, current modification procedures require substantial effort on the part of an expert roboticist with a great deal of technical training. In this paper, we simplify this process by inserting a Machine Learning module between the global path planning and local motion planning modules of an off-the shelf navigation stack. This model can be trained with human demonstrations of the preferred navigation behavior, using a training procedure based on Behavioral Cloning, allowing for an intuitive modification of the navigation policy by non-technical users to suit task-specific constraints. We find that our approach can successfully adapt a robot's navigation behavior to become more like that of a demonstrator. Moreover, for a fixed amount of demonstration data, we find that the proposed technique compares favorably to recent baselines with respect to both navigation success rate and trajectory similarity to the demonstrator.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Randomized Adversarial Imitation Learning for Autonomous Driving
    Shin, MyungJae
    Kim, Joongheon
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 4590 - 4596
  • [42] Target-driven visual navigation in indoor scenes using reinforcement learning and imitation learning
    Fang, Qiang
    Xu, Xin
    Wang, Xitong
    Zeng, Yujun
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2022, 7 (02) : 167 - 176
  • [43] Navigation of autonomous vehicles in unknown environments using reinforcement learning
    Martinez-Marin, Tomas
    Rodriguez, Rafael
    2007 IEEE INTELLIGENT VEHICLES SYMPOSIUM, VOLS 1-3, 2007, : 964 - +
  • [44] Learning Probabilistic Features for Robotic Navigation Using Laser Sensors
    Aznar, Fidel
    Pujol, Francisco A.
    Pujol, Mar
    Rizo, Ramon
    Pujol, Maria-Jose
    PLOS ONE, 2014, 9 (11):
  • [45] Autonomous Navigation and Control of a Quadrotor Using Deep Reinforcement Learning
    Mokhtar, Mohamed
    El-Badawy, Ayman
    2023 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS, ICUAS, 2023, : 1045 - 1052
  • [46] Reinforcement Learning for Autonomous UAV Navigation Using Function Approximation
    Huy Xuan Pham
    Hung Manh La
    Feil-Seifer, David
    Luan Van Nguyen
    2018 IEEE INTERNATIONAL SYMPOSIUM ON SAFETY, SECURITY, AND RESCUE ROBOTICS (SSRR), 2018,
  • [47] Autonomous Visual Navigation using Deep Reinforcement Learning: An Overview
    Ejaz, Muhammad Mudassir
    Tang, Tong Boon
    Lu, Cheng-Kai
    2019 17TH IEEE STUDENT CONFERENCE ON RESEARCH AND DEVELOPMENT (SCORED), 2019, : 294 - 299
  • [48] A Motion Generation Strategy of Robotic Rat Using Imitation Learning for Behavioral Interaction
    Xie, Hongzhao
    Jia, Guanglu
    Al-Khulaqui, Mohamed
    Gao, Zihang
    Guo, Xiaowen
    Fukuda, Toshio
    Shi, Qing
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03): : 7351 - 7358
  • [49] Robotic Imitation of Human Assembly Skills Using Hybrid Trajectory and Force Learning
    Wang, Yan
    Beltran-Hernandez, Cristian C.
    Wan, Weiwei
    Harada, Kensuke
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 11278 - 11284
  • [50] Real-time Obstacle Avoidance in Robotic Manipulation Using Imitation Learning
    Huang, Jie
    Ge, Wei
    Cheng, Hualong
    Xi, Chun
    Zhu, Jun
    Zhang, Fei
    Shang, Weiwei
    16TH IEEE INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV 2020), 2020, : 976 - 981