A Probabilistic Framework for Model-Based Imitation Learning

被引:0
|
作者
Shon, Aaron P. [1 ]
Grimes, David B. [1 ]
Baker, Chris L. [1 ]
Rao, Rajesh P. N. [1 ]
机构
[1] Univ Washington, CSE Dept, Seattle, WA 98195 USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Humans and animals use imitation as a mechanism for acquiring knowledge. Recently, several algorithms and models have been proposed for imitation learning in robots and humans. However, few proposals offer a framework for imitation learning in a stochastic environment where the imitator must learn and act under real-time performance constraints. We present a probabilistic framework for imitation learning in stochastic environments with unreliable sensors. We develop Bayesian algorithms, based on Meltzo and Moore's AIM hypothesis for infant imitation, that implement the core of an imitation learning framework, and sketch basic proposals for the other components. Our algorithms are computationally efficient, allowing real-time learning and imitation in an active stereo vision robotic head. We present results of both software simulations and our algorithms running on the head, demonstrating the validity of our approach.
引用
收藏
页码:1237 / 1242
页数:6
相关论文
共 50 条
  • [1] Probabilistic model-based imitation learning
    Englert, Peter
    Paraschos, Alexandros
    Deisenroth, Marc Peter
    Peters, Jan
    [J]. ADAPTIVE BEHAVIOR, 2013, 21 (05) : 388 - 403
  • [2] Model-based Imitation Learning by Probabilistic Trajectory Matching
    Englert, Peter
    Paraschos, Alexandros
    Peters, Jan
    Deisenroth, Marc Peter
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2013, : 1922 - 1927
  • [3] Model-Based Imitation Learning for Urban Driving
    Hu, Anthony
    Corrado, Gianluca
    Griffiths, Nicolas
    Murez, Zak
    Gurau, Corina
    Yeo, Hudson
    Kendall, Alex
    Cipolla, Roberto
    Shotton, Jamie
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [4] Imitation Game: A Model-based and Imitation Learning Deep Reinforcement Learning Hybrid
    Veith, Eric Msp
    Logemann, Torben
    Berezin, Aleksandr
    Wellssow, Arlena
    Balduin, Stephan
    [J]. 2024 12TH WORKSHOP ON MODELING AND SIMULATION OF CYBER-PHYSICAL ENERGY SYSTEMS, MSCPES, 2024,
  • [5] A Model-Based Framework for Probabilistic Simulation of Legal Policies
    Soltana, Ghanem
    Sannier, Nicolas
    Sabetzadeh, Mehrdad
    Briand, Lionel C.
    [J]. 2015 ACM/IEEE 18TH INTERNATIONAL CONFERENCE ON MODEL DRIVEN ENGINEERING LANGUAGES AND SYSTEMS (MODELS), 2015, : 70 - 79
  • [6] A framework for probabilistic model-based engineering and data synthesis
    Ray, Douglas
    Ramirez-Marquez, Jose
    [J]. RELIABILITY ENGINEERING & SYSTEM SAFETY, 2020, 193
  • [7] Model-Based Imitation Learning Using Entropy Regularization of Model and Policy
    Uchibe, Eiji
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) : 10922 - 10929
  • [8] MobILE: Model-Based Imitation Learning From Observation Alone
    Kidambi, Rahul
    Chang, Jonathan D.
    Sun, Wen
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [9] Hierarchical Model-Based Imitation Learning for Planning in Autonomous Driving
    Bronstein, Eli
    Palatucci, Mark
    Notz, Dominik
    White, Brandyn
    Kuefler, Alex
    Lu, Yiren
    Paul, Supratik
    Nikdel, Payam
    Mougin, Paul
    Chen, Hongge
    Fu, Justin
    Abrams, Austin
    Shah, Punit
    Racah, Evan
    Frenkel, Benjamin
    Whiteson, Shimon
    Anguelov, Dragomir
    [J]. 2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 8652 - 8659
  • [10] A probabilistic model-based diagnostic framework for nuclear engineering systems
    Tat Nghia Nguyen
    Downar, Thomas
    Vilim, Richard
    [J]. ANNALS OF NUCLEAR ENERGY, 2020, 149