World Model Learning from Demonstrations with Active Inference: Application to Driving Behavior

被引:2
|
作者
Wei, Ran [1 ]
Garcia, Alfredo [1 ]
McDonald, Anthony [1 ,2 ]
Markkula, Gustav [3 ]
Engstrom, Johan [4 ]
Supeene, Isaac [4 ]
O'Kelly, Matthew [4 ]
机构
[1] Texas A&M Univ, College Stn, TX USA
[2] Univ Wisconsin, Madison, WI USA
[3] Univ Leeds, Leeds, W Yorkshire, England
[4] Waymo LLC, Mountain View, CA USA
来源
ACTIVE INFERENCE, IWAI 2022 | 2023年 / 1721卷
基金
英国工程与自然科学研究理事会;
关键词
Active inference; Inverse reinforcement learning; Driving behavior modeling;
D O I
10.1007/978-3-031-28719-0_9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Active inference proposes a unifying principle for perception and action as jointly minimizing the free energy of an agent's internal world model. In the active inference literature, world models are typically pre-specified or learned through interacting with an environment. This paper explores the possibility of learning world models of active inference agents from recorded demonstrations, with an application to human driving behavior modeling. The results show that the presented method can create models that generate human-like driving behavior but the approach is sensitive to input features.
引用
收藏
页码:130 / 142
页数:13
相关论文
共 50 条
  • [1] World model learning and inference
    Friston, Karl
    Moran, Rosalyn J.
    Nagai, Yukie
    Taniguchi, Tadahiro
    Gomi, Hiroaki
    Tenenbaum, Josh
    NEURAL NETWORKS, 2021, 144 : 573 - 590
  • [2] Active Inference Integrated With Imitation Learning for Autonomous Driving
    Nozari, Sheida
    Krayani, Ali
    Marin-Plaza, Pablo
    Marcenaro, Lucio
    Gomez, David Martin
    Regazzoni, Carlo
    IEEE ACCESS, 2022, 10 : 49738 - 49756
  • [3] Real-World Robot Control Based on Contrastive Deep Active Inference With Demonstrations
    Fujii, Kentaro
    Isomura, Takuya
    Murata, Shingo
    IEEE ACCESS, 2024, 12 : 172343 - 172357
  • [4] Inverse Reinforcement Learning with Failed Demonstrations towards Stable Driving Behavior Modeling
    Zhao, Minglu
    Shimosaka, Masamichi
    2024 35TH IEEE INTELLIGENT VEHICLES SYMPOSIUM, IEEE IV 2024, 2024, : 2537 - 2544
  • [5] Resolving uncertainty on the fly: modeling adaptive driving behavior as active inference
    Engstrom, Johan
    Wei, Ran
    Mcdonald, Anthony D.
    Garcia, Alfredo
    O'Kelly, Matthew
    Johnson, Leif
    FRONTIERS IN NEUROROBOTICS, 2024, 18 (18):
  • [6] RLfOLD: Reinforcement Learning from Online Demonstrations in Urban Autonomous Driving
    Coelho, Daniel
    Oliveira, Miguel
    Santos, Vitor
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 10, 2024, : 11660 - 11668
  • [7] Driving Behavior Inference from Traffic Surveillance Data
    Zhou, Kai
    Varadarajan, Karthik Mahesh
    Vincze, Markus
    Liu, Fuqiang
    2011 14TH INTERNATIONAL IEEE CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2011, : 600 - 605
  • [8] Model predictive optimization for imitation learning from demonstrations
    Hu, Yingbai
    Cui, Mingyang
    Duan, Jianghua
    Liu, Wenjun
    Huang, Dianye
    Knoll, Alois
    Chen, Guang
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2023, 163
  • [9] Interactively learning behavior trees from imperfect human demonstrations
    Scherf, Lisa
    Schmidt, Aljoscha
    Pal, Suman
    Koert, Dorothea
    FRONTIERS IN ROBOTICS AND AI, 2023, 10
  • [10] A Deep Reinforcement Learning Algorithm with Expert Demonstrations and Supervised Loss and its application in Autonomous Driving
    Liu, Kai
    Wan, Qin
    Li, Yanjie
    2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 2944 - 2949