Hierarchical intrinsically motivated agent planning behavior with dreaming in grid environments

被引:1
|
作者
Dzhivelikian, Evgenii [1 ]
Latyshev, Artem [1 ]
Kuderov, Petr [1 ,2 ,3 ]
Panov, Aleksandr I. [1 ,2 ,3 ]
机构
[1] Moscow Inst Phys & Technol MIPT, Dolgoprudnyi, Russia
[2] Russian Acad Sci, Fed Res Ctr Comp Sci & Control, Moscow, Russia
[3] Artificial Intelligence Res Inst AIRI, Moscow, Russia
基金
俄罗斯基础研究基金会;
关键词
Model-based reinforcement learning; Intrinsic motivation; Hierarchical temporal memory; Sparse distributed representations; MEMORY; REPRESENTATIONS; ARCHITECTURE; MODELS; RATS; GO;
D O I
10.1186/s40708-022-00156-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Biologically plausible models of learning may provide a crucial insight for building autonomous intelligent agents capable of performing a wide range of tasks. In this work, we propose a hierarchical model of an agent operating in an unfamiliar environment driven by a reinforcement signal. We use temporal memory to learn sparse distributed representation of state-actions and the basal ganglia model to learn effective action policy on different levels of abstraction. The learned model of the environment is utilized to generate an intrinsic motivation signal, which drives the agent in the absence of the extrinsic signal, and through acting in imagination, which we call dreaming. We demonstrate that the proposed architecture enables an agent to effectively reach goals in grid environments.
引用
收藏
页数:28
相关论文
共 50 条
  • [1] Intrinsically Motivated Agent Behavior in a Swarm
    Khan, Md Mohiuddin
    Kasmarik, Kathryn
    Barlow, Michael
    [J]. 2018 JOINT IEEE 8TH INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING AND EPIGENETIC ROBOTICS (ICDL-EPIROB), 2018, : 113 - 118
  • [2] Intrinsically Motivated Hierarchical Skill Learning in Structured Environments
    Vigorito, Christopher M.
    Barto, Andrew G.
    [J]. IEEE TRANSACTIONS ON AUTONOMOUS MENTAL DEVELOPMENT, 2010, 2 (02) : 132 - 143
  • [3] Intrinsically motivated hierarchical manipulation
    Hart, Stephen
    Sen, Shiraj
    Grupen, Rod
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-9, 2008, : 3814 - 3819
  • [4] Intrinsically motivated intelligent sensed environments
    Maher, Mary Lou
    Merrick, Kathryn
    Macindoe, Owen
    [J]. INTELLIGENT COMPUTING IN ENGINEERING AND ARCHITECTURE, 2006, 4200 : 455 - 475
  • [5] Control What You Can Intrinsically Motivated Task-Planning Agent
    Blaes, Sebastian
    Pogancic, Marin Vlastelica
    Zhu, Jia-Jie
    Martius, Georg
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [6] EXPECTANCY DETERMINANTS OF INTRINSICALLY MOTIVATED BEHAVIOR
    SHAPIRA, Z
    [J]. JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 1976, 34 (06) : 1235 - 1244
  • [7] Intrinsically Motivated Model Learning for a Developing Curious Agent
    Hester, Todd
    Stone, Peter
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING AND EPIGENETIC ROBOTICS (ICDL), 2012,
  • [8] CHIME: an Adaptive Hierarchical Representation for Continuous Intrinsically Motivated Exploration
    Manoury, Alexandre
    Sao Mai Nguyen
    Buche, Cedric
    [J]. 2019 THIRD IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING (IRC 2019), 2019, : 167 - 170
  • [9] Effectiveness of Intrinsically Motivated Adaptive Agent for Sustainable Human-Agent Interaction
    Nozawa, Takayuki
    Kondo, Toshiyuki
    [J]. NEURAL INFORMATION PROCESSING, PT 2, PROCEEDINGS, 2009, 5864 : 179 - 188
  • [10] Intrinsically Motivated Hierarchical Policy Learning in Multiobjective Markov Decision Processes
    Abdelfattah, Sherif
    Merrick, Kathryn
    Hu, Jiankun
    [J]. IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2021, 13 (02) : 262 - 273