The hippocampal formation as a hierarchical generative model supporting generative replay and continual learning

被引:22
|
作者
Stoianov, Ivilin [1 ]
Maisto, Domenico [1 ]
Pezzulo, Giovanni [1 ,2 ]
机构
[1] CNR, Inst Cognit Sci & Technol, Rome, Italy
[2] CNR, Inst Cognit Sci & Technol, Via S Martino Battaglia, Rome, Italy
基金
欧洲研究理事会;
关键词
Hippocampus; Generative model; Generative replay; Cognitive map; Sequence generation; continual learning; PLACE CELLS; COGNITIVE MAP; ACTIVE INFERENCE; EPISODIC MEMORY; REVERSE REPLAY; SEQUENCES; CONTEXT; FUTURE; DECISION; SYSTEMS;
D O I
10.1016/j.pneurobio.2022.102329
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
We advance a novel computational theory of the hippocampal formation as a hierarchical generative model that organizes sequential experiences, such as rodent trajectories during spatial navigation, into coherent spatio-temporal contexts. We propose that the hippocampal generative model is endowed with inductive biases to identify individual items of experience (first hierarchical layer), organize them into sequences (second layer) and cluster them into maps (third layer). This theory entails a novel characterization of hippocampal reactivations as generative replay: the offline resampling of fictive sequences from the generative model, which supports the continual learning of multiple sequential experiences. We show that the model learns and efficiently retains multiple spatial navigation trajectories, by organizing them into spatial maps. Furthermore, the model reproduces flexible and prospective aspects of hippocampal dynamics that are challenging to explain within existing frameworks. This theory reconciles multiple roles of the hippocampal formation in map-based navigation, episodic memory and imagination.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Continual Learning with Deep Generative Replay
    Shin, Hanul
    Lee, Jung Kwon
    Kim, Jaehong
    Kim, Jiwon
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [2] Generative negative replay for continual learning
    Graffieti, Gabriele
    Maltoni, Davide
    Pellegrini, Lorenzo
    Lomonaco, Vincenzo
    NEURAL NETWORKS, 2023, 162 : 369 - 383
  • [3] Generative Replay Inspired by Hippocampal Memory Indexing for Continual Language Learning
    Maekawa, Aru
    Kamigaito, Hidetaka
    Funakoshi, Kotaro
    Okumura, Manabu
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 930 - 942
  • [4] Continual Pedestrian Trajectory Learning With Social Generative Replay
    Wu, Ya
    Bighashdel, Ariyan
    Chen, Guang
    Dubbelman, Gijs
    Jancura, Pavol
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (02) : 848 - 855
  • [5] CONTINUAL LEARNING OF NEW SOUND CLASSES USING GENERATIVE REPLAY
    Wang, Zhepei
    Subakan, Cem
    Tzinis, Efthymios
    Smaragdis, Paris
    Charlin, Laurent
    2019 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA), 2019, : 308 - 312
  • [6] BinPlay: A Binary Latent Autoencoder for Generative Replay Continual Learning
    Deja, Kamil
    Wawrzynski, Pawel
    Marczak, Daniel
    Masarczyk, Wojciech
    Trzcinski, Tomasz
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [7] Generative feature-driven image replay for continual learning
    Thandiackal, Kevin
    Portenier, Tiziano
    Giovannini, Andrea
    Gabrani, Maria
    Goksel, Orcun
    IMAGE AND VISION COMPUTING, 2024, 150
  • [8] Generative Feature Replay with Orthogonal Weight Modification for Continual Learning
    Shen, Gehui
    Zhang, Song
    Chen, Xiang
    Deng, Zhi-Hong
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [9] Generative appearance replay for continual unsupervised domain adaptation
    Chen, Boqi
    Thandiackal, Kevin
    Pati, Pushpak
    Goksel, Orcun
    MEDICAL IMAGE ANALYSIS, 2023, 89
  • [10] Looking Through the Past: Better Knowledge Retention for Generative Replay in Continual Learning
    Khan, Valeriya
    Cygert, Sebastian
    Deja, Kamil
    Trzcinski, Tomasz
    Twardowski, Bartlomiej
    IEEE ACCESS, 2024, 12 : 45309 - 45317