The hippocampal formation as a hierarchical generative model supporting generative replay and continual learning

被引:22
|
作者
Stoianov, Ivilin [1 ]
Maisto, Domenico [1 ]
Pezzulo, Giovanni [1 ,2 ]
机构
[1] CNR, Inst Cognit Sci & Technol, Rome, Italy
[2] CNR, Inst Cognit Sci & Technol, Via S Martino Battaglia, Rome, Italy
基金
欧洲研究理事会;
关键词
Hippocampus; Generative model; Generative replay; Cognitive map; Sequence generation; continual learning; PLACE CELLS; COGNITIVE MAP; ACTIVE INFERENCE; EPISODIC MEMORY; REVERSE REPLAY; SEQUENCES; CONTEXT; FUTURE; DECISION; SYSTEMS;
D O I
10.1016/j.pneurobio.2022.102329
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
We advance a novel computational theory of the hippocampal formation as a hierarchical generative model that organizes sequential experiences, such as rodent trajectories during spatial navigation, into coherent spatio-temporal contexts. We propose that the hippocampal generative model is endowed with inductive biases to identify individual items of experience (first hierarchical layer), organize them into sequences (second layer) and cluster them into maps (third layer). This theory entails a novel characterization of hippocampal reactivations as generative replay: the offline resampling of fictive sequences from the generative model, which supports the continual learning of multiple sequential experiences. We show that the model learns and efficiently retains multiple spatial navigation trajectories, by organizing them into spatial maps. Furthermore, the model reproduces flexible and prospective aspects of hippocampal dynamics that are challenging to explain within existing frameworks. This theory reconciles multiple roles of the hippocampal formation in map-based navigation, episodic memory and imagination.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] Generative Models from the perspective of Continual Learning
    Lesort, Timothee
    Caselles-Dupre, Hugo
    Garcia-Ortiz, Michael
    Stoian, Andrei
    Filliat, David
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [22] CRIL: Continual Robot Imitation Learning via Generative and Prediction Model
    Gao, Chongkai
    Gao, Haichuan
    Guo, Shangqi
    Zhang, Tianren
    Chen, Feng
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 6747 - 6754
  • [23] Generative Feature Replay For Class-Incremental Learning
    Liu, Xialei
    Wu, Chenshen
    Menta, Mikel
    Herranz, Luis
    Raducanu, Bogdan
    Bagdanov, Andrew D.
    Jui, Shangling
    van de Weijer, Joost
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 915 - 924
  • [24] Generative replay underlies compositional inference in the hippocampal-prefrontal circuit
    Schwartenbeck, Philipp
    Baram, Alon
    Liu, Yunzhe
    Mark, Shirley
    Muller, Timothy
    Dolan, Raymond
    Botvinick, Matthew
    Kurth-Nelson, Zeb
    Behrens, Timothy
    CELL, 2023, 186 (22) : 4885 - +
  • [25] Continual Learning for Generative Retrieval over Dynamic Corpora
    Chen, Jiangui
    Zhang, Ruqing
    Guo, Jiafeng
    de Rijke, Maarten
    Chen, Wei
    Fan, Yixing
    Cheng, Xueqi
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 306 - 315
  • [26] Efficient Feature Transformations for Discriminative and Generative Continual Learning
    Verma, Vinay Kumar
    Liang, Kevin J.
    Mehta, Nikhil
    Rai, Piyush
    Carin, Lawrence
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 13860 - 13870
  • [27] Recall-Oriented Continual Learning with Generative Adversarial Meta-Model
    Kang, Haneol
    Choi, Dong-Wan
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 12, 2024, : 13040 - 13048
  • [28] Wasserstein Expansible Variational Autoencoder for Discriminative and Generative Continual Learning
    Ye, Fei
    Bors, Adrian G.
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18619 - 18629
  • [29] Generative vs Discriminative: Rethinking The Meta-Continual Learning
    Banayeeanzade, Mohammadamin
    Mirzaiezadeh, Rasoul
    Hasani, Hosein
    Baghshah, Mahdieh Soleymani
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [30] FoCL: Feature-oriented continual learning for generative models
    Lao, Qicheng
    Mortazavi, Mehrzad
    Tahaei, Marzieh
    Dutil, Francis
    Fevens, Thomas
    Havaei, Mohammad
    PATTERN RECOGNITION, 2021, 120