The hippocampal formation as a hierarchical generative model supporting generative replay and continual learning

被引:22
|
作者
Stoianov, Ivilin [1 ]
Maisto, Domenico [1 ]
Pezzulo, Giovanni [1 ,2 ]
机构
[1] CNR, Inst Cognit Sci & Technol, Rome, Italy
[2] CNR, Inst Cognit Sci & Technol, Via S Martino Battaglia, Rome, Italy
基金
欧洲研究理事会;
关键词
Hippocampus; Generative model; Generative replay; Cognitive map; Sequence generation; continual learning; PLACE CELLS; COGNITIVE MAP; ACTIVE INFERENCE; EPISODIC MEMORY; REVERSE REPLAY; SEQUENCES; CONTEXT; FUTURE; DECISION; SYSTEMS;
D O I
10.1016/j.pneurobio.2022.102329
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
We advance a novel computational theory of the hippocampal formation as a hierarchical generative model that organizes sequential experiences, such as rodent trajectories during spatial navigation, into coherent spatio-temporal contexts. We propose that the hippocampal generative model is endowed with inductive biases to identify individual items of experience (first hierarchical layer), organize them into sequences (second layer) and cluster them into maps (third layer). This theory entails a novel characterization of hippocampal reactivations as generative replay: the offline resampling of fictive sequences from the generative model, which supports the continual learning of multiple sequential experiences. We show that the model learns and efficiently retains multiple spatial navigation trajectories, by organizing them into spatial maps. Furthermore, the model reproduces flexible and prospective aspects of hippocampal dynamics that are challenging to explain within existing frameworks. This theory reconciles multiple roles of the hippocampal formation in map-based navigation, episodic memory and imagination.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] Generative Hierarchical Learning of Sparse FRAME Models
    Xie, Jianwen
    Xu, Yifei
    Nijkamp, Erik
    Wu, Ying Nian
    Zhu, Song-Chun
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1933 - 1941
  • [32] MODEL-FREE GENERATIVE REPLAY FOR LIFELONG REINFORCEMENT LEARNING: APPLICATION TO STARCRAFT-2
    Daniels, Zachary
    Raghavan, Aswin
    Hostetler, Jesse
    Rahman, Abrar
    Sur, Indranil
    Piacentino, Michael
    Divakaran, Ajay
    CONFERENCE ON LIFELONG LEARNING AGENTS, VOL 199, 2022, 199
  • [33] Handling data heterogeneity with generative replay in collaborative learning for medical imaging
    Qu, Liangqiong
    Balachandar, Niranjan
    Zhang, Miao
    Rubin, Daniel
    MEDICAL IMAGE ANALYSIS, 2022, 78
  • [34] General Federated Class-Incremental Learning With Lightweight Generative Replay
    Chen, Yuanlu
    Tan, Alysa Ziying
    Feng, Siwei
    Yu, Han
    Deng, Tao
    Zhao, Libang
    Wu, Feng
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (20): : 33927 - 33939
  • [35] Few-Shot Class Incremental Learning with Generative Feature Replay
    Shankarampeta, Abhilash Reddy
    Yamauchi, Koichiro
    PROCEEDINGS OF THE 10TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS (ICPRAM), 2021, : 259 - 267
  • [36] SAR Incremental Learning via Generative Adversarial Network and Experience Replay
    Gao, Fei
    Fan, Chen
    Chen, Penghui
    Hussain, Amir
    Zhou, Huiyu
    ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, BICS 2023, 2024, 14374 : 345 - 353
  • [37] Adversarial Targeted Forgetting in Regularization and Generative Based Continual Learning Models
    Umer, Muhammad
    Polikar, Robi
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [38] Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models
    Heng, Alvin
    Soh, Harold
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [39] GopGAN: Gradients Orthogonal Projection Generative Adversarial Network With Continual Learning
    Li, Xiaobin
    Wang, Weiqiang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (01) : 215 - 227
  • [40] Learning Hierarchical Features from Deep Generative Models
    Zhao, Shengjia
    Song, Jiaming
    Ermon, Stefano
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70