The hippocampal formation as a hierarchical generative model supporting generative replay and continual learning

被引:22
|
作者
Stoianov, Ivilin [1 ]
Maisto, Domenico [1 ]
Pezzulo, Giovanni [1 ,2 ]
机构
[1] CNR, Inst Cognit Sci & Technol, Rome, Italy
[2] CNR, Inst Cognit Sci & Technol, Via S Martino Battaglia, Rome, Italy
基金
欧洲研究理事会;
关键词
Hippocampus; Generative model; Generative replay; Cognitive map; Sequence generation; continual learning; PLACE CELLS; COGNITIVE MAP; ACTIVE INFERENCE; EPISODIC MEMORY; REVERSE REPLAY; SEQUENCES; CONTEXT; FUTURE; DECISION; SYSTEMS;
D O I
10.1016/j.pneurobio.2022.102329
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
We advance a novel computational theory of the hippocampal formation as a hierarchical generative model that organizes sequential experiences, such as rodent trajectories during spatial navigation, into coherent spatio-temporal contexts. We propose that the hippocampal generative model is endowed with inductive biases to identify individual items of experience (first hierarchical layer), organize them into sequences (second layer) and cluster them into maps (third layer). This theory entails a novel characterization of hippocampal reactivations as generative replay: the offline resampling of fictive sequences from the generative model, which supports the continual learning of multiple sequential experiences. We show that the model learns and efficiently retains multiple spatial navigation trajectories, by organizing them into spatial maps. Furthermore, the model reproduces flexible and prospective aspects of hippocampal dynamics that are challenging to explain within existing frameworks. This theory reconciles multiple roles of the hippocampal formation in map-based navigation, episodic memory and imagination.
引用
收藏
页数:20
相关论文
共 50 条
  • [11] Looking through the past: better knowledge retention for generative replay in continual learning
    Khan, Valeriya
    Cygert, Sebastian
    Twardowski, Bartlomiej
    Trzcinski, Tomasz
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 3488 - 3492
  • [12] Generative Continual Concept Learning
    Rostami, Mohammad
    Kolouri, Soheil
    McClelland, James
    Pilly, Praveen
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 5545 - 5552
  • [13] Unified Probabilistic Deep Continual Learning through Generative Replay and Open Set Recognition
    Mundt, Martin
    Pliushch, Iuliia
    Majumder, Sagnik
    Hong, Yongwon
    Ramesh, Visvanathan
    JOURNAL OF IMAGING, 2022, 8 (04)
  • [14] Hierarchical Correlations Replay for Continual Learning
    Wang, Qiang
    Liu, Jiayi
    Ji, Zhong
    Pang, Yanwei
    Zhang, Zhongfei
    KNOWLEDGE-BASED SYSTEMS, 2022, 250
  • [15] UNSUPERVISED GENERATIVE VARIATIONAL CONTINUAL LEARNING
    Liu Guimeng
    Yang, Guo
    Yin, Cheryl Wong Sze
    Suganathan, Ponnuthurai Nagartnam
    Savitha, Ramasamy
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 4028 - 4032
  • [16] Continual learning with invertible generative models
    Pomponi, Jary
    Scardapane, Simone
    Uncini, Aurelio
    NEURAL NETWORKS, 2023, 164 : 606 - 616
  • [17] Generative Negative Text Replay for Continual Vision-Language Pretraining
    Yan, Shipeng
    Hong, Lanqing
    Xu, Hang
    Han, Jianhua
    Tuytelaars, Tinne
    Li, Zhenguo
    He, Xuming
    COMPUTER VISION, ECCV 2022, PT XXXVI, 2022, 13696 : 22 - 38
  • [18] Continual Trajectory Prediction with Uncertainty-Aware Generative Memory Replay
    Feng, Xiushi
    Liu, Shuncheng
    Chen, Haitian
    Zheng, Kai
    23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023, 2023, : 1013 - 1018
  • [19] Hippocampal formation-inspired probabilistic generative model
    Taniguchi, Akira
    Fukawa, Ayako
    Yamakawa, Hiroshi
    NEURAL NETWORKS, 2022, 151 : 317 - 335
  • [20] S-TRIGGER: Continual State Representation Learning via Self-Triggered Generative Replay
    Caselles-Dupre, Hugo
    Garcia-Ortiz, Michael
    Filliat, David
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,