Rapid learning of spatial representations for goal-directed navigation based on a novel model of hippocampal place fields

被引:2
|
作者
Alabi, Adedapo [1 ]
Vanderelst, Dieter [1 ]
Minai, Ali A. [1 ]
机构
[1] Univ Cincinnati, Dept Elect & Comp Engn, Cincinnati, OH 45221 USA
关键词
Spatial cognition; Robotics; Reinforcement learning; Hippocampus; Computational neuroscience; MORRIS WATER MAZE; FIBER SYNAPTIC-TRANSMISSION; VECTOR CELL MODEL; GRID CELLS; PATH-INTEGRATION; VICARIOUS TRIAL; CHOLINERGIC SUPPRESSION; SELECTIVE SUPPRESSION; NETWORK ACTIVITY; MEMORY;
D O I
10.1016/j.neunet.2023.01.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The discovery of place cells and other spatially modulated neurons in the hippocampal complex of rodents has been crucial to elucidating the neural basis of spatial cognition. More recently, the replay of neural sequences encoding previously experienced trajectories has been observed during consummatory behavior-potentially with implications for rapid learning, quick memory consolidation, and behavioral planning. Several promising models for robotic navigation and reinforcement learning have been proposed based on these and previous findings. Most of these models, however, use carefully engineered neural networks, and sometimes require long learning periods. In this paper, we present a self-organizing model incorporating place cells and replay, and demonstrate its utility for rapid one-shot learning in non-trivial environments with obstacles. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:116 / 128
页数:13
相关论文
共 50 条
  • [1] Contribution of hippocampal place cell activity to learning and formation of goal-directed navigation in rats
    Kobayashi, T
    Tran, AH
    Nishijo, H
    Ono, T
    Matsumoto, G
    NEUROSCIENCE, 2003, 117 (04) : 1025 - 1035
  • [2] A prefrontal–thalamo–hippocampal circuit for goal-directed spatial navigation
    Hiroshi T. Ito
    Sheng-Jia Zhang
    Menno P. Witter
    Edvard I. Moser
    May-Britt Moser
    Nature, 2015, 522 : 50 - 55
  • [3] Network mechanisms of hippocampal laterality, place coding, and goal-directed navigation
    Kitanishi, Takuma
    Ito, Hiroshi T.
    Hayashi, Yuichiro
    Shinohara, Yoshiaki
    Mizuseki, Kenji
    Hikida, Takatoshi
    JOURNAL OF PHYSIOLOGICAL SCIENCES, 2017, 67 (02): : 247 - 258
  • [4] Network mechanisms of hippocampal laterality, place coding, and goal-directed navigation
    Takuma Kitanishi
    Hiroshi T. Ito
    Yuichiro Hayashi
    Yoshiaki Shinohara
    Kenji Mizuseki
    Takatoshi Hikida
    The Journal of Physiological Sciences, 2017, 67 : 247 - 258
  • [5] A prefrontal-thalamo-hippocampal circuit for goal-directed spatial navigation
    Ito, Hiroshi T.
    Zhang, Sheng-Jia
    Witter, Menno P.
    Moser, Edvard I.
    Moser, May-Britt
    NATURE, 2015, 522 (7554) : 50 - U82
  • [6] A neural circuit architecture for rapid learning in goal-directed navigation
    Dan, Chuntao
    Hulse, Brad K.
    Kappagantula, Ramya
    Jayaraman, Vivek
    Hermundstad, Ann M.
    NEURON, 2024, 112 (15)
  • [7] Modeling goal-directed spatial navigation in the rat based on physiological data from the hippocampal formation
    Koene, RA
    Gorchnikov, A
    Cannon, RC
    Hasselmo, ME
    NEURAL NETWORKS, 2003, 16 (5-6) : 577 - 584
  • [8] The Integration of Goal-Directed Signals onto Spatial Maps of Hippocampal Place Cells
    Aoki, Yuki
    Igata, Hideyoshi
    Ikegaya, Yuji
    Sasaki, Takuya
    CELL REPORTS, 2019, 27 (05): : 1516 - +
  • [9] A Goal-Directed Behavioral Learning Model Based on Hippocampal-Striatal Circuit
    Chai, Jie
    Ruan, Xiaogang
    Huang, Jing
    Li, Peng
    PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 916 - 921
  • [10] A SIMPLE NETWORK MODEL SIMULATES HIPPOCAMPAL PLACE FIELDS .2. COMPUTING GOAL-DIRECTED TRAJECTORIES AND MEMORY FIELDS
    HETHERINGTON, PA
    SHAPIRO, ML
    BEHAVIORAL NEUROSCIENCE, 1993, 107 (03) : 434 - 443