Neurocomputational models of basal ganglia function in learning, memory and choice

被引:155
|
作者
Cohen, Michael X. [1 ]
Frank, Michael J. [1 ]
机构
[1] Univ Arizona, Dept Psychol, Program Neurosci, Tucson, AZ 85721 USA
关键词
Basal ganglia; Computational model; Dopamine; Reinforcement learning; Decision making; LONG-TERM POTENTIATION; MEDIUM SPINY NEURONS; TEMPORAL DIFFERENCE MODELS; HIGH-FREQUENCY STIMULATION; DEEP BRAIN-STIMULATION; SUBTHALAMIC NUCLEUS; DECISION-MAKING; PARKINSONS-DISEASE; L-DOPA; FRONTAL-CORTEX;
D O I
10.1016/j.bbr.2008.09.029
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
The basal ganglia (BG) are critical for the coordination of several motor, cognitive, and emotional functions and become dysfunctional in several pathological states ranging from Parkinson's disease to Schizophrenia. Here we review principles developed within a neurocomputational framework of BG and related circuitry which provide insights into their functional roles in behavior. We focus on two classes of models: those that incorporate aspects of biological realism and constrained by functional principles, and more abstract mathematical models focusing on the higher level computational goals of the BG. While the former are arguably more "realistic", the latter have a complementary advantage in being able to describe functional principles of how the system works in a relatively simple set of equations, but are less suited to making specific hypotheses about the roles of specific nuclei and neurophysiological processes. We review the basic architecture and assumptions of these models, their relevance to our understanding of the neurobiological and cognitive functions of the BG, and provide an update on the potential roles of biological details not explicitly incorporated in existing models. Empirical studies ranging from those in transgenic mice to dopaminergic manipulation, deep brain stimulation, and genetics in humans largely support model predictions and provide the basis for further refinement. Finally, we discuss possible future directions and possible ways to integrate different types of models. (C) 2008 Elsevier B.V. All rights reserved.
引用
收藏
页码:141 / 156
页数:16
相关论文
共 50 条
  • [2] Learning and memory functions of the basal ganglia
    Packard, MG
    Knowlton, BJ
    ANNUAL REVIEW OF NEUROSCIENCE, 2002, 25 : 563 - 593
  • [3] On the Role of Cortex-Basal Ganglia Interactions for Category Learning: A Neurocomputational Approach
    Villagrasa, Francesc
    Baladron, Javier
    Vitay, Julien
    Schroll, Henning
    Antzoulatos, Evan G.
    Miller, Earl K.
    Hamker, Fred H.
    JOURNAL OF NEUROSCIENCE, 2018, 38 (44): : 9551 - 9562
  • [4] Simulation of GABA function in the basal ganglia: computational models of GABAergic mechanisms in basal ganglia function
    Wickens, Jeffery R.
    Arbuthnott, Gordon W.
    Shindou, Tomomi
    GABA AND THE BASAL GANGLIA: FROM MOLECULES TO SYSTEMS, 2007, 160 : 313 - 329
  • [5] Modeling the effects of motivation on choice and learning in the basal ganglia
    van Swieten, Maaike M. H.
    Bogacz, Rafal
    PLOS COMPUTATIONAL BIOLOGY, 2020, 16 (05)
  • [6] Reassessing Models of Basal Ganglia Function and Dysfunction
    Nelson, Alexandra B.
    Kreitzer, Anatol C.
    ANNUAL REVIEW OF NEUROSCIENCE, VOL 37, 2014, 37 : 117 - 135
  • [7] Update on models of basal ganglia function and dysfunction
    DeLong, Mahlon
    Wichmann, Thomas
    PARKINSONISM & RELATED DISORDERS, 2009, 15 : S237 - S240
  • [8] Basal Ganglia Models for Autonomous Behavior Learning
    Tsujino, Hiroshi
    Takeuchi, Johane
    Shouno, Osamu
    CREATING BRAIN-LIKE INTELLIGENCE: FROM BASIC PRINCIPLES TO COMPLEX INTELLIGENT SYSTEMS, 2009, 5436 : 328 - 350
  • [9] The role of the basal ganglia in learning and memory: Neuropsychological studies
    Grahn, Jessica A.
    Parkinson, John A.
    Owen, Adrian M.
    BEHAVIOURAL BRAIN RESEARCH, 2009, 199 (01) : 53 - 60
  • [10] Neurocomputational models of working memory
    Daniel Durstewitz
    Jeremy K. Seamans
    Terrence J. Sejnowski
    Nature Neuroscience, 2000, 3 : 1184 - 1191