From reinforcement learning models to psychiatric and neurological disorders

被引:464
|
作者
Maia, Tiago V. [1 ,2 ]
Frank, Michael J. [3 ,4 ,5 ]
机构
[1] Columbia Univ, Dept Psychiat, New York, NY 10027 USA
[2] New York State Psychiat Inst & Hosp, New York, NY 10032 USA
[3] Brown Univ, Dept Cognit Linguist & Psychol Sci, Providence, RI 02912 USA
[4] Brown Univ, Dept Psychiat & Human Behav, Providence, RI 02912 USA
[5] Brown Univ, Brown Inst Brain Sci, Providence, RI 02912 USA
关键词
ATTENTION-DEFICIT/HYPERACTIVITY DISORDER; BASAL GANGLIA; PREFRONTAL CORTEX; PREDICTION-ERROR; DECISION-MAKING; COMPUTATIONAL MODELS; NUCLEUS-ACCUMBENS; WORKING-MEMORY; DOPAMINE MODULATION; OPTOGENETIC CONTROL;
D O I
10.1038/nn.2723
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Over the last decade and a half, reinforcement learning models have fostered an increasingly sophisticated understanding of the functions of dopamine and cortico-basal ganglia-thalamo-cortical (CBGTC) circuits. More recently, these models, and the insights that they afford, have started to be used to understand important aspects of several psychiatric and neurological disorders that involve disturbances of the dopaminergic system and CBGTC circuits. We review this approach and its existing and potential applications to Parkinson's disease, Tourette's syndrome, attention-deficit/hyperactivity disorder, addiction, schizophrenia and preclinical animal models used to screen new antipsychotic drugs. The approach's proven explanatory and predictive power bodes well for the continued growth of computational psychiatry and computational neurology.
引用
收藏
页码:154 / 162
页数:9
相关论文
共 50 条
  • [1] From reinforcement learning models to psychiatric and neurological disorders
    Tiago V Maia
    Michael J Frank
    [J]. Nature Neuroscience, 2011, 14 : 154 - 162
  • [2] Noise in models of neurological and psychiatric disorders
    Spitzer, M
    Neumann, M
    [J]. INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 1996, 7 (04) : 355 - 361
  • [3] The promises and pitfalls of applying computational models to neurological and psychiatric disorders
    Teufel, Christoph
    Fletcher, Paul C.
    [J]. BRAIN, 2016, 139 : 2600 - 2608
  • [4] From Lab to Life: Exploring Cutting-Edge Models for Neurological and Psychiatric Disorders
    Tanaka, Masaru
    Vecsei, Laszlo
    [J]. BIOMEDICINES, 2024, 12 (03)
  • [5] LEARNING DISORDERS AS A SCHOOL HEALTH PROBLEM - NEUROLOGICAL AND PSYCHIATRIC ASPECTS
    WHITSELL, LJ
    [J]. CALIFORNIA MEDICINE, 1969, 111 (06): : 433 - +
  • [6] Psychiatric disorders from EEG signals through deep learning models
    Ahmed, Zaeem
    Wali, Aamir
    Shahid, Saman
    Zikria, Shahid
    Rasheed, Jawad
    Asuroglu, Tunc
    [J]. IBRO NEUROSCIENCE REPORTS, 2024, 17 : 300 - 310
  • [7] Computational reinforcement learning, reward (and punishment), and dopamine in psychiatric disorders
    Liebenow, Brittany
    Jones, Rachel
    DiMarco, Emily
    Trattner, Jonathan D. D.
    Humphries, Joseph
    Sands, L. Paul
    Spry, Kasey P. P.
    Johnson, Christina K. K.
    Farkas, Evelyn B. B.
    Jiang, Angela
    Kishida, Kenneth T. T.
    [J]. FRONTIERS IN PSYCHIATRY, 2022, 13
  • [8] Reinforcement learning models of aversive learning and their translation to anxiety disorders
    Seymour, Ben
    Norbury, Agnes
    [J]. JOURNAL OF NEURAL TRANSMISSION, 2017, 124 (10) : 1283 - 1284
  • [9] Neurological and psychiatric disorders in psoriasis
    Amanat, Man
    Salehi, Mona
    Rezaei, Nima
    [J]. REVIEWS IN THE NEUROSCIENCES, 2018, 29 (07) : 805 - 813
  • [10] Genetics of neurological and psychiatric disorders
    Tatsushi Toda
    [J]. Journal of Human Genetics, 2023, 68 : 113 - 113