Hierarchical Error Representation: A Computational Model of Anterior Cingulate and Dorsolateral Prefrontal Cortex

被引:74
|
作者
Alexander, William H. [1 ,2 ]
Brown, Joshua W. [1 ]
机构
[1] Indiana Univ, Dept Psychol & Brain Sci, Bloomington, IN 47405 USA
[2] Univ Ghent, Dept Expt Psychol, B-9000 Ghent, Belgium
关键词
WORKING-MEMORY; COGNITIVE CONTROL; FRONTAL-CORTEX; FUNCTIONAL-ORGANIZATION; INTEGRATIVE THEORY; NEURAL MECHANISMS; DOPAMINE NEURONS; DECISION-MAKING; TERM-MEMORY; ATTENTION;
D O I
10.1162/NECO_a_00779
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anterior cingulate and dorsolateral prefrontal cortex (ACC and dlPFC, respectively) are core components of the cognitive control network. Activation of these regions is routinely observed in tasks that involve monitoring the external environment and maintaining information in order to generate appropriate responses. Despite the ubiquity of studies reporting coactivation of these two regions, a consensus on how they interact to support cognitive control has yet to emerge. In this letter, we present a new hypothesis and computational model of ACC and dlPFC. The error representation hypothesis states that multidimensional error signals generated by ACC in response to surprising outcomes are used to train representations of expected error in dlPFC, which are then associated with relevant task stimuli. Error representations maintained in dlPFC are in turn used to modulate predictive activity in ACC in order to generate better estimates of the likely outcomes of actions. We formalize the error representation hypothesis in a new computational model based on our previous model of ACC. The hierarchical error representation (HER) model of ACC/dlPFC suggests a mechanism by which hierarchically organized layers within ACC and dlPFC interact in order to solve sophisticated cognitive tasks. In a series of simulations, we demonstrate the ability of the HER model to autonomously learn to perform structured tasks in a manner comparable to human performance, and we show that the HER model outperforms current deep learning networks by an order of magnitude.
引用
收藏
页码:2354 / 2410
页数:57
相关论文
共 50 条
  • [21] Anterior cingulate and prefrontal cortex: who's in control?
    Cohen, JD
    Botvinick, M
    Carter, CS
    NATURE NEUROSCIENCE, 2000, 3 (05) : 421 - 423
  • [22] Learned error matching in the anterior cingulate cortex
    Brown, J
    Braver, T
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2005, : 86 - 86
  • [23] Less NMDA Receptor Binding in Dorsolateral Prefrontal Cortex and Anterior Cingulate Cortex Associated With Reported Early-Life Adversity but Not Suicide
    Underwood, Mark D.
    Bakalian, Mihran J.
    Johnson, Virginia L.
    Kassir, Suham A.
    Ellis, Steven P.
    Mann, J. John
    Arango, Victoria
    INTERNATIONAL JOURNAL OF NEUROPSYCHOPHARMACOLOGY, 2020, 23 (05): : 311 - 318
  • [24] Effects of state and trait emotion on cognitive control: fMRI evidence for selective interactions in dorsolateral prefrontal and anterior cingulate cortex
    Gray, JW
    Braver, TS
    Raichle, ME
    NEUROIMAGE, 2001, 13 (06) : S412 - S412
  • [25] Cellular Diversity in Human Subgenual Anterior Cingulate and Dorsolateral Prefrontal Cortex by Single-Nucleus RNA-Sequencing
    Kim, Billy
    Kim, Dowon
    Schulmann, Anton
    Patel, Yash
    Caban-Rivera, Carolina
    Kim, Paul
    Jambhale, Ananya
    Johnson, Kory R.
    Feng, Ningping
    Xu, Qing
    Kang, Sun Jung
    Mandal, Ajeet
    Kelly, Michael
    Akula, Nirmala
    McMahon, Francis J.
    Lipska, Barbara
    Marenco, Stefano
    Auluck, Pavan K.
    JOURNAL OF NEUROSCIENCE, 2023, 43 (19): : 3582 - 3597
  • [26] Dissociable roles of ventromedial prefrontal cortex (vmPFC) and rostral anterior cingulate cortex (rACC) in value representation and optimistic bias
    Blair, Karina S.
    Otero, Marcela
    Teng, Cindy
    Jacobs, Madeline
    Odenheimer, Stephanie
    Pine, Daniel S.
    Blair, R. J. R.
    NEUROIMAGE, 2013, 78 : 103 - 110
  • [27] A computational model of risk, conflict, and individual difference effects in the anterior cingulate cortex
    Brown, Josliua W.
    Braver, Todd S.
    BRAIN RESEARCH, 2008, 1202 : 99 - 108
  • [28] Learned predictions of error likelihood in the anterior cingulate cortex
    Brown, JW
    Braver, TS
    SCIENCE, 2005, 307 (5712) : 1118 - 1121
  • [29] Proton magnetic resonance spectroscopy in subjects with high genetic risk of schizophrenia: Investigation of anterior cingulate, dorsolateral prefrontal cortex and thalamus
    Yoo, So Young
    Yeon, Suran
    Choi, Chi-Hoon
    Kang, Do-Hyung
    Lee, Jong-Min
    Shin, Na Young
    Jung, Wi Hoon
    Choi, Jung-Seok
    Jang, Dong-Pyo
    Kwon, Jun Soo
    SCHIZOPHRENIA RESEARCH, 2009, 111 (1-3) : 86 - 93
  • [30] Single-nucleus RNA-seq in the human dorsolateral prefrontal cortex and subgenual anterior cingulate: implications for psychiatric disorders
    Kim, Billy
    Kim, Paul
    Johnson, Kory
    Caban-Rivera, Carolina
    Feng, Ningping
    Xu, Qing
    Mandal, Ajeet
    Akula, Nirmala
    McMahon, Francis
    Lipska, Barbara
    Marenco, Stefano
    Auluck, Pavan
    JOURNAL OF NEUROPATHOLOGY AND EXPERIMENTAL NEUROLOGY, 2019, 78 (06): : 552 - 552