Hierarchical Error Representation: A Computational Model of Anterior Cingulate and Dorsolateral Prefrontal Cortex

被引:74
|
作者
Alexander, William H. [1 ,2 ]
Brown, Joshua W. [1 ]
机构
[1] Indiana Univ, Dept Psychol & Brain Sci, Bloomington, IN 47405 USA
[2] Univ Ghent, Dept Expt Psychol, B-9000 Ghent, Belgium
关键词
WORKING-MEMORY; COGNITIVE CONTROL; FRONTAL-CORTEX; FUNCTIONAL-ORGANIZATION; INTEGRATIVE THEORY; NEURAL MECHANISMS; DOPAMINE NEURONS; DECISION-MAKING; TERM-MEMORY; ATTENTION;
D O I
10.1162/NECO_a_00779
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anterior cingulate and dorsolateral prefrontal cortex (ACC and dlPFC, respectively) are core components of the cognitive control network. Activation of these regions is routinely observed in tasks that involve monitoring the external environment and maintaining information in order to generate appropriate responses. Despite the ubiquity of studies reporting coactivation of these two regions, a consensus on how they interact to support cognitive control has yet to emerge. In this letter, we present a new hypothesis and computational model of ACC and dlPFC. The error representation hypothesis states that multidimensional error signals generated by ACC in response to surprising outcomes are used to train representations of expected error in dlPFC, which are then associated with relevant task stimuli. Error representations maintained in dlPFC are in turn used to modulate predictive activity in ACC in order to generate better estimates of the likely outcomes of actions. We formalize the error representation hypothesis in a new computational model based on our previous model of ACC. The hierarchical error representation (HER) model of ACC/dlPFC suggests a mechanism by which hierarchically organized layers within ACC and dlPFC interact in order to solve sophisticated cognitive tasks. In a series of simulations, we demonstrate the ability of the HER model to autonomously learn to perform structured tasks in a manner comparable to human performance, and we show that the HER model outperforms current deep learning networks by an order of magnitude.
引用
收藏
页码:2354 / 2410
页数:57
相关论文
共 50 条
  • [41] Changes in NMDA receptor subunits and interacting PSD proteins in dorsolateral prefrontal and anterior cingulate cortex indicate abnormal regional expression in schizophrenia
    L V Kristiansen
    M Beneyto
    V Haroutunian
    J H Meador-Woodruff
    Molecular Psychiatry, 2006, 11 : 737 - 747
  • [42] Dorsolateral prefrontal and anterior cingulate cortex volumetric abnormalities in adults with attention-deficit/hyperactivity disorder identified by magnetic resonance imaging
    Seidman, Larry J.
    Valera, Eve M.
    Makris, Nikos
    Monuteaux, Michael C.
    Boriel, Denise L.
    Kelkar, Kalika
    Kennedy, David N.
    Caviness, Verne S.
    Bush, George
    Aleardi, Meg
    Faraone, Stephen V.
    Biederman, Joseph
    BIOLOGICAL PSYCHIATRY, 2006, 60 (10) : 1071 - 1080
  • [43] Learning and Representation of Hierarchical Concepts in Hippocampus and Prefrontal Cortex
    Theves, Stephanie
    Neville, David A.
    Fernandez, Guillen
    Doeller, Christian F.
    JOURNAL OF NEUROSCIENCE, 2021, 41 (36): : 7675 - 7686
  • [44] Dissociating Response Conflict and Error Likelihood in Anterior Cingulate Cortex
    Yeung, Nick
    Nieuwenhuis, Sander
    JOURNAL OF NEUROSCIENCE, 2009, 29 (46): : 14506 - 14510
  • [45] Anterior cingulate cortex, error detection, and the online monitoring of performance
    Carter, Cameron S.
    Braver, Todd S.
    Barch, Deanna M.
    Botvinick, Matthew M.
    Noll, Douglas
    Cohen, Jonathan D.
    1998, (280)
  • [46] Another major function of the anterior cingulate cortex: The representation of requirements
    Weston, C. S. E.
    NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2012, 36 (01): : 90 - 110
  • [47] Anterior cingulate cortex, error detection, and the online monitoring of performance
    Carter, CS
    Braver, TS
    Barch, DM
    Botvinick, MM
    Noll, D
    Cohen, JD
    SCIENCE, 1998, 280 (5364) : 747 - 749
  • [48] The Role of the Anterior Cingulate Cortex in Prediction Error and Signaling Surprise
    Alexander, William H.
    Brown, Joshua W.
    TOPICS IN COGNITIVE SCIENCE, 2019, 11 (01) : 119 - 135
  • [49] Error Effects in Anterior Cingulate Cortex Reverse when Error Likelihood Is High
    Jessup, Ryan K.
    Busemeyer, Jerome R.
    Brown, Joshua W.
    JOURNAL OF NEUROSCIENCE, 2010, 30 (09): : 3467 - 3472
  • [50] The Best Laid Plans: Computational Principles of Anterior Cingulate Cortex
    Holroyd, Clay B.
    Verguts, Tom
    TRENDS IN COGNITIVE SCIENCES, 2021, 25 (04) : 316 - 329