Hierarchical Error Representation: A Computational Model of Anterior Cingulate and Dorsolateral Prefrontal Cortex

被引:74
|
作者
Alexander, William H. [1 ,2 ]
Brown, Joshua W. [1 ]
机构
[1] Indiana Univ, Dept Psychol & Brain Sci, Bloomington, IN 47405 USA
[2] Univ Ghent, Dept Expt Psychol, B-9000 Ghent, Belgium
关键词
WORKING-MEMORY; COGNITIVE CONTROL; FRONTAL-CORTEX; FUNCTIONAL-ORGANIZATION; INTEGRATIVE THEORY; NEURAL MECHANISMS; DOPAMINE NEURONS; DECISION-MAKING; TERM-MEMORY; ATTENTION;
D O I
10.1162/NECO_a_00779
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anterior cingulate and dorsolateral prefrontal cortex (ACC and dlPFC, respectively) are core components of the cognitive control network. Activation of these regions is routinely observed in tasks that involve monitoring the external environment and maintaining information in order to generate appropriate responses. Despite the ubiquity of studies reporting coactivation of these two regions, a consensus on how they interact to support cognitive control has yet to emerge. In this letter, we present a new hypothesis and computational model of ACC and dlPFC. The error representation hypothesis states that multidimensional error signals generated by ACC in response to surprising outcomes are used to train representations of expected error in dlPFC, which are then associated with relevant task stimuli. Error representations maintained in dlPFC are in turn used to modulate predictive activity in ACC in order to generate better estimates of the likely outcomes of actions. We formalize the error representation hypothesis in a new computational model based on our previous model of ACC. The hierarchical error representation (HER) model of ACC/dlPFC suggests a mechanism by which hierarchically organized layers within ACC and dlPFC interact in order to solve sophisticated cognitive tasks. In a series of simulations, we demonstrate the ability of the HER model to autonomously learn to perform structured tasks in a manner comparable to human performance, and we show that the HER model outperforms current deep learning networks by an order of magnitude.
引用
收藏
页码:2354 / 2410
页数:57
相关论文
共 50 条
  • [1] Cooperation of the anterior cingulate cortex and dorsolateral prefrontal cortex for attention shifting
    Kondo, H
    Osaka, N
    Osaka, M
    NEUROIMAGE, 2004, 23 (02) : 670 - 679
  • [2] Anterior cingulate and dorsolateral prefrontal cortex involvement in preparatory attention
    Luks, TL
    Feiwell, RJ
    Miller, WL
    Simpson, GV
    NEUROIMAGE, 2001, 13 (06) : S329 - S329
  • [3] Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control
    MacDonald, AW
    Cohen, JD
    Stenger, VA
    Carter, CS
    SCIENCE, 2000, 288 (5472) : 1835 - 1838
  • [4] Hierarchical error representation in medial prefrontal cortex
    Zarr, Noah
    Brown, Joshua W.
    NEUROIMAGE, 2016, 124 : 238 - 247
  • [5] Bilingual Language Control Mechanisms in Anterior Cingulate Cortex and Dorsolateral Prefrontal Cortex: A Developmental Perspective
    D'Souza, Dean
    D'Souza, Hana
    JOURNAL OF NEUROSCIENCE, 2016, 36 (20): : 5434 - 5436
  • [6] Effects of unilateral deactivations of dorsolateral prefrontal cortex and anterior cingulate cortex on saccadic eye movements
    Koval, Michael J.
    Hutchison, R. Matthew
    Lomber, Stephen G.
    Everling, Stefan
    JOURNAL OF NEUROPHYSIOLOGY, 2014, 111 (04) : 787 - 803
  • [7] rTMS of the Left Dorsolateral Prefrontal Cortex Modulates Dopamine Release in the Ipsilateral Anterior Cingulate Cortex and Orbitofrontal Cortex
    Cho, Sang Soo
    Strafella, Antonio P.
    PLOS ONE, 2009, 4 (08):
  • [8] Dissociating control processes of dorsolateral prefrontal cortex and anterior cingulate cortex with fMRI and the Stroop task.
    MacDonald, AW
    Cohen, JD
    Stenger, VA
    Carter, CS
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2000, : 111 - 111
  • [9] Dorsolateral prefrontal cortex and anterior cingulate cortex white matter alterations in late-life depression
    Bae, Jae Nam
    MacFall, James R.
    Krishnan, K. Ranga R.
    Payne, Martha E.
    Steffens, David C.
    Taylor, Warren D.
    BIOLOGICAL PSYCHIATRY, 2006, 60 (12) : 1356 - 1363
  • [10] Motivation and Affective Judgments Differentially Recruit Neurons in the Primate Dorsolateral Prefrontal and Anterior Cingulate Cortex
    Amemori, Ken-ichi
    Amemori, Satoko
    Graybiel, Ann M.
    JOURNAL OF NEUROSCIENCE, 2015, 35 (05): : 1939 - 1953