Goal -oriented and habitual decisions: Neural signatures of model -based and model -free learning

被引:29
|
作者
Huang, Yi [1 ]
Yaple, Zachary A. [2 ]
Yu, Rongjun [1 ,2 ]
机构
[1] Natl Univ Singapore, NUS Grad Sch Integrat Sci & Engn, Singapore, Singapore
[2] Natl Univ Singapore, Dept Psychol, Block AS4,02-17,9 Arts Link, Singapore 117570, Singapore
基金
英国医学研究理事会;
关键词
VENTROMEDIAL PREFRONTAL CORTEX; COGNITIVE INFLEXIBILITY; NUCLEUS-ACCUMBENS; PREDICTION ERROR; DISSOCIATION; METAANALYSIS; HUMANS; TASK; HIPPOCAMPUS; ACTIVATION;
D O I
10.1016/j.neuroimage.2020.116834
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Human decision-making is mainly driven by two fundamental learning processes: a slow, deliberative, goal-directed model-based process that maps out the potential outcomes of all options and a rapid habitual model-free process that enables reflexive repetition of previously successful choices. Although many model-informed neuroimaging studies have examined the neural correlates of model-based and model-free learning, the concordant activity among these two processes remains unclear. We used quantitative meta-analyses of functional magnetic resonance imaging experiments to identify the concordant activity pertaining to model-based and model-free learning over a range of reward-related paradigms. We found that: 1) both processes yielded concordant ventral striatum activity, 2) model-based learning activated the medial prefrontal cortex and orbital frontal cortex, and 3) model-free learning specifically activated the left globus pallidus and right caudate head. Our findings suggest that model-free and model-based decision making engage overlapping yet distinct neural regions. These stereotaxic maps improve our understanding of how deliberative goal-directed and reflexive habitual learning are implemented in the brain. © 2020 The Author(s)
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Requirements Engineering Model: Role Based Goal Oriented Model
    Sandfreni, S. S., I
    Surendro, Ir. Kridanto
    [J]. 2016 INTERNATIONAL CONFERENCE ON DESIGN ENGINEERING AND SCIENCE (ICDES 2016), 2016, 52
  • [2] GOAL PROGRAMMING MODEL FOR PURCHASING DECISIONS
    GLEASON, JM
    [J]. OPERATIONS RESEARCH, 1975, 23 : B404 - B404
  • [3] A Multi-Task Based Neural Model to Simulate Users in Goal-Oriented Dialogue Systems
    Kim, To Eun
    Lipani, Aldo
    [J]. PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 2115 - 2119
  • [4] Goal-oriented, model-based drug regimens
    Jelliffe, RW
    Maire, P
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2001, 31 (03) : 145 - 146
  • [5] A Goal Programming-Based Methodology for Machine Learning Model Selection Decisions: A Predictive Maintenance Application
    Mallidis, Ioannis
    Yakavenka, Volha
    Konstantinidis, Anastasios
    Sariannidis, Nikolaos
    [J]. MATHEMATICS, 2021, 9 (19)
  • [6] Regularized Neural User Model for Goal-Oriented Spoken Dialogue Systems
    Serras, Manex
    Ines Torres, Maria
    del Pozo, Arantza
    [J]. ADVANCED SOCIAL INTERACTION WITH AGENTS, 2019, 510 : 235 - 245
  • [7] A goal oriented attention guidance model
    Navalpakkam, V
    Itti, L
    [J]. BIOLOGICALLY MOTIVATED COMPUTER VISION, PROCEEDINGS, 2002, 2525 : 453 - 461
  • [8] LEARNING UNDER UNCERTAINTY: NEURAL MARKERS OF MODEL-FREE AND MODEL-BASED LEARNING IN PROBABILISTIC ENVIRONMENTS
    Wurm, Franz
    Ernst, Benjamin
    Steinhauser, Marco
    [J]. PSYCHOPHYSIOLOGY, 2017, 54 : S127 - S127
  • [9] Neural Computations Underlying Arbitration between Model-Based and Model-free Learning
    Lee, Sang Wan
    Shimojo, Shinsuke
    O'Doherty, John P.
    [J]. NEURON, 2014, 81 (03) : 687 - 699
  • [10] Model-Based and Model-Free Decisions in Alcohol Dependence
    Sebold, Miriam
    Deserno, Lorenz
    Nebe, Stefan
    Schad, Daniel J.
    Garbusow, Maria
    Haegele, Claudia
    Keller, Juergen
    Juenger, Elisabeth
    Kathmann, Norbert
    Smolka, Michael
    Rapp, Michael A.
    Schlagenhauf, Florian
    Heinz, Andreas
    Huys, Quentin J. M.
    [J]. NEUROPSYCHOBIOLOGY, 2014, 70 (02) : 122 - 131