Goal -oriented and habitual decisions: Neural signatures of model -based and model -free learning

被引:29
|
作者
Huang, Yi [1 ]
Yaple, Zachary A. [2 ]
Yu, Rongjun [1 ,2 ]
机构
[1] Natl Univ Singapore, NUS Grad Sch Integrat Sci & Engn, Singapore, Singapore
[2] Natl Univ Singapore, Dept Psychol, Block AS4,02-17,9 Arts Link, Singapore 117570, Singapore
基金
英国医学研究理事会;
关键词
VENTROMEDIAL PREFRONTAL CORTEX; COGNITIVE INFLEXIBILITY; NUCLEUS-ACCUMBENS; PREDICTION ERROR; DISSOCIATION; METAANALYSIS; HUMANS; TASK; HIPPOCAMPUS; ACTIVATION;
D O I
10.1016/j.neuroimage.2020.116834
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Human decision-making is mainly driven by two fundamental learning processes: a slow, deliberative, goal-directed model-based process that maps out the potential outcomes of all options and a rapid habitual model-free process that enables reflexive repetition of previously successful choices. Although many model-informed neuroimaging studies have examined the neural correlates of model-based and model-free learning, the concordant activity among these two processes remains unclear. We used quantitative meta-analyses of functional magnetic resonance imaging experiments to identify the concordant activity pertaining to model-based and model-free learning over a range of reward-related paradigms. We found that: 1) both processes yielded concordant ventral striatum activity, 2) model-based learning activated the medial prefrontal cortex and orbital frontal cortex, and 3) model-free learning specifically activated the left globus pallidus and right caudate head. Our findings suggest that model-free and model-based decision making engage overlapping yet distinct neural regions. These stereotaxic maps improve our understanding of how deliberative goal-directed and reflexive habitual learning are implemented in the brain. © 2020 The Author(s)
引用
收藏
页数:8
相关论文
共 50 条
  • [31] NORMATIVE MODEL FOR PROBLEM-ORIENTED AND GOAL-ORIENTED THERAPEUTIC INTERVENTION
    MOSER, AJ
    RYBACK, RS
    [J]. INTERNATIONAL JOURNAL OF MENTAL HEALTH, 1977, 6 (02) : 89 - 109
  • [32] Evolving a Risk-Free, Requirement Centric and Goal Oriented Software Development Life Cycle Model
    Khatri, Sunil Kumar
    Garg, Ayushi
    [J]. 2015 4TH INTERNATIONAL CONFERENCE ON RELIABILITY, INFOCOM TECHNOLOGIES AND OPTIMIZATION (ICRITO) (TRENDS AND FUTURE DIRECTIONS), 2015,
  • [33] A Risk-Oriented Model for Factor Timing Decisions
    Miller, Keith L.
    Li, Hong
    Zhou, Tiffany G.
    Giamouridis, Daniel
    [J]. JOURNAL OF PORTFOLIO MANAGEMENT, 2015, 41 (03): : 46 - 58
  • [34] Deep Learning based Situated Goal -oriented Dialogue Systems
    Hakkani-Tur, Dilek
    [J]. 19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 1308 - 1308
  • [35] Entrainable Neural Conversation Model Based on Reinforcement Learning
    Kawano, Seiya
    Mizukami, Masahiro
    Yoshino, Koichiro
    Nakamura, Satoshi
    [J]. IEEE ACCESS, 2020, 8 : 178283 - 178294
  • [36] An agent reinforcement learning model based on neural networks
    Tang, Liang Gui
    An, Bo
    Cheng, Dai Jie
    [J]. BIO-INSPIRED COMPUTATIONAL INTELLIGENCE AND APPLICATIONS, 2007, 4688 : 117 - +
  • [37] Learning Curve Model for Torpedo Based on Neural Network
    Zhao, Min-quan
    Liang, Qing-wei
    Jiang, Shanshan
    Chen, Ping
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2011, PT II, 2011, 6676 : 159 - +
  • [38] Operationalizing the Chronic Care Model with Goal-Oriented Care
    Agnes Grudniewicz
    Carolyn Steele Gray
    Pauline Boeckxstaens
    Jan De Maeseneer
    James Mold
    [J]. The Patient - Patient-Centered Outcomes Research, 2023, 16 : 569 - 578
  • [39] A goal-oriented trust model for virtual organization creation
    Mun, Jungtae
    Shin, Moonsoo
    Jung, Mooyoung
    [J]. JOURNAL OF INTELLIGENT MANUFACTURING, 2011, 22 (03) : 345 - 354
  • [40] Model adaptivity for goal-oriented inference using adjoints
    Li, Harriet
    Garg, Vikram V.
    Willcox, Karen
    [J]. COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2018, 331 : 1 - 22