Prosocial learning: Model-based or model-free?

被引:0
|
作者
Navidi, Parisa [1 ]
Saeedpour, Sepehr [2 ]
Ershadmanesh, Sara [3 ,4 ]
Hossein, Mostafa Miandari [5 ]
Bahrami, Bahador [6 ]
机构
[1] Inst Cognit Sci Studies, Dept Cognit Psychol, Tehran, Iran
[2] Univ Tehran, Dept Elect & Comp Engn, Tehran, Iran
[3] Inst Res Fundamental Sci, Sch Cognit Sci, Tehran, Iran
[4] MPI Biol Cybernet, Dept Computat Neurosci, Tubingen, Germany
[5] Univ Toronto, Dept Psychol, Toronto, ON, Canada
[6] Ludwig Maximilians Univ Munchen, Dept Gen Psychol & Educ, Crowd Cognit Grp, Munich, Germany
来源
PLOS ONE | 2023年 / 18卷 / 06期
基金
欧洲研究理事会;
关键词
DECISION-MAKING; SOCIAL ANXIETY; SELF; CHOICE; OTHERS; PERSPECTIVE; MECHANISMS; PREDICTION; SYSTEMS; HABITS;
D O I
10.1371/journal.pone.0287563
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Prosocial learning involves the acquisition of knowledge and skills necessary for making decisions that benefit others. We asked if, in the context of value-based decision-making, there is any difference between learning strategies for oneself vs. for others. We implemented a 2-step reinforcement learning paradigm in which participants learned, in separate blocks, to make decisions for themselves or for a present other confederate who evaluated their performance. We replicated the canonical features of the model-based and model-free reinforcement learning in our results. The behaviour of the majority of participants was best explained by a mixture of the model-based and model-free control, while most participants relied more heavily on MB control, and this strategy enhanced their learning success. Regarding our key self-other hypothesis, we did not find any significant difference between the behavioural performances nor in the model-based parameters of learning when comparing self and other conditions.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Model-based decision making and model-free learning
    Drummond, Nicole
    Niv, Yael
    [J]. CURRENT BIOLOGY, 2020, 30 (15) : R860 - R865
  • [2] Model-Free and Model-Based Active Learning for Regression
    O'Neill, Jack
    Delany, Sarah Jane
    MacNamee, Brian
    [J]. ADVANCES IN COMPUTATIONAL INTELLIGENCE SYSTEMS, 2017, 513 : 375 - 386
  • [3] Model-based and Model-free Reinforcement Learning for Visual Servoing
    Farahmand, Amir Massoud
    Shademan, Azad
    Jagersand, Martin
    Szepesvari, Csaba
    [J]. ICRA: 2009 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-7, 2009, : 4135 - 4142
  • [4] Model-Based and Model-Free Mechanisms of Human Motor Learning
    Haith, Adrian M.
    Krakauer, John W.
    [J]. PROGRESS IN MOTOR CONTROL: NEURAL, COMPUTATIONAL AND DYNAMIC APPROACHES, 2013, 782 : 1 - 21
  • [5] Model-based learning retrospectively updates model-free values
    Max Doody
    Maaike M. H. Van Swieten
    Sanjay G. Manohar
    [J]. Scientific Reports, 12
  • [6] Model-based learning retrospectively updates model-free values
    Doody, Max
    Van Swieten, Maaike M. H.
    Manohar, Sanjay G.
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [7] Expert Initialized Hybrid Model-Based and Model-Free Reinforcement Learning
    Langaa, Jeppe
    Sloth, Christoffer
    [J]. 2023 EUROPEAN CONTROL CONFERENCE, ECC, 2023,
  • [8] Model-Based and Model-Free Replay Mechanisms for Reinforcement Learning in Neurorobotics
    Massi, Elisa
    Barthelemy, Jeanne
    Mailly, Juliane
    Dromnelle, Remi
    Canitrot, Julien
    Poniatowski, Esther
    Girard, Benoit
    Khamassi, Mehdi
    [J]. FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [10] Model-based and Model-free Learning: A Trans-diagnostic Approach
    Voon, Valerie
    [J]. BIOLOGICAL PSYCHIATRY, 2015, 77 (09) : 39S - 39S