Behavioral and Neural Properties of Social Reinforcement Learning

被引:132
|
作者
Jones, Rebecca M. [1 ]
Somerville, Leah H. [1 ]
Li, Jian [2 ]
Ruberry, Erika J. [1 ]
Libby, Victoria [1 ]
Glover, Gary [3 ]
Voss, Henning U. [4 ]
Ballon, Douglas J. [4 ]
Casey, B. J. [1 ]
机构
[1] Weill Cornell Med Coll, Sackler Inst Dev Psychobiol, New York, NY 10065 USA
[2] NYU, Dept Psychol, New York, NY 10003 USA
[3] Stanford Univ, Dept Radiol, Lucas Ctr Imaging, Stanford, CA 94305 USA
[4] Weill Cornell Med Coll, Dept Radiol, Citigrp Biomed Imaging Ctr, New York, NY 10065 USA
来源
JOURNAL OF NEUROSCIENCE | 2011年 / 31卷 / 37期
关键词
ANTERIOR CINGULATE CORTEX; TEMPORAL DIFFERENCE MODELS; MEDIAL PREFRONTAL CORTEX; VENTRAL TEGMENTAL AREA; DECISION-MAKING; ORBITOFRONTAL CORTEX; HUMAN STRIATUM; RISK-TAKING; HUMAN BRAIN; PREDICTION ERRORS;
D O I
10.1523/JNEUROSCI.2972-11.2011
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Social learning is critical for engaging in complex interactions with other individuals. Learning from positive social exchanges, such as acceptance from peers, may be similar to basic reinforcement learning. We formally test this hypothesis by developing a novel paradigm that is based on work in nonhuman primates and human imaging studies of reinforcement learning. The probability of receiving positive social reinforcement from three distinct peers was parametrically manipulated while brain activity was recorded in healthy adults using event-related functional magnetic resonance imaging. Over the course of the experiment, participants responded more quickly to faces of peers who provided more frequent positive social reinforcement, and rated them as more likeable. Modeling trial-by-trial learning showed ventral striatum and orbital frontal cortex activity correlated positively with forming expectations about receiving social reinforcement. Rostral anterior cingulate cortex activity tracked positively with modulations of expected value of the cues ( peers). Together, the findings across three levels of analysis-social preferences, response latencies, and modeling neural responses-are consistent with reinforcement learning theory and nonhuman primate electrophysiological studies of reward. This work highlights the fundamental influence of acceptance by one's peers in altering subsequent behavior.
引用
收藏
页码:13039 / 13045
页数:7
相关论文
共 50 条
  • [1] Behavioral roles of the striatonigral neural pathway in reinforcement learning
    Fukabori, Ryoji
    Kai, Nobuyuki
    Kobayashi, Kenta
    Okada, Kana
    Yasoshima, Yasunobu
    Tsutsui, Yuji
    Kobayashi, Kazuto
    [J]. NEUROSCIENCE RESEARCH, 2009, 65 : S190 - S190
  • [2] Investigating the properties of neural network representations in reinforcement learning
    Wang, Han
    Miahi, Erfan
    White, Martha
    Machado, Marlos C.
    Abbas, Zaheer
    Kumaraswamy, Raksha
    Liu, Vincent
    White, Adam
    [J]. ARTIFICIAL INTELLIGENCE, 2024, 330
  • [3] Neural Correlates of Reinforcement Learning and Social Preferences in Competitive Bidding
    van den Bos, Wouter
    Talwar, Arjun
    McClure, Samuel M.
    [J]. JOURNAL OF NEUROSCIENCE, 2013, 33 (05): : 2137 - 2146
  • [4] Antipsychotic dose modulates behavioral and neural responses to feedback during reinforcement learning in schizophrenia
    Insel, Catherine
    Reinen, Jenna
    Weber, Jochen
    Wager, Tor D.
    Jarskog, L. Fredrik
    Shohamy, Daphna
    Smith, Edward E.
    [J]. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2014, 14 (01) : 189 - 201
  • [5] Antipsychotic dose modulates behavioral and neural responses to feedback during reinforcement learning in schizophrenia
    Catherine Insel
    Jenna Reinen
    Jochen Weber
    Tor D. Wager
    L. Fredrik Jarskog
    Daphna Shohamy
    Edward E. Smith
    [J]. Cognitive, Affective, & Behavioral Neuroscience, 2014, 14 : 189 - 201
  • [6] Neural Logic Reinforcement Learning
    Jiang, Zhengyao
    Luo, Shan
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [7] Autonomous Reinforcement of Behavioral Sequences in Neural Dynamics
    Kazerounian, Sohrob
    Luciw, Matthew
    Sandamirskaya, Yulia
    Richter, Mathis
    Schmidhuber, Juergen
    Schoener, Gregor
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING AND EPIGENETIC ROBOTICS (ICDL), 2012,
  • [8] Autonomous Reinforcement of Behavioral Sequences in Neural Dynamics
    Kazerounian, Sohrob
    Luciw, Matthew
    Richter, Mathis
    Sandamirskaya, Yulia
    [J]. 2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [9] Neural regions that underlie reinforcement learning are also active for social expectancy violations
    Harris, Lasana T.
    Fiske, Susan T.
    [J]. SOCIAL NEUROSCIENCE, 2010, 5 (01) : 76 - 91
  • [10] Enriching behavioral ecology with reinforcement learning methods
    Frankenhuis, Willem E.
    Panchanathan, Karthik
    Barto, Andrew G.
    [J]. BEHAVIOURAL PROCESSES, 2019, 161 : 94 - 100