Phasic Dopamine Release in the Rat Nucleus Accumbens Symmetrically Encodes a Reward Prediction Error Term

被引:189
|
作者
Hart, Andrew S. [1 ,2 ]
Rutledge, Robb B. [3 ]
Glimcher, Paul W. [3 ]
Phillips, Paul E. M. [1 ,2 ]
机构
[1] Univ Washington, Dept Psychiat & Behav Sci, Dept Pharmacol, Seattle, WA 98195 USA
[2] Univ Washington, Grad Program Neurobiol & Behav, Seattle, WA 98195 USA
[3] NYU, Ctr Neural Sci, New York, NY 10003 USA
来源
JOURNAL OF NEUROSCIENCE | 2014年 / 34卷 / 03期
基金
美国国家卫生研究院;
关键词
NEURONS ENCODE; UNCERTAINTY; RESPONSES;
D O I
10.1523/JNEUROSCI.2489-13.2014
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Making predictions about the rewards associated with environmental stimuli and updating those predictions through feedback is an essential aspect of adaptive behavior. Theorists have argued that dopamine encodes a reward prediction error (RPE) signal that is used in such a reinforcement learning process. Recent work with fMRI has demonstrated that the BOLD signal in dopaminergic target areas meets both necessary and sufficient conditions of an axiomatic model of the RPE hypothesis. However, there has been no direct evidence that dopamine release itself also meets necessary and sufficient criteria for encoding an RPE signal. Further, the fact that dopamine neurons have low tonic firing rates that yield a limited dynamic range for encoding negative RPEs has led to significant debate about whether positive and negative prediction errors are encoded on a similar scale. To address both of these issues, we used fast-scan cyclic voltammetry to measure reward-evoked dopamine release at carbon fiber electrodes chronically implanted in the nucleus accumbens core of rats trained on a probabilistic decision-making task. We demonstrate that dopamine concentrations transmit a bidirectional RPE signal with symmetrical encoding of positive and negative RPEs. Our findings strengthen the case that changes in dopamine concentration alone are sufficient to encode the full range of RPEs necessary for reinforcement learning.
引用
收藏
页码:698 / 704
页数:7
相关论文
共 50 条
  • [41] Direct effect of nicotine on mesolimbic dopamine release in rat nucleus accumbens shell
    Kleijn, J.
    Folgering, J. H. A.
    van der Hart, M. C. G.
    Rollema, H.
    Cremers, T. I. F. H.
    Westerink, B. H. C.
    NEUROSCIENCE LETTERS, 2011, 493 (1-2) : 55 - 58
  • [42] Preferential enhancement of dopamine transmission within the nucleus accumbens shell by cocaine is attributable to a direct increase in phasic dopamine release events
    Aragona, Brandon J.
    Cleaveland, Nathan A.
    Stuber, Garret D.
    Day, Jeremy J.
    Carelli, Regina M.
    Wightman, R. Mark
    JOURNAL OF NEUROSCIENCE, 2008, 28 (35): : 8821 - 8831
  • [43] FACILITATION OF GABA RELEASE BY NEUROTENSIN IS ASSOCIATED WITH A REDUCTION OF DOPAMINE RELEASE IN RAT NUCLEUS-ACCUMBENS
    TANGANELLI, S
    OCONNOR, WT
    FERRARO, L
    BIANCHI, C
    BEANI, L
    UNGERSTEDT, U
    FUXE, K
    NEUROSCIENCE, 1994, 60 (03) : 649 - 657
  • [44] Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine
    Salamone, JD
    Correa, M
    Mingote, SM
    Weber, SM
    CURRENT OPINION IN PHARMACOLOGY, 2005, 5 (01) : 34 - 41
  • [45] Dopamine reward prediction error coding
    Schultz, Wolfram
    DIALOGUES IN CLINICAL NEUROSCIENCE, 2016, 18 (01) : 23 - 32
  • [46] Neuropharmacological mechanisms of drug reward: Beyond dopamine in the nucleus accumbens
    Bardo, MT
    CRITICAL REVIEWS IN NEUROBIOLOGY, 1998, 12 (1-2): : 37 - 67
  • [47] Dopamine, reward prediction error, and economics
    Caplin, Andrew
    Dean, Mark
    QUARTERLY JOURNAL OF ECONOMICS, 2008, 123 (02): : 663 - 701
  • [48] Phasic Dopamine Release in the Nucleus Accumbens in Response to Pro-Social 50 kHz Ultrasonic Vocalizations in Rats
    Willuhn, Ingo
    Tose, Amanda
    Wanat, Matthew J.
    Hart, Andrew S.
    Hollon, Nick G.
    Phillips, Paul E. M.
    Schwarting, Rainer K. W.
    Woehr, Markus
    JOURNAL OF NEUROSCIENCE, 2014, 34 (32): : 10616 - 10623
  • [49] Nucleus accumbens dopamine release is necessary and sufficient to promote the behavioral response to reward-predictive cues
    Nicola, SM
    Taha, SA
    Kim, SW
    Fields, HL
    NEUROSCIENCE, 2005, 135 (04) : 1025 - 1033
  • [50] Suppression of reward-induced dopamine release in the nucleus accumbens of the chronic mild stress model rats
    Minami, Saki
    Satoyoshi, Hiroshi
    Ide, Soichiro
    Minami, Masabumi
    INTERNATIONAL JOURNAL OF NEUROPSYCHOPHARMACOLOGY, 2016, 19 : 95 - 95