Phasic Dopamine Release in the Rat Nucleus Accumbens Symmetrically Encodes a Reward Prediction Error Term

被引:189
|
作者
Hart, Andrew S. [1 ,2 ]
Rutledge, Robb B. [3 ]
Glimcher, Paul W. [3 ]
Phillips, Paul E. M. [1 ,2 ]
机构
[1] Univ Washington, Dept Psychiat & Behav Sci, Dept Pharmacol, Seattle, WA 98195 USA
[2] Univ Washington, Grad Program Neurobiol & Behav, Seattle, WA 98195 USA
[3] NYU, Ctr Neural Sci, New York, NY 10003 USA
来源
JOURNAL OF NEUROSCIENCE | 2014年 / 34卷 / 03期
基金
美国国家卫生研究院;
关键词
NEURONS ENCODE; UNCERTAINTY; RESPONSES;
D O I
10.1523/JNEUROSCI.2489-13.2014
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Making predictions about the rewards associated with environmental stimuli and updating those predictions through feedback is an essential aspect of adaptive behavior. Theorists have argued that dopamine encodes a reward prediction error (RPE) signal that is used in such a reinforcement learning process. Recent work with fMRI has demonstrated that the BOLD signal in dopaminergic target areas meets both necessary and sufficient conditions of an axiomatic model of the RPE hypothesis. However, there has been no direct evidence that dopamine release itself also meets necessary and sufficient criteria for encoding an RPE signal. Further, the fact that dopamine neurons have low tonic firing rates that yield a limited dynamic range for encoding negative RPEs has led to significant debate about whether positive and negative prediction errors are encoded on a similar scale. To address both of these issues, we used fast-scan cyclic voltammetry to measure reward-evoked dopamine release at carbon fiber electrodes chronically implanted in the nucleus accumbens core of rats trained on a probabilistic decision-making task. We demonstrate that dopamine concentrations transmit a bidirectional RPE signal with symmetrical encoding of positive and negative RPEs. Our findings strengthen the case that changes in dopamine concentration alone are sufficient to encode the full range of RPEs necessary for reinforcement learning.
引用
收藏
页码:698 / 704
页数:7
相关论文
共 50 条
  • [1] Phasic Nucleus Accumbens Dopamine Release Encodes Effort- and Delay-Related Costs
    Day, Jeremy J.
    Jones, Joshua L.
    Wightman, R. Mark
    Carelli, Regina M.
    BIOLOGICAL PSYCHIATRY, 2010, 68 (03) : 306 - 309
  • [2] Phasic dopamine release in the rat nucleus accumbens predicts approach and avoidance performance
    Ronny N. Gentry
    Brian Lee
    Matthew R. Roesch
    Nature Communications, 7
  • [3] Phasic dopamine release in the rat nucleus accumbens predicts approach and avoidance performance
    Gentry, Ronny N.
    Lee, Brian
    Roesch, Matthew R.
    NATURE COMMUNICATIONS, 2016, 7
  • [4] Effects of nitrous oxide on dopamine release in the rat nucleus accumbens and expectation of reward
    Benturquia, N.
    Le Marec, T.
    Scherrmann, J. -M.
    Noble, F.
    NEUROSCIENCE, 2008, 155 (02) : 341 - 344
  • [5] Effects of nitrous oxide on dopamine release in the rat nucleus accumbens and expectation of reward
    Benturquial, N.
    Le Maree, T.
    Scherrmann, J. M.
    Noble, F.
    EUROPEAN NEUROPSYCHOPHARMACOLOGY, 2008, 18 : S544 - S544
  • [6] Phasic Dopamine Release in the Nucleus Accumbens Influences REM Sleep Timing
    Toth, Brandon A.
    Burgess, Christian R.
    JOURNAL OF NEUROSCIENCE, 2025, 45 (09):
  • [7] Dopamine encodes a quantiative reward prediction error for for reinforcement learning
    Glimcher, PW
    Mullette-Gillman, OA
    Bayer, HM
    Lau, B
    Rutledge, R
    NEUROPSYCHOPHARMACOLOGY, 2005, 30 : S27 - S27
  • [8] EFFECTS OF AMYLOID-β AND LITHIUM ON THE PHASIC DOPAMINE RELEASE IN THE NUCLEUS ACCUMBENS SHELL
    Mukhin, V. N.
    Borovets, I. R.
    Sizov, V. V.
    Pavlov, K., I
    Klimenko, V. M.
    ZHURNAL VYSSHEI NERVNOI DEYATELNOSTI IMENI I P PAVLOVA, 2020, 70 (04) : 488 - 499
  • [9] β-Amyloid and Lithium Affect the Magnitude of Phasic Dopamine Release in the Shell of the Nucleus Accumbens
    Mukhin V.N.
    Borovets I.R.
    Sizov V.V.
    Pavlov K.I.
    Klimenko V.M.
    Neuroscience and Behavioral Physiology, 2021, 51 (2) : 201 - 208
  • [10] Phasic Nucleus Accumbens Dopamine Encodes Risk-Based Decision-Making Behavior
    Sugam, Jonathan A.
    Day, Jeremy J.
    Wightman, R. Mark
    Carelli, Regina M.
    BIOLOGICAL PSYCHIATRY, 2012, 71 (03) : 199 - 205