Learning from Sensory and Reward Prediction Errors during Motor Adaptation

被引:309
|
作者
Izawa, Jun [1 ,2 ]
Shadmehr, Reza [1 ]
机构
[1] Johns Hopkins Sch Med, Dept Biomed Engn, Baltimore, MD USA
[2] Univ Electrocommun, Dept Human Media Syst, Tokyo, Japan
基金
美国国家卫生研究院;
关键词
SIGNAL-DEPENDENT NOISE; BASAL GANGLIA; INTERNAL-MODELS; MOVEMENT VARIABILITY; HUNTINGTONS-DISEASE; PARKINSONS-DISEASE; NEURAL MECHANISMS; DECISION-MAKING; CEREBELLUM; MEMORY;
D O I
10.1371/journal.pcbi.1002012
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Voluntary motor commands produce two kinds of consequences. Initially, a sensory consequence is observed in terms of activity in our primary sensory organs ( e. g., vision, proprioception). Subsequently, the brain evaluates the sensory feedback and produces a subjective measure of utility or usefulness of the motor commands ( e. g., reward). As a result, comparisons between predicted and observed consequences of motor commands produce two forms of prediction error. How do these errors contribute to changes in motor commands? Here, we considered a reach adaptation protocol and found that when high quality sensory feedback was available, adaptation of motor commands was driven almost exclusively by sensory prediction errors. This form of learning had a distinct signature: as motor commands adapted, the subjects altered their predictions regarding sensory consequences of motor commands, and generalized this learning broadly to neighboring motor commands. In contrast, as the quality of the sensory feedback degraded, adaptation of motor commands became more dependent on reward prediction errors. Reward prediction errors produced comparable changes in the motor commands, but produced no change in the predicted sensory consequences of motor commands, and generalized only locally. Because we found that there was a within subject correlation between generalization patterns and sensory remapping, it is plausible that during adaptation an individual's relative reliance on sensory vs. reward prediction errors could be inferred. We suggest that while motor commands change because of sensory and reward prediction errors, only sensory prediction errors produce a change in the neural system that predicts sensory consequences of motor commands.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Roles of reward and sensory perdition errors in motor learning
    Izawa, Jun
    Shadmehr, Reza
    NEUROSCIENCE RESEARCH, 2010, 68 : E107 - E108
  • [2] Reward prediction errors, not sensory prediction errors, play a major role in model selection in human reinforcement learning
    Wu, Yihao
    Morita, Masahiko
    Izawa, Jun
    NEURAL NETWORKS, 2022, 154 : 109 - 121
  • [3] Hierarchical Prediction Errors in Midbrain and Basal Forebrain during Sensory Learning
    Iglesias, Sandra
    Mathys, Christoph
    Brodersen, Kay H.
    Kasper, Lars
    Piccirelli, Marco
    den Ouden, Hanneke E. M.
    Stephan, Klaas E.
    NEURON, 2013, 80 (02) : 519 - 530
  • [4] Sensory prediction errors, not performance errors, update memories in visuomotor adaptation
    Kangwoo Lee
    Youngmin Oh
    Jun Izawa
    Nicolas Schweighofer
    Scientific Reports, 8
  • [5] Sensory prediction errors, not performance errors, update memories in visuomotor adaptation
    Lee, Kangwoo
    Oh, Youngmin
    Izawa, Jun
    Schweighofer, Nicolas
    SCIENTIFIC REPORTS, 2018, 8
  • [6] Minimizing Precision-Weighted Sensory Prediction Errors via Memory Formation and Switching in Motor Adaptation
    Oh, Youngmin
    Schweighofer, Nicolas
    JOURNAL OF NEUROSCIENCE, 2019, 39 (46): : 9237 - 9250
  • [7] Signed reward prediction errors drive declarative learning
    De Loof, Esther
    Ergo, Kate
    Naert, Lien
    Janssens, Clio
    Talsma, Durk
    Van Opstal, Filip
    Verguts, Tom
    PLOS ONE, 2018, 13 (01):
  • [8] Oscillatory signatures of reward prediction errors in declarative learning
    Ergo, Kate
    De Loof, Esther
    Janssens, Clio
    Verguts, Tom
    NEUROIMAGE, 2019, 186 : 137 - 145
  • [9] Emotion and reward are dissociable from error during motor learning
    Sara B. Festini
    Stephanie D. Preston
    Patricia A. Reuter-Lorenz
    Rachael D. Seidler
    Experimental Brain Research, 2016, 234 : 1385 - 1394
  • [10] Emotion and reward are dissociable from error during motor learning
    Festini, Sara B.
    Preston, Stephanie D.
    Reuter-Lorenz, Patricia A.
    Seidler, Rachael D.
    EXPERIMENTAL BRAIN RESEARCH, 2016, 234 (06) : 1385 - 1394