Modulation of neural activity in frontopolar cortex drives reward-based motor learning

被引:4
|
作者
Ruiz, M. Herrojo [1 ,2 ,3 ]
Maudrich, T. [3 ]
Kalloch, B. [3 ]
Sammler, D. [4 ]
Kenville, R. [3 ]
Villringer, A. [3 ]
Sehm, B. [3 ,5 ]
Nikulin, V [2 ,3 ]
机构
[1] Goldsmiths Univ London, Psychol Dept, London, England
[2] Natl Res Univ Higher Sch Econ, Ctr Cognit & Decis Making, Moscow, Russia
[3] Max Planck Inst Human Cognit & Brain Sci, Dept Neurol, Leipzig, Germany
[4] Max Planck Inst Empir Aesthet, Res Grp Neurocognit Mus & Language, Frankfurt, Germany
[5] Univ Hosp Halle Saale, Dept Neurol, Halle, Germany
关键词
DIRECT-CURRENT STIMULATION; CORTICOSPINAL EXCITABILITY; VARIABILITY; EXPLORATION; PLASTICITY; CORTICES;
D O I
10.1038/s41598-021-98571-y
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The frontopolar cortex (FPC) contributes to tracking the reward of alternative choices during decision making, as well as their reliability. Whether this FPC function extends to reward gradients associated with continuous movements during motor learning remains unknown. We used anodal transcranial direct current stimulation (tDCS) over the right FPC to investigate its role in reward-based motor learning. Nineteen healthy human participants practiced novel sequences of finger movements on a digital piano with corresponding auditory feedback. Their aim was to use trialwise reward feedback to discover a hidden performance goal along a continuous dimension: timing. We additionally modulated the contralateral motor cortex (left M1) activity, and included a control sham stimulation. Right FPC-tDCS led to faster learning compared to lM1-tDCS and sham through regulation of motor variability. Bayesian computational modelling revealed that in all stimulation protocols, an increase in the trialwise expectation of reward was followed by greater exploitation, as shown previously. Yet, this association was weaker in lM1-tDCS suggesting a less efficient learning strategy. The effects of frontopolar stimulation were dissociated from those induced by lM1-tDCS and sham, as motor exploration was more sensitive to inferred changes in the reward tendency (volatility). The findings suggest that rFPC-tDCS increases the sensitivity of motor exploration to updates in reward volatility, accelerating reward-based motor learning.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Reward-Based Motor Adaptation Can Generalize Across Actions
    van der Kooij, Katinka
    Smeets, Jeroen B. J.
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2019, 45 (01) : 71 - 81
  • [42] Reward-Based Spatial Learning in Teens With Bulimia Nervosa
    Cyr, Marilyn
    Wang, Zhishun
    Tau, Gregory Z.
    Zhao, Guihu
    Friedl, Eve
    Stefan, Mihaela
    Terranova, Kate
    Marsh, Rachel
    JOURNAL OF THE AMERICAN ACADEMY OF CHILD AND ADOLESCENT PSYCHIATRY, 2016, 55 (11): : 962 - 971
  • [43] Effects of STN subregion stimulation on reward-based learning
    van Wouwe, N. C.
    Neimat, J.
    Claassen, D. O.
    Kanoff, K.
    Wylie, S. A.
    MOVEMENT DISORDERS, 2014, 29 : S369 - S370
  • [44] Reward-Based Learning of a Memory-Required Task Based on the Internal Dynamics of a Chaotic Neural Network
    Matsuki, Toshitaka
    Shibata, Katsunari
    NEURAL INFORMATION PROCESSING, ICONIP 2016, PT I, 2016, 9947 : 376 - 383
  • [45] Dorsal anterior cingulate cortex: A role in reward-based decision making
    Bush, G
    Vogt, BA
    Holmes, J
    Dale, AM
    Greve, D
    Jenike, MA
    Rosen, BR
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2002, 99 (01) : 523 - 528
  • [46] A Reward-Based Behavioral Platform to Measure Neural Activity during Head-Fixed Behavior
    Micallef, Andrew H.
    Takahashi, Naoya
    Larkum, Matthew E.
    Palmer, Lucy M.
    FRONTIERS IN CELLULAR NEUROSCIENCE, 2017, 11
  • [47] Counterfactual Choice and Learning in a Neural Network Centered on Human Lateral Frontopolar Cortex
    Boorman, Erie D.
    Behrens, Timothy E.
    Rushworth, Matthew F.
    PLOS BIOLOGY, 2011, 9 (06)
  • [48] Reward-based participant selection for improving federated reinforcement learning
    Lee, Woonghee
    ICT EXPRESS, 2023, 9 (05): : 803 - 808
  • [49] Reward-Based Exploration: Adaptive Control for Deep Reinforcement Learning
    Xu, Zhi-xiong
    Cao, Lei
    Chen, Xi-liang
    Li, Chen-xi
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (09): : 2409 - 2412
  • [50] Acute stroke in the basal ganglia - effects on reward-based learning
    Seidel, U. K.
    Wicking, M.
    Todica, O.
    Bellebaum, C.
    Daum, I.
    Hermann, D. M.
    JOURNAL OF NEUROLOGY, 2010, 257 : S161 - S161