Single-trial modeling separates multiple overlapping prediction errors during reward processing in human EEG

被引:22
|
作者
Hoy, Colin W. [1 ]
Steiner, Sheila C. [1 ]
Knight, Robert T. [1 ,2 ]
机构
[1] Univ Calif Berkeley, Helen Wills Neurosci Inst, Berkeley, CA 94720 USA
[2] Univ Calif Berkeley, Dept Psychol, 3210 Tolman Hall, Berkeley, CA 94720 USA
关键词
FEEDBACK-RELATED NEGATIVITY; MEDIAL FRONTAL-CORTEX; ANTERIOR CINGULATE; TEMPORAL DYNAMICS; BRAIN POTENTIALS; NEURAL SYSTEM; DOPAMINE; THETA; SENSITIVITY; ERP;
D O I
10.1038/s42003-021-02426-1
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Learning signals during reinforcement learning and cognitive control rely on valenced reward prediction errors (RPEs) and non-valenced salience prediction errors (PEs) driven by surprise magnitude. A core debate in reward learning focuses on whether valenced and non-valenced PEs can be isolated in the human electroencephalogram (EEG). We combine behavioral modeling and single-trial EEG regression to disentangle sequential PEs in an interval timing task dissociating outcome valence, magnitude, and probability. Multiple regression across temporal, spatial, and frequency dimensions characterized a spatio-tempo-spectral cascade from early valenced RPE value to non-valenced RPE magnitude, followed by outcome probability indexed by a late frontal positivity. Separating negative and positive outcomes revealed the valenced RPE value effect is an artifact of overlap between two non-valenced RPE magnitude responses: frontal theta feedback-related negativity on losses and posterior delta reward positivity on wins. These results reconcile longstanding debates on the sequence of components representing reward and salience PEs in the human EEG. Hoy et al. combine behavioral modeling and single-trial EEG regression to disentangle sequential prediction errors in an interval timing task, which dissociated outcome valence, magnitude, and probability in human participants. Their study reconciles debates on the sequence of components representing reward and salience prediction errors in the human EEG.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Single-trial modeling separates multiple overlapping prediction errors during reward processing in human EEG
    Colin W. Hoy
    Sheila C. Steiner
    Robert T. Knight
    [J]. Communications Biology, 4
  • [2] Single-Trial EEG Classification Of Similar Errors
    Wirth, Christopher
    Lacey, Eric
    Dockree, Paul
    Arvaneh, Mahnaz
    [J]. 2018 40TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2018, : 1919 - 1922
  • [3] A SINGLE-TRIAL ERP ANALYSIS OF PREDICTION ERRORS DURING VISUAL MISMATCH: A COMPUTATIONAL MODELING STUDY
    Stefanics, Gabor
    [J]. PSYCHOPHYSIOLOGY, 2017, 54 : S9 - S9
  • [4] HIERARCHICAL PREDICTION ERRORS DURING AUDITORY MISMATCH UNDER PHARMACOLOGICAL MANIPULATIONS: A COMPUTATIONAL SINGLE-TRIAL EEG ANALYSIS
    Weber, Lilian
    Diaconescu, Andreea
    Tomiello, Sara
    Schobi, Dario
    Iglesias, Sandra
    Mathys, Christoph
    Haker, Helene
    Stefanics, Gabor
    Schmidt, Andre
    Kometer, Michael
    Vollenweider, Franz X.
    Stephan, Klaas Enno
    [J]. SCHIZOPHRENIA BULLETIN, 2018, 44 : S281 - S282
  • [5] Hierarchical Prediction Errors during Auditory Mismatch under Pharmacological Manipulations: A Computational Single-Trial EEG Analysis
    Weber, Lilian A.
    Tomiello, Sara
    Schoebi, Dario
    Haker, Helene
    Stefanics, Gabor
    Diaconescu, Andreea O.
    Mathys, Christoph
    Iglesias, Sandra
    Stephan, Klaas E.
    [J]. NEUROPSYCHOBIOLOGY, 2018, 77 (03) : 138 - 139
  • [6] THE EFFECTS OF REWARD MAGNITUDE ON REWARD PROCESSING: AN AVERAGED AND SINGLE-TRIAL EVENTRELATED POTENTIAL STUDY
    Meadows, Caroline C.
    Gable, Philip A.
    Lohse, Keith R.
    Miller, Matthew W.
    [J]. PSYCHOPHYSIOLOGY, 2016, 53 : S85 - S85
  • [7] Single-trial EEG dynamics of object and face visual processing
    Rousselet, Guillaume A.
    Husk, Jesse S.
    Bennett, Patrick J.
    Sekuler, Allison B.
    [J]. NEUROIMAGE, 2007, 36 (03) : 843 - 862
  • [8] Adaptive autoregressive modeling used for single-trial EEG classification
    Schlogl, A
    Flotzinger, D
    Pfurtscheller, G
    [J]. BIOMEDIZINISCHE TECHNIK, 1997, 42 (06): : 162 - 167
  • [9] Signal Processing Challenges for Single-trial Analysis of Simultaneous EEG/fMRI
    Sajda, Paul
    [J]. 2009 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-20, 2009, : 29 - 30
  • [10] EEG-based Single-trial Detection of Errors from Multiple Error-related Brain Activity
    Shou, Guofa
    Ding, Lei
    [J]. 2016 38TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2016, : 2764 - 2767