Semantic processing during continuous speech production: an analysis from eye movements and EEG

被引:0
|
作者
Huang, Jinfeng [1 ,2 ]
Zhang, Gaoyan [3 ]
Dang, Jianwu [3 ]
Chen, Yu [4 ]
Miyamoto, Shoko [1 ]
机构
[1] Univ Tsukuba, Fac Human Sci, Ibaraki, Japan
[2] NeuralEcho Technol Co Ltd, Res Inst, Beijing, Peoples R China
[3] Tianjin Univ, Coll Intelligence & Comp, Tianjin Key Lab Cognit Comp & Applicat, Tianjin, Peoples R China
[4] Tianjin Univ Technol, Tech Coll Deaf, Tianjin, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
semantic processing; eye-voice span; continuous speech production; brain network; speech planning; VENTRAL STREAMS; WORD PRODUCTION; DYNAMICS; DORSAL; COMPONENTS; ATTENTION; LANGUAGE; MODEL;
D O I
10.3389/fnhum.2023.1253211
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Introduction: Speech production involves neurological planning and articulatory execution. How speakers prepare for articulation is a significant aspect of speech production research. Previous studies have focused on isolated words or short phrases to explore speech planning mechanisms linked to articulatory behaviors, including investigating the eye-voice span (EVS) during text reading. However, these experimental paradigms lack real-world speech process replication. Additionally, our understanding of the neurological dimension of speech planning remains limited. Methods: This study examines speech planning mechanisms during continuous speech production by analyzing behavioral (eye movement and speech) and neurophysiological (EEG) data within a continuous speech production task. The study specifically investigates the influence of semantic consistency on speech planning and the occurrence of "look ahead" behavior. Results: The outcomes reveal the pivotal role of semantic coherence in facilitating fluent speech production. Speakers access lexical representations and phonological information before initiating speech, emphasizing the significance of semantic processing in speech planning. Behaviorally, the EVS decreases progressively during continuous reading of regular sentences, with a slight increase for non-regular sentences. Moreover, eye movement pattern analysis identifies two distinct speech production modes, highlighting the importance of semantic comprehension and prediction in higher-level lexical processing. Neurologically, the dual pathway model of speech production is supported, indicating a dorsal information flow and frontal lobe involvement. The brain network linked to semantic understanding exhibits a negative correlation with semantic coherence, with significant activation during semantic incoherence and suppression in regular sentences. Discussion: The study's findings enhance comprehension of speech planning mechanisms and offer insights into the role of semantic coherence in continuous speech production. Furthermore, the research methodology establishes a valuable framework for future investigations in this domain.
引用
下载
收藏
页数:13
相关论文
共 50 条
  • [31] Eye movements and information processing during reading - Preface
    Radach, R
    Kennedy, A
    Rayner, K
    EUROPEAN JOURNAL OF COGNITIVE PSYCHOLOGY, 2004, 16 (1-2): : 1 - 2
  • [32] Eye movements and parafoveal processing during reading in Korean
    Kim, Young-Suk
    Radach, Ralph
    Vorstius, Christian
    READING AND WRITING, 2012, 25 (05) : 1053 - 1078
  • [33] Inhibition of attended processing during saccadic eye movements
    James R. Brockmole
    Laura A. Carlson
    David E. Irwin
    Perception & Psychophysics, 2002, 64 : 867 - 881
  • [34] Eye movements and parafoveal processing during reading in Korean
    Young-Suk Kim
    Ralph Radach
    Christian Vorstius
    Reading and Writing, 2012, 25 : 1053 - 1078
  • [35] Inhibition of attended processing during saccadic eye movements
    Brockmole, JR
    Carlson, LA
    Irwin, DE
    PERCEPTION & PSYCHOPHYSICS, 2002, 64 (06): : 867 - 881
  • [36] Attention and semantic processing during speech: An fMRI study
    Rama, Pia
    Relander-Syrjanen, Kristiina
    Carlson, Synnove
    Salonen, Oili
    Kujala, Teija
    BRAIN AND LANGUAGE, 2012, 122 (02) : 114 - 119
  • [37] Effects of irrelevant background speech on eye movements during reading
    Yan, Guoli
    Meng, Zhu
    Liu, Nina
    He, Liyuan
    Paterson, Kevin B.
    QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2018, 71 (06): : 1270 - 1275
  • [38] The processing of metonymy: Evidence from eye movements
    Frisson, S
    Pickering, MJ
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 1999, 25 (06) : 1366 - 1383
  • [39] Co-registration of EEG and eye movements: Effects of context on stimulus processing
    Gaspar, C.
    Pernet, C.
    Rousselet, G.
    Sereno, S.
    PERCEPTION, 2011, 40 : 192 - 192
  • [40] Semantic parafoveal processing in natural reading: Insight from fixation-related potentials & eye movements
    Antunez, Martin
    Milligan, Sara
    Andres Hernandez-Cabrera, Juan
    Barber, Horacio A.
    Schotter, Elizabeth R.
    PSYCHOPHYSIOLOGY, 2022, 59 (04)