Semantic processing during continuous speech production: an analysis from eye movements and EEG

被引:0
|
作者
Huang, Jinfeng [1 ,2 ]
Zhang, Gaoyan [3 ]
Dang, Jianwu [3 ]
Chen, Yu [4 ]
Miyamoto, Shoko [1 ]
机构
[1] Univ Tsukuba, Fac Human Sci, Ibaraki, Japan
[2] NeuralEcho Technol Co Ltd, Res Inst, Beijing, Peoples R China
[3] Tianjin Univ, Coll Intelligence & Comp, Tianjin Key Lab Cognit Comp & Applicat, Tianjin, Peoples R China
[4] Tianjin Univ Technol, Tech Coll Deaf, Tianjin, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
semantic processing; eye-voice span; continuous speech production; brain network; speech planning; VENTRAL STREAMS; WORD PRODUCTION; DYNAMICS; DORSAL; COMPONENTS; ATTENTION; LANGUAGE; MODEL;
D O I
10.3389/fnhum.2023.1253211
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Introduction: Speech production involves neurological planning and articulatory execution. How speakers prepare for articulation is a significant aspect of speech production research. Previous studies have focused on isolated words or short phrases to explore speech planning mechanisms linked to articulatory behaviors, including investigating the eye-voice span (EVS) during text reading. However, these experimental paradigms lack real-world speech process replication. Additionally, our understanding of the neurological dimension of speech planning remains limited. Methods: This study examines speech planning mechanisms during continuous speech production by analyzing behavioral (eye movement and speech) and neurophysiological (EEG) data within a continuous speech production task. The study specifically investigates the influence of semantic consistency on speech planning and the occurrence of "look ahead" behavior. Results: The outcomes reveal the pivotal role of semantic coherence in facilitating fluent speech production. Speakers access lexical representations and phonological information before initiating speech, emphasizing the significance of semantic processing in speech planning. Behaviorally, the EVS decreases progressively during continuous reading of regular sentences, with a slight increase for non-regular sentences. Moreover, eye movement pattern analysis identifies two distinct speech production modes, highlighting the importance of semantic comprehension and prediction in higher-level lexical processing. Neurologically, the dual pathway model of speech production is supported, indicating a dorsal information flow and frontal lobe involvement. The brain network linked to semantic understanding exhibits a negative correlation with semantic coherence, with significant activation during semantic incoherence and suppression in regular sentences. Discussion: The study's findings enhance comprehension of speech planning mechanisms and offer insights into the role of semantic coherence in continuous speech production. Furthermore, the research methodology establishes a valuable framework for future investigations in this domain.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Shallow semantic processing of text: Evidence from eye movements
    Daneman, Meredyth
    Lennertz, Tracy
    Hannon, Brenda
    [J]. LANGUAGE AND COGNITIVE PROCESSES, 2007, 22 (01): : 83 - 105
  • [2] Eye movements during text reading align with the rate of speech production
    Benjamin Gagl
    Klara Gregorova
    Julius Golch
    Stefan Hawelka
    Jona Sassenhagen
    Alessandro Tavano
    David Poeppel
    Christian J. Fiebach
    [J]. Nature Human Behaviour, 2022, 6 : 429 - 442
  • [3] Eye movements during text reading align with the rate of speech production
    Gagl, Benjamin
    Gregorova, Klara
    Golch, Julius
    Hawelka, Stefan
    Sassenhagen, Jona
    Tavano, Alessandro
    Poeppel, David
    Fiebach, Christian J.
    [J]. NATURE HUMAN BEHAVIOUR, 2022, 6 (03) : 429 - +
  • [4] PRONOUN ASSIGNMENT AND SEMANTIC INTEGRATION DURING READING - EYE-MOVEMENTS AND IMMEDIACY OF PROCESSING
    EHRLICH, K
    RAYNER, K
    [J]. JOURNAL OF VERBAL LEARNING AND VERBAL BEHAVIOR, 1983, 22 (01): : 75 - 87
  • [5] From eye to mouth: Eye movements before and during sentence production
    Dobel, C
    [J]. JOURNAL OF PSYCHOPHYSIOLOGY, 2003, 17 (03) : 146 - 146
  • [6] To Name or Not to Name: Eye Movements and Semantic Processing in RAN and Reading
    Chau, Luan Tuyen
    Vulchanova, Mila Dimitrova
    Talcott, Joel B.
    [J]. BRAIN SCIENCES, 2021, 11 (07)
  • [7] Revealing the Dynamic Brain Connectivity from Perception of Speech Sound to Semantic Processing by EEG
    Zhang, Gaoyan
    Si, Yuke
    Dang, Jianwu
    [J]. NEUROSCIENCE, 2019, 415 : 70 - 76
  • [8] Functional heterogeneity within the default network during semantic processing and speech production
    Seghier, Mohamed L.
    Price, Cathy J.
    [J]. FRONTIERS IN PSYCHOLOGY, 2012, 3
  • [9] Orthographic, Semantic, and Contextual Influences on Initial Processing and Learning of Novel Words During Reading: Evidence From Eye Movements
    Yi, Wei
    Lu, Shiyi
    DeKeyser, Robert
    [J]. CHINESE JOURNAL OF APPLIED LINGUISTICS, 2022, 45 (02) : 194 - 219
  • [10] Lexical processing during saccadic eye movements
    Irwin, DE
    [J]. COGNITIVE PSYCHOLOGY, 1998, 36 (01) : 1 - 27