Speech Prosody and Eye Movements in Processing Discourse Information: A Preliminary Study in Mandarin Chinese

被引:0
|
作者
Chen, Ying [1 ]
Xiao, Wentao [1 ]
Cui, Jie [1 ]
Xu, Hanyu [1 ]
机构
[1] Nanjing Univ Sci & Technol, Nanjing, Peoples R China
关键词
REPETITION; DURATIONS; WORDS;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This study investigates variations in speech prosody and eye movements and their potential correlations in processing discourse information of map direction in Mandarin Chinese. A production experiment was conducted to collect mean duration, F0, intensity of target words in speech prosody and fixation counts and fixation duration of target areas of interest in eye movements for statistical analyses. The results show fixation counts, fixation duration, and syllable duration of the target words decreased, syllable intensity increased, but syllable pitch remained intact as the information became old to the speaker in the discourse. Prosodic reduction of duration, F0, and intensity was found in speech repetition and in the processing of old information.
引用
收藏
页码:1342 / 1346
页数:5
相关论文
共 50 条
  • [1] Processing causal structure sentences in Mandarin Chinese: an eye movements study
    Gao, Lei
    Li, Lin
    Gao, Xiaolei
    Sui, Xue
    PEERJ, 2024, 12
  • [2] The Automatic Analysis by Synthesis of Speech Prosody with Preliminary Results on Mandarin Chinese
    Hirst, Daniel
    2012 8TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING, 2012, : XXIV - XXIV
  • [3] Prosody and information structure in a tone language: an investigation of Mandarin Chinese
    Ouyang, Iris Chuoying
    Kaiser, Elsi
    LANGUAGE COGNITION AND NEUROSCIENCE, 2015, 30 (1-2) : 57 - 72
  • [4] Prosody for Mandarin Speech Recognition: a Comparative Study of Read and Spontaneous Speech
    Yeung, Yu Ting
    Qian, Yao
    Lee, Tan
    Soong, Frank K.
    INTERSPEECH 2008: 9TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2008, VOLS 1-5, 2008, : 1133 - +
  • [5] A Quantitative Study on Information Contribution of Prosody Phrase Boundaries in Chinese Speech
    Zhang, Jinsong
    Li, Wei
    Xie, Yanlu
    Cao, Wen
    PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON SPEECH PROSODY, VOLS I AND II, 2012, : 555 - 558
  • [6] Study on the consistency analysis between the prosody and the spectrum for Mandarin speech
    Yeh, Cheng-Yu
    Chen, Kuan-Lin
    Hwang, Shaw-Hwa
    Yan, Long-Jhe
    IET SIGNAL PROCESSING, 2013, 7 (02) : 158 - 165
  • [7] Study on the consistency analysis between the prosody and the spectrum for mandarin speech
    Department of Electrical Engineering, National Chin-Yi University of Technology, 57, Sec. 2, Zhongshan Road, Taiping Dist., Taichung
    41170, Taiwan
    不详
    10608, Taiwan
    IET Signal Proc., 2 (158-165):
  • [8] Eye movements and visual information processing
    Findlay, JM
    MIND'S EYE: COGNITIVE AND APPLIED ASPECTS OF EYE MOVEMENT RESEARCH, 2003, : 143 - 155
  • [9] THE PROCESSING OF MANDARIN CHINESE TONAL ALTERNATIONS IN CONTEXTS: AN EYE-TRACKING STUDY
    Tu, Jung-yueh
    Chien, Yu-Fu
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 6244 - 6248
  • [10] A Pilot Study on Mandarin Chinese Cued Speech
    Liu, Li
    Feng, Gang
    AMERICAN ANNALS OF THE DEAF, 2019, 164 (04) : 496 - 518