Articulatory constraints on spontaneous entrainment between speech and manual gesture

被引:12
|
作者
Zelic, Gregory [1 ]
Kim, Jeesun [1 ]
Davis, Chris [1 ]
机构
[1] Univ Western Sydney, MARCS Inst, Sydney, NSW, Australia
关键词
Spontaneous entrainment processes; Speech articulatory constraints; Rhythmic coordination dynamics; INTERLIMB COORDINATION; DYNAMIC STABILITY; PHASE-TRANSITIONS; LANGUAGE; VARIABILITY; JAW; MOVEMENTS; AMPLITUDE; POSITION; PROSODY;
D O I
10.1016/j.humov.2015.05.009
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The present study examined the extent to which speech and manual gestures spontaneously entrain in a non-communicative task. Participants had to repeatedly utter nonsense /CV/ syllables while continuously moving the right index finger in flexion/extension. No instructions to coordinate were given. We manipulated the type of syllable uttered (/ba/ vs. /sa/), and vocalization (phonated vs. silent speech). Assuming principles of coordination dynamics, a stronger entrainment between the fingers oscillations and the jaw motion was predicted (1) for /ba/, due to expected larger amplitude of jaw motion and (2) in phonated speech, due to the auditory feedback. Fifteen out of twenty participants showed simple ratios of speech to finger cycles (1:1, 1:2 or 2:1). In contrast with our predictions, speech-gesture entrainment was stronger when vocalizing /sa/ than /ba/, also more widely distributed on an in-phase mode. Furthermore, results revealed a spatial anchoring and an increased temporal variability in jaw motion when producing /sa/. We suggested that this indicates a greater control of the speech articulators for /sa/, making the speech performance more receptive to environmental forces, resulting in the greater entrainment observed to gesture oscillations. The speech-gesture coordination was maintained in silent speech, suggesting a somatosensory basis for their endogenous coupling. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:232 / 245
页数:14
相关论文
共 50 条
  • [1] Gesture and Speech Coordination: The Influence of the Relationship Between Manual Gesture and Speech
    Roustan, Benjamin
    Dohen, Marion
    [J]. 11TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2010 (INTERSPEECH 2010), VOLS 1-2, 2010, : 498 - 501
  • [2] Estimation of articulatory gesture patterns from speech acoustics
    Ghosh, Prasanta Kumar
    Narayanan, Shrikanth
    Divenyi, Pierre
    Goldstein, Louis
    Saltzman, Elliot
    [J]. INTERSPEECH 2009: 10TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2009, VOLS 1-5, 2009, : 2767 - +
  • [3] A gesture-based concept for speech movement control in articulatory speech synthesis
    Kroeger, Berrid J.
    Birkholz, Peter
    [J]. VERBAL AND NONVERBAL COMMUNICATION BEHAVIOURS, 2007, 4775 : 174 - +
  • [4] Manual transcription of conversational speech at the articulatory feature level
    Livescu, Karen
    Bezman, Ari
    Borges, Nash
    Yung, Lisa
    Cetin, Oezguer
    Frankel, Joe
    King, Simon
    Magimai-Doss, Mathew
    Chi, Xuemin
    Lavoie, Lisa
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL IV, PTS 1-3, 2007, : 953 - +
  • [5] ARTICULATORY PATTERN AND ORAL GESTURE - RADIOLOGICAL ASPECTS OF EMOTIVE SPEECH
    FONAGY, I
    [J]. PHONETICA, 1976, 33 (01) : 31 - 44
  • [6] Informational constraints on spontaneous visuomotor entrainment
    Varlet, Manuel
    Bucci, Colleen
    Richardson, Michael J.
    Schmidt, R. C.
    [J]. HUMAN MOVEMENT SCIENCE, 2015, 41 : 265 - 281
  • [7] From manual gesture to speech: A gradual transition
    Gentilucci, Maurizio
    Corballis, Michael C.
    [J]. NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2006, 30 (07): : 949 - 960
  • [8] GESTURE AND SPEECH IN SPONTANEOUS AND REHEARSED NARRATIVES
    CHAWLA, P
    KRAUSS, RM
    [J]. JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY, 1994, 30 (06) : 580 - 601
  • [9] IMPROVEMENT OF ANIMATED ARTICULATORY GESTURE EXTRACTED FROM SPEECH FOR PRONUNCIATION TRAINING
    Iribe, Yurie
    Manosavan, Silasak
    Katsurada, Kouichi
    Hayashi, Ryoko
    Zhu, Chunyue
    Nitta, Tsuneo
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 5133 - 5136
  • [10] The temporal relationship between speech and manual communicative gesture in children with specific language impairment
    Sanjeevan, Teenu
    Mainela-Arnold, Elina
    Alibali, Martha W.
    Evans, Julia L.
    [J]. GESTURE, 2016, 15 (03) : 321 - 339