Vocal drum sounds in human beatboxing: An acoustic and articulatory exploration using electromagnetic articulography

被引:5
|
作者
Paroni, Annalisa [1 ]
Henrich Bernardoni, Nathalie [1 ]
Savariaux, Christophe [1 ]
Loevenbruck, Helene [2 ]
Calabrese, Pascale [3 ]
Pellegrini, Thomas [4 ]
Mouysset, Sandrine [4 ]
Gerber, Silvain [1 ]
机构
[1] Univ Grenoble Alpes, CNRS, Grenoble INP, GIPSA Lab, F-38000 Grenoble, France
[2] Univ Grenoble Alpes, CNRS, Univ Savoie Mt Blanc, LPNC, F-38000 Grenoble, France
[3] Univ Grenoble Alpes, CNRS, Grenoble INP, TIMC IMAG, F-38000 Grenoble, France
[4] IRIT, Toulouse, France
来源
关键词
RESPIRATORY INDUCTANCE PLETHYSMOGRAPHY;
D O I
10.1121/10.0002921
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Acoustic characteristics, lingual and labial articulatory dynamics, and ventilatory behaviors were studied on a beatboxer producing twelve drum sounds belonging to five main categories of his repertoire (kick, snare, hi-hat, rimshot, cymbal). Various types of experimental data were collected synchronously (respiratory inductance plethysmography, electroglottography, electromagnetic articulography, and acoustic recording). Automatic unsupervised classification was successfully applied on acoustic data with t-SNE spectral clustering technique. A cluster purity value of 94% was achieved, showing that each sound has a specific acoustic signature. Acoustical intensity of sounds produced with the humming technique was found to be significantly lower than their non-humming counterparts. For these sounds, a dissociation between articulation and breathing was observed. Overall, a wide range of articulatory gestures was observed, some of which were non-linguistic. The tongue was systematically involved in the articulation of the explored beatboxing sounds, either as the main articulator or as accompanying the lip dynamics. Two pulmonic and three non-pulmonic airstream mechanisms were identified. Ejectives were found in the production of all the sounds with bilabial occlusion or alveolar occlusion with egressive airstream. A phonetic annotation using the IPA alphabet was performed, highlighting the complexity of such sound production and the limits of speech-based annotation.
引用
收藏
页码:191 / 206
页数:16
相关论文
共 17 条
  • [1] Combining language corpora in a Japanese electromagnetic articulography database for acoustic-to-articulatory inversion
    Yan, Tianfang
    Maekawa, Kikuo
    Nota, Yukiko
    Hirata, Masayuki
    INTERSPEECH 2023, 2023, : 1464 - 1467
  • [2] Combining language corpora in a Japanese electromagnetic articulography database for acoustic-to-articulatory inversion
    Yan, Tianfang
    Maekawa, Kikuo
    Nota, Yukiko
    Hirata, Masayuki
    Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 2023, 2023-August : 1464 - 1467
  • [3] Analysis of articulatory dynamics in dysarthria following brain injury in childhood using electromagnetic articulography and electropalatography
    Cheng, HY
    Goozée, JV
    Murdoch, BE
    JOURNAL OF MEDICAL SPEECH-LANGUAGE PATHOLOGY, 2005, 13 (01) : 15 - 35
  • [4] THE ELECTROMAGNETIC ARTICULOGRAPHY MANDARIN ACCENTED ENGLISH (EMA-MAE) CORPUS OF ACOUSTIC AND 3D ARTICULATORY KINEMATIC DATA
    Ji, An
    Berry, Jeffrey J.
    Johnson, Michael T.
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [5] DETERMINATION OF ARTICULATORY PARAMETERS OF HUMAN VOCAL-TRACT FROM ACOUSTIC MEASUREMENTS
    MOLLER, WJ
    ATAL, BS
    SCHROEDER, MR
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1976, 60 : S77 - S77
  • [6] The DKU-JNU-EMA Electromagnetic Articulography Database on Mandarin and Chinese Dialects with Tandem Feature based Acoustic-to-Articulatory Inversion
    Cai, Zexin
    Qin, Xiaoyi
    Cai, Danwei
    Li, Ming
    Liu, Xinzhong
    Zhong, Haibin
    2018 11TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2018, : 235 - 239
  • [7] Temporal Coordination of Articulatory Gestures in Nonnative Onset Clusters: Evidence From American English Speakers Using Electromagnetic Articulography
    Cheng, Hung-Shao
    Masapollo, Matthew
    Hagedorn, Christina
    Buchwald, Adam
    JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2024, 67 (10): : 3549 - 3565
  • [8] Speech events are recoverable from unlabeled articulatory data: Using an unsupervised clustering approach on data obtained from Electromagnetic Midsaggital Articulography (EMA)
    Duran, Daniel
    Bruni, Jagoda
    Dogil, Grzegorz
    Schuetze, Hinrich
    12TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2011 (INTERSPEECH 2011), VOLS 1-5, 2011, : 2212 - 2215
  • [9] Speaker dependent acoustic-to-articulatory inversion using real-time MRI of the vocal tract
    Csapo, Tamas Gabor
    INTERSPEECH 2020, 2020, : 3720 - 3724
  • [10] Speaker dependent articulatory-to-acoustic mapping using real-time MRI of the vocal tract
    Csapo, Tamas Gabor
    INTERSPEECH 2020, 2020, : 2722 - 2726