Vocal tract length normalization for speaker independent acoustic-to-articulatory speech inversion

被引:15
|
作者
Sivaraman, Ganesh [1 ]
Mitra, Vikramjit [2 ]
Nam, Hosung [3 ]
Tiede, Mark [4 ]
Espy-Wilson, Carol [1 ]
机构
[1] Univ Maryland, College Pk, MD 20742 USA
[2] SRI Int, 333 Ravenswood Ave, Menlo Pk, CA 94025 USA
[3] Korea Univ, Dept English Language & Literature, Seoul, South Korea
[4] Haskins Labs Inc, New Haven, CT USA
基金
美国国家科学基金会;
关键词
Acoustic to articulatory speech inversion; speaker normalization; Vocal Tract Length Normalization;
D O I
10.21437/Interspeech.2016-1399
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Speech inversion is a well-known ill-posed problem and addition of speaker differences typically makes it even harder. This paper investigates a vocal tract length normalization (VTLN) technique to transform the acoustic space of different speakers to a target speaker space such that speaker specific details are minimized. The speaker normalized features are then used to train a feed-forward neural network based acoustic-to articulatory speech inversion system. The acoustic features are parameterized as time-contextualized mel-frequency cepstral coefficients and the articulatory features are represented by six tract-variable (TV) trajectories. Experiments are performed with ten speakers from the U. Wisc. X-ray microbeam database. Speaker dependent speech inversion systems are trained for each speaker as baselines to compare the performance of the speaker independent approach. For each target speaker, data from the remaining nine speakers are transformed using the proposed approach and the transformed features are used to train a speech inversion system. The performances of the individual systems are compared using the correlation between the estimated and the actual TVs on the target speaker's test set. Results show that the proposed speaker normalization approach provides a 7% absolute improvement in correlation as compared to the system where speaker normalization was not performed.
引用
收藏
页码:455 / 459
页数:5
相关论文
共 50 条
  • [41] Incorporation of phonetic constraints in acoustic-to-articulatory inversion
    Potard, Blaise
    Laprie, Yves
    Ouni, Slim
    [J]. Journal of the Acoustical Society of America, 2008, 123 (04): : 2310 - 2323
  • [42] The impact of speaking rate on acoustic-to-articulatory inversion
    Illa, Aravind
    Ghosh, Prasanta Kumar
    [J]. COMPUTER SPEECH AND LANGUAGE, 2020, 59 : 75 - 90
  • [43] Acoustic-to-Articulatory Inversion of a Three-dimensional Theoretical Vocal Tract Model Using Deep Learning-based Model
    Lapthawan, Thanat
    Prom-on, Santitham
    [J]. 2019 IEEE 10TH INTERNATIONAL CONFERENCE ON AWARENESS SCIENCE AND TECHNOLOGY (ICAST 2019), 2019, : 52 - 56
  • [44] Information theoretic acoustic feature selection for acoustic-to-articulatory inversion
    Ghosh, Prasanta Kumar
    Narayanan, Shrikanth S.
    [J]. 14TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2013), VOLS 1-5, 2013, : 3176 - 3180
  • [45] An investigation on speaker specific articulatory synthesis with speaker independent articulatory inversion
    Illa, Aravind
    Ghosh, Prasanta Kumar
    [J]. INTERSPEECH 2019, 2019, : 121 - 125
  • [46] A study of acoustic-to-articulatory inversion of speech by analysis-by-synthesis using chain matrices and the Maeda articulatory model
    Panchapagesan, Sankaran
    Alwan, Abeer
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2011, 129 (04): : 2144 - 2162
  • [47] Modeling the articulatory space using a hypercube codebook for acoustic-to-articulatory inversion
    Ouni, S
    Laprie, Y
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2005, 118 (01): : 444 - 460
  • [48] Is average RMSE appropriate for evaluating acoustic-to-articulatory inversion?
    Fang, Qiang
    [J]. 2019 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2019, : 997 - 1003
  • [49] Acoustic-to-Articulatory Inversion Using Particle Swarm Optimization
    Fairee, Suthida
    Sirinaovakul, Booncharoen
    Prom-on, Santitham
    [J]. 2015 12TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY (ECTI-CON), 2015,
  • [50] Acoustic-to-articulatory inversion from infants' vowel vocalizations
    Oohashi, Hiroki
    Watanabe, Hama
    Taga, Gentaro
    [J]. NEUROSCIENCE RESEARCH, 2011, 71 : E286 - E286