Fusion Feature Extraction Based on Auditory and Energy for Noise-Robust Speech Recognition

被引:8
|
作者
Shi, Yanyan [1 ]
Bai, Jing [1 ]
Xue, Peiyun [1 ]
Shi, Dianxi [2 ,3 ]
机构
[1] Taiyuan Univ Technol, Coll Informat & Comp, Taiyuan 030024, Shanxi, Peoples R China
[2] NIIDT, AIRC, Beijing 100071, Peoples R China
[3] TAIIC, Tianjin 300457, Peoples R China
来源
IEEE ACCESS | 2019年 / 7卷
关键词
Cochlear filter cepstral coefficients; Teager energy operators cepstral coefficients; principal component analysis; speech recognition;
D O I
10.1109/ACCESS.2019.2918147
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Environmental noise can pose a threat to the stable operation of current speech recognition systems. It is therefore essential to develop a front feature set that is able to identify speech under low signal-to-noise ratio. In this paper, a robust fusion feature is proposed that can fully characterize speech information. To obtain the cochlear filter cepstral coefficients (CFCC), a novel feature is first extracted by the power-law nonlinear function, which can simulate the auditory characteristics of the human ear. Speech enhancement technology is then introduced into the front end of feature extraction, and the extracted feature and their first-order difference are combined in new mixed features. An energy feature Teager energy operator cepstral coefficient (TEOCC) is also extracted, and combined with the above-mentioned mixed features to form the fusion feature sets. Principal component analysis (PCA) is then applied to feature selection and optimization of the feature set, and the final feature set is used in a non-specific persons, isolated words, and small-vocabulary speech recognition system. Finally, a comparative experiment of speech recognition is designed to verify the advantages of the proposed feature set using a support vector machine (SVM). The experimental results show that the proposed feature set not only display a high recognition rate and excellent anti-noise performance in speech recognition, but can also fully characterize the auditory and energy information in the speech signals.
引用
收藏
页码:81911 / 81922
页数:12
相关论文
共 50 条
  • [1] INTERACTIVE FEATURE FUSION FOR END-TO-END NOISE-ROBUST SPEECH RECOGNITION
    Hu, Yuchen
    Hou, Nana
    Chen, Chen
    Chng, Eng Siong
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 6292 - 6296
  • [2] Orthogonalized distinctive phonetic feature extraction for noise-robust automatic speech recognition
    Fukuda, T
    Nitta, T
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2004, E87D (05): : 1110 - 1118
  • [3] Noise-Robust Speech Recognition Through Auditory Feature Detection and Spike Sequence Decoding
    Schafer, Phillip B.
    Jin, Dezhe Z.
    [J]. NEURAL COMPUTATION, 2014, 26 (03) : 523 - 556
  • [4] Feature extraction based on auditory representations for robust speech recognition
    Kim, DS
    Lee, SY
    Kil, RM
    Zhu, XL
    [J]. ELECTRONICS LETTERS, 1997, 33 (01) : 15 - 16
  • [5] Modeling human auditory perception for noise-robust speech recognition
    Lee, SY
    [J]. PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS AND BRAIN, VOLS 1-3, 2005, : PL72 - PL74
  • [6] On the temporal decorrelation of feature parameters for noise-robust speech recognition
    Jung, HY
    Lee, SY
    [J]. IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, 2000, 8 (04): : 407 - 416
  • [7] Noise-Robust Algorithm of Speech Features Extraction for Automatic Speech Recognition System
    Yakhnev, A. N.
    Pisarev, A. S.
    [J]. PROCEEDINGS OF THE XIX IEEE INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND MEASUREMENTS (SCM 2016), 2016, : 206 - 208
  • [8] Noise-Robust Feature Extraction Based on Forward Masking
    Chiou, Sheng-Chiuan
    Chen, Chia-Ping
    [J]. INTERSPEECH 2009: 10TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2009, VOLS 1-5, 2009, : 1243 - 1246
  • [9] A missing data-based feature fusion strategy for noise-robust automatic speech recognition using noisy sensors
    Demiroglu, Cenk
    Anderson, David V.
    Clements, Mark. A.
    [J]. 2007 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-11, 2007, : 965 - 968
  • [10] Combining speech enhancement and auditory feature extraction for robust speech recognition
    Kleinschmidt, M
    Tchorz, J
    Kollmeier, B
    [J]. SPEECH COMMUNICATION, 2001, 34 (1-2) : 75 - 91