Deep Learning for Environmentally Robust Speech Recognition: An Overview of Recent Developments

被引:180
|
作者
Zhang, Zixing [1 ]
Geiger, Juergen [2 ]
Pohjalainen, Jouni [3 ]
Mousa, Amr El-Desoky [3 ]
Jin, Wenyu [2 ]
Schuller, Bjoern [1 ]
机构
[1] Imperial Coll London, Dept Comp, Queens Gate 180, London SW7 2AZ, England
[2] Huawei Technol Dusseldorf GmbH, German Res Ctr, Riesstr 25, D-80992 Munich, Germany
[3] Univ Passau, Chair Complex & Intelligent Syst, Innstr 41, D-94032 Passau, Germany
关键词
Robust speech recognition; deep learning; neural networks; non-stationary noise; multi-channel speech recognition; SHORT-TERM-MEMORY; RECURRENT NEURAL-NETWORKS; FRONT-END; ENHANCEMENT; DEREVERBERATION; DOMAIN; NOISE; SUPPRESSION; SEPARATION; MASKS;
D O I
10.1145/3178115
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Eliminating the negative effect of non-stationary environmental noise is a long-standing research topic for automatic speech recognition but still remains an important challenge. Data-driven supervised approaches, especially the ones based on deep neural networks, have recently emerged as potential alternatives to traditional unsupervised approaches and with sufficient training, can alleviate the shortcomings of the unsupervised methods in various real-life acoustic environments. In this light, we review recently developed, representative deep learning approaches for tackling non-stationary additive and convolutional degradation of speech with the aim of providing guidelines for those involved in the development of environmentally robust speech recognition systems. We separately discuss single- and multi-channel techniques developed for the front-end and back-end of speech recognition systems, as well as joint front-end and back-end training frameworks. In the meanwhile, we discuss the pros and cons of these approaches and provide their experimental results on benchmark databases. We expect that this overview can facilitate the development of the robustness of speech recognition systems in acoustic noisy environments.
引用
收藏
页数:28
相关论文
共 50 条
  • [41] EFFICIENT DEEP LEARNING FOR PATHOLOGICAL SPEECH RECOGNITION
    Pham, Tuan D.
    [J]. 2023 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI, 2023, : 103 - 104
  • [42] Speech Emotion Recognition Using Deep Learning
    Ahmed, Waqar
    Riaz, Sana
    Iftikhar, Khunsa
    Konur, Savas
    [J]. ARTIFICIAL INTELLIGENCE XL, AI 2023, 2023, 14381 : 191 - 197
  • [43] Research on a Deep Learning Method for Speech Recognition
    Xiao, Jia
    Xiaolin, Sun
    [J]. IAENG International Journal of Computer Science, 2024, 51 (09) : 1272 - 1280
  • [44] Fake Speech Recognition Using Deep Learning
    Camacho, Steven
    Maria Ballesteros, Dora
    Renza, Diego
    [J]. APPLIED COMPUTER SCIENCES IN ENGINEERING, WEA 2021, 2021, 1431 : 38 - 48
  • [45] Deep learning for Depression Recognition from Speech
    Tian, Han
    Zhu, Zhang
    Jing, Xu
    [J]. MOBILE NETWORKS & APPLICATIONS, 2023,
  • [46] Persian speech recognition using deep learning
    Hadi Veisi
    Armita Haji Mani
    [J]. International Journal of Speech Technology, 2020, 23 : 893 - 905
  • [47] Overview of behavior recognition based on deep learning
    Kai Hu
    Junlan Jin
    Fei Zheng
    Liguo Weng
    Yiwu Ding
    [J]. Artificial Intelligence Review, 2023, 56 : 1833 - 1865
  • [48] On the relevance. of auditory-based Gabor features for deep learning in robust speech recognition
    Martinez, Angel Mario Castro
    Mallidi, Sri Harish
    Meyer, Bernd T.
    [J]. COMPUTER SPEECH AND LANGUAGE, 2017, 45 : 21 - 38
  • [49] Speaker recognition based on deep learning: An overview
    Bai, Zhongxin
    Zhang, Xiao-Lei
    [J]. NEURAL NETWORKS, 2021, 140 : 65 - 99
  • [50] Overview of behavior recognition based on deep learning
    Hu, Kai
    Jin, Junlan
    Zheng, Fei
    Weng, Liguo
    Ding, Yiwu
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (03) : 1833 - 1865