Deep Learning for Environmentally Robust Speech Recognition: An Overview of Recent Developments

被引:180
|
作者
Zhang, Zixing [1 ]
Geiger, Juergen [2 ]
Pohjalainen, Jouni [3 ]
Mousa, Amr El-Desoky [3 ]
Jin, Wenyu [2 ]
Schuller, Bjoern [1 ]
机构
[1] Imperial Coll London, Dept Comp, Queens Gate 180, London SW7 2AZ, England
[2] Huawei Technol Dusseldorf GmbH, German Res Ctr, Riesstr 25, D-80992 Munich, Germany
[3] Univ Passau, Chair Complex & Intelligent Syst, Innstr 41, D-94032 Passau, Germany
关键词
Robust speech recognition; deep learning; neural networks; non-stationary noise; multi-channel speech recognition; SHORT-TERM-MEMORY; RECURRENT NEURAL-NETWORKS; FRONT-END; ENHANCEMENT; DEREVERBERATION; DOMAIN; NOISE; SUPPRESSION; SEPARATION; MASKS;
D O I
10.1145/3178115
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Eliminating the negative effect of non-stationary environmental noise is a long-standing research topic for automatic speech recognition but still remains an important challenge. Data-driven supervised approaches, especially the ones based on deep neural networks, have recently emerged as potential alternatives to traditional unsupervised approaches and with sufficient training, can alleviate the shortcomings of the unsupervised methods in various real-life acoustic environments. In this light, we review recently developed, representative deep learning approaches for tackling non-stationary additive and convolutional degradation of speech with the aim of providing guidelines for those involved in the development of environmentally robust speech recognition systems. We separately discuss single- and multi-channel techniques developed for the front-end and back-end of speech recognition systems, as well as joint front-end and back-end training frameworks. In the meanwhile, we discuss the pros and cons of these approaches and provide their experimental results on benchmark databases. We expect that this overview can facilitate the development of the robustness of speech recognition systems in acoustic noisy environments.
引用
收藏
页数:28
相关论文
共 50 条
  • [1] Deep Learning for Environmentally Robust Speech Recognition
    Alhamada, A., I
    Khalifa, O. O.
    Abdalla, A. H.
    [J]. PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON ELECTRONIC DEVICES, SYSTEMS AND APPLICATIONS (ICEDSA2020), 2020, 2306
  • [2] Explainable deep learning for efficient and robust pattern recognition: A survey of recent developments
    Bai, Xiao
    Wang, Xiang
    Liu, Xianglong
    Liu, Qiang
    Song, Jingkuan
    Sebe, Nicu
    Kim, Been
    [J]. PATTERN RECOGNITION, 2021, 120
  • [3] Speech Recognition Utilizing Deep Learning: A Systematic Review of the Latest Developments
    Al-Fraihat, Dimah
    Sharrab, Yousef
    Alzyoud, Faisal
    Qahmash, Ayman
    Tarawneh, Monther
    Maaita, Adi
    [J]. HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2024, 14
  • [4] Deep Learning in Acoustic Modeling for Automatic Speech Recognition and Understanding - An Overview -
    Gavat, Inge
    Militaru, Diana
    [J]. 2015 INTERNATIONAL CONFERENCE ON SPEECH TECHNOLOGY AND HUMAN-COMPUTER DIALOGUE (SPED), 2015,
  • [5] NOISE ROBUST SPEECH RECOGNITION USING RECENT DEVELOPMENTS IN NEURAL NETWORKS FOR COMPUTER VISION
    Yoshioka, Takuya
    Ohnishi, Katsunori
    Fang, Fuming
    Nakatani, Toniohiro
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 5730 - 5734
  • [6] Deep Learning Based Dereverberation of Temporal Envelopes for Robust Speech Recognition
    Purushothaman, Anurenjan
    Sreeram, Anirudh
    Kumar, Rohit
    Ganapathy, Sriram
    [J]. INTERSPEECH 2020, 2020, : 1688 - 1692
  • [7] AUDIO-VISUAL DEEP LEARNING FOR NOISE ROBUST SPEECH RECOGNITION
    Huang, Jing
    Kingsbury, Brian
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 7596 - 7599
  • [8] Robust speech recognition based on deep learning for sports game review
    Liu, Min
    Ying-Hao, An
    Fa-Li, Liang
    [J]. APPLIED MATHEMATICS AND NONLINEAR SCIENCES, 2023,
  • [9] RECENT APPLICATIONS AND DEVELOPMENTS IN SPEECH RECOGNITION TECHNOLOGIES
    SUGAMURA, N
    KITAWAKI, N
    [J]. NTT REVIEW, 1994, 6 (03): : 81 - 87
  • [10] Modulation Filter Learning Using Deep Variational Networks for Robust Speech Recognition
    Agrawal, Purvi
    Ganapathy, Sriram
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2019, 13 (02) : 244 - 253