A neural network-supported two-stage algorithm for lightweight dereverberation on hearing devices

被引:0
|
作者
Jean-Marie Lemercier
Joachim Thiemann
Raphael Koning
Timo Gerkmann
机构
[1] Universität Hamburg,Signal Processing
[2] Advanced Bionics,undefined
关键词
Dereverberation; Neural network; End-to-end learning; Hearing devices;
D O I
暂无
中图分类号
学科分类号
摘要
A two-stage lightweight online dereverberation algorithm for hearing devices is presented in this paper. The approach combines a multi-channel multi-frame linear filter with a single-channel single-frame post-filter. Both components rely on power spectral density (PSD) estimates provided by deep neural networks (DNNs). By deriving new metrics analyzing the dereverberation performance in various time ranges, we confirm that directly optimizing for a criterion at the output of the multi-channel linear filtering stage results in a more efficient dereverberation as compared to placing the criterion at the output of the DNN to optimize the PSD estimation. More concretely, we show that training this stage end-to-end helps further remove the reverberation in the range accessible to the filter, thus increasing the early-to-moderate reverberation ratio. We argue and demonstrate that it can then be well combined with a post-filtering stage to efficiently suppress the residual late reverberation, thereby increasing the early-to-final reverberation ratio. This proposed two-stage procedure is shown to be both very effective in terms of dereverberation performance and computational demands, as compared to, e.g., recent state-of-the-art DNN approaches. Furthermore, the proposed two-stage system can be adapted to the needs of different types of hearing-device users by controlling the amount of reduction of early reflections.
引用
收藏
相关论文
共 50 条
  • [1] A neural network-supported two-stage algorithm for lightweight dereverberation on hearing devices
    Lemercier, Jean-Marie
    Thiemann, Joachim
    Koning, Raphael
    Gerkmann, Timo
    [J]. EURASIP JOURNAL ON AUDIO SPEECH AND MUSIC PROCESSING, 2023, 2023 (01)
  • [2] CUSTOMIZABLE END-TO-END OPTIMIZATION OF ONLINE NEURAL NETWORK-SUPPORTED DEREVERBERATION FOR HEARING DEVICES
    Lemercier, Jean-Marie
    Thiemann, Joachim
    Koning, Raphael
    Gerkmann, Timo
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 171 - 175
  • [3] Perceptual Improvement of a Two-Stage Algorithm for Speech Dereverberation
    Prego, Thiago de M.
    de Lima, Amaro A.
    Netto, Sergio L.
    [J]. 12TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2011 (INTERSPEECH 2011), VOLS 1-5, 2011, : 216 - 219
  • [4] A Two-Stage Exact Algorithm for Optimization of Neural Network Ensemble
    Wang, Keliang
    Lozano, Leonardo
    Bergman, David
    Cardonha, Carlos
    [J]. INTEGRATION OF CONSTRAINT PROGRAMMING, ARTIFICIAL INTELLIGENCE, AND OPERATIONS RESEARCH, 2021, 12735 : 106 - 114
  • [5] A two-stage algorithm for network reconstruction
    Wu, Jianshe
    Yang, Hedi
    Ren, Yanhua
    Li, X. Rong
    [J]. APPLIED SOFT COMPUTING, 2018, 70 : 751 - 763
  • [6] Audio-Visual Speech Separation and Dereverberation With a Two-Stage Multimodal Network
    Tan, Ke
    Xu, Yong
    Zhang, Shi-Xiong
    Yu, Meng
    Yu, Dong
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (03) : 542 - 553
  • [7] Artificial Neural Network-Supported Selection of Materials in Ecodesign
    Rojek, Izabela
    Dostatni, Ewa
    [J]. ADVANCES IN MANUFACTURING II, VOL 1 - SOLUTIONS FOR INDUSTRY 4.0, 2019, : 422 - 431
  • [8] Two-Stage Liver and Tumor Segmentation Algorithm Based on Convolutional Neural Network
    Meng, Lu
    Zhang, Qianqian
    Bu, Sihang
    [J]. DIAGNOSTICS, 2021, 11 (10)
  • [9] Two-stage random search algorithm of fuzzy neural network with variable radius
    An, Kai
    Xing, Jinsheng
    Qin, Zulian
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2000, 26 (05): : 616 - 622
  • [10] Two-stage dereverberation with integrated reverberation and noise estimation
    Sugiyama, Akihiko
    Gattoni, Lucas
    [J]. 2006 IEEE 12TH DIGITAL SIGNAL PROCESSING WORKSHOP & 4TH IEEE SIGNAL PROCESSING EDUCATION WORKSHOP, VOLS 1 AND 2, 2006, : 322 - 327