Design of a robust MVDR beamforming method with Low-Latency by reconstructing covariance matrix for speech enhancement

被引:1
|
作者
Zhou, Jing [1 ]
Bao, Changchun [1 ]
Zhang, Xu [1 ]
Xiong, Wenmeng [1 ]
Jia, Maoshen [1 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Speech & Audio Signal Proc Lab, Beijing 100124, Peoples R China
基金
中国国家自然科学基金;
关键词
Speech enhancement; Microphone array; Minimum variance distortionless response; Beamformer; Direction of arrival; STEERING VECTOR ESTIMATION; PERFORMANCE; ARRAY;
D O I
10.1016/j.apacoust.2023.109464
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Aiming at solving the problems of the conventional minimum variance distortionless response (MVDR) beamformer in practical applications, such as the sensibility of the steering vector mismatch and beam pattern distortion, a robust broadband MVDR beamforming method with low-latency by reconstructing covariance matrix is proposed and applied to speech enhancement with a linear microphone array in this paper. In this work, some important steps are optimized, and the main contribution is to consider the problem of correlation terms generated by the low latency. Firstly, the direction of arrival (DOA) is cor-rected and the steering vector is estimated based on the sparsity of the DOAs corresponding to the sound sources, which improves the ability of anti-mismatches in the steering vector. Secondly, the correlation terms between the sound sources and noise are estimated and eliminated by the Capon power within the eigen-subspace, and the indirect dominant method is used to eliminate the correlation terms between the sound sources, so that the covariance matrix is reconstructed to obtain a more robust MVDR beam former. Thirdly, the problem of white noise amplification at low frequency bins is analyzed, and a white noise gain (WNG) modification method is proposed to obtain a compromise between the interference suppression and WNG. In the experiments, the TIMIT corpus is used to generate the multi-channel speech data set, and the performance of the proposed method is evaluated with different DOAs and input signal to interference plus noise ratios (SINRs). The experimental results show that the proposed method can effectively suppress the interferences and reduce the noise with strong robustness.& COPY; 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页数:16
相关论文
共 44 条
  • [31] Robust adaptive beamforming based on interference-plus-noise covariance matrix reconstruction method
    Bi, Yang
    Feng, XiAn
    Guo, Tuo
    Progress In Electromagnetics Research M, 2020, 97 : 87 - 96
  • [32] SPEECH ENHANCEMENT USING BEAMFORMING AND NON NEGATIVE MATRIX FACTORIZATION FOR ROBUST SPEECH RECOGNITION IN THE CHIME-3 CHALLENGE
    Vu, Thanh T.
    Bigot, Benjamin
    Chng, Eng Siong
    2015 IEEE WORKSHOP ON AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING (ASRU), 2015, : 423 - 429
  • [33] Design of Beamforming Algorithm for Ultra-reliable and Low-latency Communication in Heterogeneous Networks Based on IRS Assistance
    Luo Jiajun
    Dai Haibo
    Wang Baoyun
    Li Chunguo
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (07) : 2289 - 2298
  • [34] Framewise Finite Impulse Response Filtering Based on Time-Frequency Mask for Low-Latency Speech Enhancement
    Haruta, Chiho
    Ono, Nobutaka
    Kinoshita, Yuma
    2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2021, : 1215 - 1220
  • [35] TEACHER-STUDENT LEARNING FOR LOW-LATENCY ONLINE SPEECH ENHANCEMENT USING WAVE-U-NET
    Nakaoka, Sotaro
    Li, Li
    Inoue, Shota
    Makino, Shoji
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 661 - 665
  • [36] LOW BIT RATE BINAURAL LINK FOR IMPROVED ULTRA LOW-LATENCY LOW-COMPLEXITY MULTICHANNEL SPEECH ENHANCEMENT IN HEARING AIDS
    Westhausen, Nils L.
    Meyer, Bernd T.
    2023 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS, WASPAA, 2023,
  • [37] An Efficient Robust Adaptive Beamforming Method Using Steering Vector Estimation and Interference Covariance Matrix Reconstruction
    Yang, Jie
    Yang, Yixin
    Lei, Bo
    2018 OCEANS - MTS/IEEE KOBE TECHNO-OCEANS (OTO), 2018,
  • [38] Low-complexity robust adaptive beamforming method for MIMO radar based on covariance matrix estimation and steering vector mismatch correction
    Huang, Junsheng
    Su, Hongtao
    Yang, Yang
    IET RADAR SONAR AND NAVIGATION, 2019, 13 (05): : 712 - 720
  • [39] Robust Adaptive Beamforming Using a Low-Complexity Steering Vector Estimation and Covariance Matrix Reconstruction Algorithm
    Chen, Pei
    Zhao, Yongjun
    Liu, Chengcheng
    INTERNATIONAL JOURNAL OF ANTENNAS AND PROPAGATION, 2016, 2016
  • [40] TIME-FREQUENCY MASKING STRATEGIES FOR SINGLE-CHANNEL LOW-LATENCY SPEECH ENHANCEMENT USING NEURAL NETWORKS
    Parviainen, Mikko
    Pertila, Pasi
    Virtanen, Tuomas
    Grosche, Peter
    2018 16TH INTERNATIONAL WORKSHOP ON ACOUSTIC SIGNAL ENHANCEMENT (IWAENC), 2018, : 51 - 55