Direction of Arrival Estimation for Reverberant Speech Based on Enhanced Decomposition of the Direct Sound

被引:26
|
作者
Madmoni, Lior [1 ]
Rafaely, Boaz [1 ]
机构
[1] Ben Gurion Univ Negev, Dept Elect & Comp Engn, IL-84105 Beer Sheva, Israel
关键词
Direction of arrival estimation; reverberation; spherical arrays; plane wave decomposition; SPHERICAL MICROPHONE ARRAY; LOCALIZATION; FIELD;
D O I
10.1109/JSTSP.2018.2885930
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Direction of arrival (DOA) estimation for speech sources is an important task in audio signal processing. This task becomes a challenge in reverberant environments, which are typical to real scenarios. Several methods of DOA estimation for speech sources have been developed recently, in an attempt to overcome the effect of reverberation. One effective approach aims to identify time-frequency bins in the short time Fourier transform domain that are dominated by the direct sound. This approach was shown to be particularly adequate for spherical arrays, with processing in the spherical harmonics domain. The direct-path dominance (DPD) test, and a method which is based on the directivity of the sound field are recent examples. While these methods seem to perform well, high reverberation conditions may degrade their performance. In this paper, the structure of the spatial correlation matrix is comprehensively studied, showing that under some well-defined conditions, the DOA of the direct sound can be correctly extracted from its dominant eigenvector, even when contaminated by reflections. This new insight leads to the development of a new test, performing an enhanced decomposition of the direct sound (EDS), denoted the DPD-EDS test. The proposed test is compared to previous DPD tests, and to other recently proposed reverberation-robust methods, using computer simulations and an experimental study, demonstrating its potential advantage. The studies include multiple speakers in highly reverberant environments, therefore representing challenging real-life acoustics scenes.
引用
收藏
页码:131 / 142
页数:12
相关论文
共 50 条
  • [1] DIRECTION OF ARRIVAL ESTIMATION FOR REVERBERANT SPEECH BASED ON NEURAL NETWORKS AND THE DIRECT-PATH DOMINANCE TEST
    Ben Zaken, Orel
    Rafaely, Boaz
    Kumar, Anurag
    Tourbabin, Vladimir
    [J]. 2022 INTERNATIONAL WORKSHOP ON ACOUSTIC SIGNAL ENHANCEMENT (IWAENC 2022), 2022,
  • [2] On the angular error of intensity vector based direction of arrival estimation in reverberant sound fields
    Levin, Dovid
    Habets, Emanuel A. P.
    Gannot, Sharon
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2010, 128 (04): : 1800 - 1811
  • [3] Robust direction of arrival estimation for speech enhancement in noisy reverberant rooms
    Lotter, T
    Loellmann, HW
    Vary, P
    [J]. 2002 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I-IV, PROCEEDINGS, 2002, : 4186 - 4186
  • [4] A LEARNING-BASED APPROACH TO DIRECTION OF ARRIVAL ESTIMATION IN NOISY AND REVERBERANT ENVIRONMENTS
    Xiao, Xiong
    Zhao, Shengkui
    Zhong, Xionghu
    Jones, Douglas L.
    Chng, Eng Siong
    Li, Haizhou
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 2814 - 2818
  • [5] Neural-Network-Based Direction-of-Arrival Estimation for Reverberant Speech - The Importance of Energetic, Temporal, and Spatial Information
    Ben Zaken, Orel
    Kumar, Anurag
    Tourbabin, Vladimir
    Rafaely, Boaz
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 1298 - 1309
  • [6] Direction of arrival estimation based on spherical harmonics decomposition
    Gao, Weijian
    Zhao, Hangfang
    Xu, Wen
    [J]. OCEANS 2016 MTS/IEEE MONTEREY, 2016,
  • [7] Direction of Arrival Estimation of Kiwi Call in Noisy and Reverberant Bush
    Gray, Craig
    Hioka, Yusuke
    [J]. 2014 IEEE SENSORS APPLICATIONS SYMPOSIUM (SAS), 2014, : 258 - 262
  • [8] Acoustic SLAM Based on the Direction-of-Arrival and the Direct-to-Reverberant Energy Ratio
    Qiu, Wenhao
    Wang, Gang
    Zhang, Wenjing
    [J]. DRONES, 2023, 7 (02)
  • [9] Lamb waves Direction of Arrival estimation based on wavelet decomposition
    Malatesta, Michelangelo Maria
    Testoni, Nicola
    De Marchi, Luca
    Marzani, Alessandro
    [J]. 2019 IEEE INTERNATIONAL ULTRASONICS SYMPOSIUM (IUS), 2019, : 1616 - 1618
  • [10] Direction of arrival estimation using matching pursuit under reverberant condition
    Oikawa, Yasuhiro
    Yamasaki, Yoshio
    [J]. ACOUSTICAL SCIENCE AND TECHNOLOGY, 2005, 26 (04) : 365 - 367