DIRECTION OF ARRIVAL ESTIMATION FOR REVERBERANT SPEECH BASED ON NEURAL NETWORKS AND THE DIRECT-PATH DOMINANCE TEST

被引:0
|
作者
Ben Zaken, Orel [1 ]
Rafaely, Boaz [1 ]
Kumar, Anurag [2 ]
Tourbabin, Vladimir [2 ]
机构
[1] Ben Gurion Univ Negev, Sch Elect & Comp Engn, Beer Sheva, Israel
[2] Real Labs Res Meta, 1 Hacker Way, Menlo Pk, CA 94025 USA
关键词
Speaker localization; spherical arrays; machine learning; LOCALIZATION;
D O I
10.1109/IWAENC53105.2022.9914696
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
In reverberant environments, typical of real-world scenarios, direction of arrival (DOA) estimation for speech sources appears to be a challenging problem in audio signal processing. An effective way of overcoming this challenge is to perform a direct-path dominance (DPD) test. The DPD test identifies time frequency bins dominated by the direct sound and holds accurate DOA data. In recent years, methods based on neural networks (NN) have been developed to estimate DOA. Based on the latter approach, this work proposes a NN based method, for spherical arrays, that is a generalization of the original DPD test method and aims to improve its performance by utilizing new information in the data, while preserving its advantages. This article presents the results of the proposed method for a single speaker in a room, and analyzes which features contain useful information about the direct sound by evaluating performance for simulated data.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] Binaural reverberant Speech separation based on deep neural networks
    Zhang, Xueliang
    Wang, DeLiang
    [J]. 18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 2018 - 2022
  • [22] Localization of Multiple Speakers under High Reverberation using a Spherical Microphone Array and the Direct-Path Dominance Test
    Nadiri, O.
    Rafaely, B.
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2014, 22 (10) : 1494 - 1505
  • [23] BLIND SPEECH SEPARATION THROUGH DIRECTION OF ARRIVAL ESTIMATION USING DEEP NEURAL NETWORKS WITH A FLEXIBILITY ON THE NUMBER OF SPEAKERS
    Hafsati, Mohammed
    Bentounes, Kamil
    Marxer, Ricard
    [J]. 2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [24] Antenna array signal processing with neural networks for direction of arrival estimation
    ElZooghby, AH
    Christodoulou, CG
    Georgiopoulos, M
    [J]. IEEE ANTENNAS AND PROPAGATION SOCIETY INTERNATIONAL SYMPOSIUM 1997, VOLS 1-4, 1997, : 2274 - 2277
  • [25] Direction-of-arrival estimation of passive acoustic sources in reverberant environments based on the Householder transformation
    Huang, Gongping
    Chen, Jingdong
    Benesty, Jacob
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2015, 138 (05): : 3053 - 3060
  • [26] Broadband Direction of Arrival Estimation Based on Convolutional Neural Network
    Zhu, Wenli
    Zhang, Min
    Wu, Chenxi
    Zeng, Lingqing
    [J]. IEICE TRANSACTIONS ON COMMUNICATIONS, 2020, E103B (03) : 148 - 154
  • [27] Direction of Arrival Estimation for Radionuclides Based on Neural Network Approach
    Yossi, Salomon
    Eran, Vax
    Yakir, Knafo
    Nadav, Ben David
    Alon, Osovizky
    Dan, Vilenchik
    [J]. IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2024, 71 (05) : 1124 - 1133
  • [28] Direction of Arrival Estimation of Noisy Speech using Convolutional Recurrent Neural Networks with Higher-Order Ambisonics Signals
    Poschadel, Nils
    Hupke, Robert
    Preihs, Stephan
    Peissig, Juergen
    [J]. 29TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2021), 2021, : 211 - 215
  • [29] Direction of Arrival Estimation Applied to Antenna Arrays using Convolutional Neural Networks
    Kokkinis, Giorgos
    Zaharis, Zaharias D.
    Lazaridis, Pavlos, I
    Kantartzis, Nikolaos, V
    [J]. 2022 3RD URSI ATLANTIC AND ASIA PACIFIC RADIO SCIENCE MEETING (AT-AP-RASC), 2022,
  • [30] Direction of arrival estimation of unknown emitter by deep neural networks with array imperfections
    Chen, Min
    Mao, Xingpeng
    Liu, Libao
    [J]. IET RADAR SONAR AND NAVIGATION, 2023, 17 (06): : 978 - 990