Sound field reconstruction using neural processes with dynamic kernels

被引:0
|
作者
Zining Liang
Wen Zhang
Thushara D. Abhayapala
机构
[1] Northwestern Polytechnical University,Center of Intelligent Acoustics and Immersive Communications, School of Marine Science and Technology
[2] The Australian National University,Audio and Acoustic Signal Processing Group, College of Engineering and Computer Science
关键词
Sound field reconstruction; Gaussian processes; Kernels; Neural processes;
D O I
暂无
中图分类号
学科分类号
摘要
Accurately representing the sound field with high spatial resolution is crucial for immersive and interactive sound field reproduction technology. In recent studies, there has been a notable emphasis on efficiently estimating sound fields from a limited number of discrete observations. In particular, kernel-based methods using Gaussian processes (GPs) with a covariance function to model spatial correlations have been proposed. However, the current methods rely on pre-defined kernels for modeling, requiring the manual identification of optimal kernels and their parameters for different sound fields. In this work, we propose a novel approach that parameterizes GPs using a deep neural network based on neural processes (NPs) to reconstruct the magnitude of the sound field. This method has the advantage of dynamically learning kernels from data using an attention mechanism, allowing for greater flexibility and adaptability to the acoustic properties of the sound field. Numerical experiments demonstrate that our proposed approach outperforms current methods in reconstructing accuracy, providing a promising alternative for sound field reconstruction.
引用
收藏
相关论文
共 50 条
  • [1] Sound field reconstruction using neural processes with dynamic kernels
    Liang, Zining
    Zhang, Wen
    Abhayapala, Thushara D.
    EURASIP JOURNAL ON AUDIO SPEECH AND MUSIC PROCESSING, 2024, 2024 (01)
  • [2] Gaussian processes for sound field reconstruction
    Caviedes-Nozal, Diego
    Riis, Nicolai A. B.
    Heuchel, Franz M.
    Brunskog, Jonas
    Gerstoft, Peter
    Fernandez-Grande, Efren
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2021, 149 (02): : 1107 - 1119
  • [3] Sound field reconstruction using a compact acoustics-informed neural network
    Ma, Fei
    Zhao, Sipei
    Burnett, Ian S.
    Journal of the Acoustical Society of America, 2024, 156 (03): : 2009 - 2021
  • [4] ANOMALOUS SOUND DETECTION USING ATTENTIVE NEURAL PROCESSES
    Wichern, Gordon
    Chakrabarty, Ankush
    Wang, Zhong-Qiu
    Le Roux, Jonathan
    2021 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA), 2021, : 186 - 190
  • [5] Reconstruction of the sound field in a room using compressive sensing
    1600, Acoustical Society of America (143):
  • [6] Sound Field Reconstruction Using Error Function Method
    Huang, Linsen
    Zeng, Rui
    IEEE Sensors Journal, 2024, 24 (24) : 41213 - 41220
  • [7] Reconstruction of the sound field in a room using compressive sensing
    Verburg, Samuel A.
    Fernandez-Grande, Efren
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2018, 143 (06): : 3770 - 3779
  • [8] Sound field reconstruction using a spherical microphone array
    Fernandez-Grande, Efren
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2016, 139 (03): : 1168 - 1178
  • [9] Diffraction Kernels for Interactive Sound Propagation in Dynamic Environments
    Rungta, Atul
    Schissler, Carl
    Rewkowski, Nicholas
    Mehra, Ravish
    Manocha, Dinesh
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2018, 24 (04) : 1613 - 1622
  • [10] Sound field reconstruction using acousto-optic tomography
    Torras-Rosell, Antoni
    Barrera-Figueroa, Salvador
    Jacobsen, Finn
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2012, 131 (05): : 3786 - 3793