WIDE-AREA 6DOF RENDERING OF MULTI-POINT AMBISONIC RECORDINGS BASED ON INTERPOLATION OF SPATIAL PARAMETERS

被引:0
|
作者
Politis, Archontis [1 ]
Pajunen, Lauros [2 ]
Leppanen, Jussi [2 ]
Mate, Sujeet [2 ]
Eronen, Antti [2 ]
机构
[1] Tampere Univ, Audio Res Grp, Tampere, Finland
[2] Nokia Technol, Tampere, Finland
关键词
spatial audio; 6DoF; Ambisonics; binaural; VR/AR; immersive media; MPEG; SOUND SCENES;
D O I
10.1109/WASPAA58266.2023.10248142
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This work presents a method for 6DoF binaural rendering from multi-point first- or higher-order Ambisonic (FOA/HOA) recordings. Previous methods were either based on wavefield decompositions or expansions, with extreme hardware requirements and a limited effective bandwidth, or based on spatial filtering of prominent sources, which can prove difficult in dense multi-source scenes in reverberant environments. The proposed method measures spatial parameters in the time-frequency domain that summarize the scene at the microphone positions. It then estimates the same parameters at the listener position through spatial interpolation of the measured ones. A prototype 3DoF binaural signal, produced from the FOA/HOA recording closest to the listener with high signal fidelity, is then adapted to match binaural cues dictated by the interpolated spatial parameters. The method is designed to support perceptually plausible rendering for scenes of arbitrary complexity even from FOA recordings spaced widely apart in unstructured arrangements. A real-time 6DOF listening preference test demonstrates higher-perceived spatial quality of the method compared to alternatives that mix spatially HOA recordings. This work is related to the upcoming MPEG-I immersive audio standard (ISO/IEC 23090-4) which is defining 6DoF immersive audio technology for AR and VR scenarios.
引用
收藏
页数:5
相关论文
共 2 条
  • [1] A wide-area relaying protection system based on multi-point measurement information
    Li, Zhenxing
    Meng, Xiaoxing
    Wang, Xin
    Deng, Jinglei
    IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2018, 13 (04) : 529 - 536
  • [2] Multi-Point Time-Synchronized Waveform Recording for the Analysis of Wide-Area Harmonic Propagation
    Babaev, Stanislav
    Singh, Ravi Shankar
    Cobben, Sjef
    Cuk, Vladimir
    Downie, Allan
    APPLIED SCIENCES-BASEL, 2020, 10 (11):