Weighted Von Mises Distribution-based Loss Function for Real-time STFT Phase Reconstruction Using DNN

被引:0
|
作者
Thien, Nguyen Binh [1 ]
Wakabayashi, Yukoh [2 ]
Geng Yuting [1 ]
Iwai, Kenta [1 ]
Nishiura, Takanobu [1 ]
机构
[1] Ritsumeikan Univ, Shiga, Japan
[2] Toyohashi Univ Technol, Toyohashi, Aichi, Japan
来源
关键词
Deep neural network; phase reconstruction; instantaneous frequency; group delay; von Mises distribution; CHANNEL SPEECH ENHANCEMENT; SIGNAL ESTIMATION; NETWORKS;
D O I
10.21437/Interspeech.2023-580
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This paper presents improvements to real-time phase reconstruction using deep neural networks (DNNs). The advantage of DNN-based approaches in phase reconstruction is that they can leverage prior knowledge from data and are adaptable to real-time applications by using causal models. However, conventional DNN-based methods do not consider the varying properties of the phase at different time-frequency bins. Our paper proposes loss functions for phase reconstruction that incorporate frequency-specific and amplitude weights to distinguish the importance of phase elements based on their properties. We also use an extension of the group delay to improve the phase connections along the frequency. To improve the generalization, we augment the data by randomly shifting the signals in the time domain for each epoch during training. Experimental results show the superior performance of the proposed methods compared to conventional DNN-based and non-DNN real-time phase reconstruction methods.
引用
收藏
页码:3864 / 3868
页数:5
相关论文
共 50 条
  • [41] A function-based approach to real-time visualization using graphics processing units
    Vyatkin, Sergey, I
    Romanyuk, Olexander N.
    Pavlov, Sergii, V
    Romanyuk, Oksana, V
    Snigur, Anatoly, V
    Komodo, Pawel
    Smailova, Saule
    Yeraliyeva, Bakhyt
    PHOTONICS APPLICATIONS IN ASTRONOMY, COMMUNICATIONS, INDUSTRY, AND HIGH ENERGY PHYSICS EXPERIMENTS 2020, 2020, 11581
  • [42] Real-time reconstruction of the time-dependent heat flux and temperature distribution in participating media by using the Kalman filtering technique
    Qi, Hong
    Wen, Shuang
    Wang, Yi-Fei
    Ren, Ya-Tao
    Wei, Lin-Yang
    Ruan, Li-Ming
    APPLIED THERMAL ENGINEERING, 2019, 157
  • [43] Von der Rekonstruktion zur FunktionTympanoplastik-Training mit Real-Time-FeedbackFrom reconstruction to functionHands-on training in tympanoplasty using real-time feedback
    T. Beleites
    T. Zahnert
    M.-L. Polk
    A. Kluge
    M. Neudert
    M. Kemper
    HNO, 2021, 69 : 556 - 561
  • [44] PHASE CONTROL DURING RECONSTRUCTION OF HOLOGRAPHICALLY RECORDED FLOW FIELDS USING REAL-TIME HOLOGRAPHIC INTERFEROMETRY.
    Burner, A.W.
    Goad, W.K.
    NASA Technical Memorandum, 1981,
  • [45] Optimal scan delay of arterial phase scanning of hepatic CT using a real-time image reconstruction system
    Shimizu, T
    Misaki, T
    Yamamoto, K
    Tanaka, Y
    Utsunomiya, K
    Sueyoshi, K
    CLINICAL IMAGING, 1999, 23 (02) : 107 - 110
  • [46] Model-Based Reconstruction for Real-Time Phase-Contrast Flow MRI: Improved Spatiotemporal Accuracy
    Tan, Zhengguo
    Roeloffs, Volkert
    Voit, Dirk
    Joseph, Arun A.
    Untenberger, Markus
    Merboldt, K. Dietmar
    Frahm, Jens
    MAGNETIC RESONANCE IN MEDICINE, 2017, 77 (03) : 1082 - 1093
  • [47] Real-time reconstruction using electro-optics modulator-based structured illumination microscopy
    Xu, Fanghui
    Zhang, Jiachen
    Ding, Dongdong
    Liu, Wenjie
    Zheng, Chi
    Zhou, Sijia
    Chen, Youhua
    Kuang, Cuifang
    OPTICS EXPRESS, 2022, 30 (08): : 13238 - 13251
  • [48] Homography based parallel volume intersection: Toward real-time volume reconstruction using active cameras
    Wada, T
    Wu, XJ
    Tokai, S
    Matsuyama, T
    5TH INTERNATIONAL WORKSHOP ON COMPUTER ARCHITECTURES FOR MACHINE PERCEPTION, PROCEEDINGS, 2000, : 331 - 339
  • [49] Real-time 3D Reconstruction in Dynamic Scenes using Point-based Fusion
    Keller, Maik
    Lefloch, Damien
    Lambers, Martin
    Izadi, Shahram
    Weyrich, Tim
    Kolb, Andreas
    2013 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2013), 2013, : 1 - 8
  • [50] Real-time 3D Reconstruction Using a Combination of Point-based and Volumetric Fusion
    Xia, Zhengyu
    Kim, Joohee
    Park, Young Soo
    2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 8449 - 8455