Artificial bandwidth extension using deep neural network-based spectral envelope estimation and enhanced excitation estimation

被引:20
|
作者
Li, Yaxing [1 ]
Kang, Sangwon [1 ]
机构
[1] Hanyang Univ, Dept Elect & Commun Engn, Ansan 426791, South Korea
关键词
speech synthesis; neural nets; filtering theory; speech coding; artificial bandwidth extension; deep neural network-based spectral envelope estimation; enhanced excitation estimation; narrowband speech signal quality; enhanced spectrum envelope; excitation estimation; whitening filter; adaptive spectral double shifting method; adaptive multirate codec; log spectral distortion; perceptual evaluation;
D O I
10.1049/iet-spr.2015.0375
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The authors propose a robust artificial bandwidth extension (ABE) technique to improve narrowband (NB) speech signal quality using an enhanced spectrum envelope and excitation estimation. For envelope estimation, they propose an enhanced envelope estimation method using a deep neural network with multiple layers. For excitation estimation, they use a whitened NB excitation signal that is generated by passing the excitation signal through a whitening filter. An adaptive spectral double shifting method is introduced to obtain an enhanced wideband (WB) excitation signal. The proposed ABE system is applied to the decoded output of an adaptive multi-rate (AMR) codec at 12.2 kbps. They evaluate its performance using log spectral distortion, a WB perceptual evaluation of speech quality, and a formal listening test. The objective and subjective evaluations confirm that the proposed ABE system provides better speech quality than AMR at the same bit rate.
引用
收藏
页码:422 / 427
页数:6
相关论文
共 50 条
  • [1] ARTIFICIAL BANDWIDTH EXTENSION USING DEEP NEURAL NETWORKS FOR SPECTRAL ENVELOPE ESTIMATION
    Abel, Johannes
    Strake, Maximilian
    Fingscheidt, Tim
    2016 IEEE INTERNATIONAL WORKSHOP ON ACOUSTIC SIGNAL ENHANCEMENT (IWAENC), 2016,
  • [2] Artificial Speech Bandwidth Extension Using Deep Neural Networks for Wideband Spectral Envelope Estimation
    Abel, Johannes
    Fingscheidt, Tim
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2018, 26 (01) : 71 - 83
  • [3] SPECTRAL ENVELOPE ESTIMATION USED FOR AUDIO BANDWIDTH EXTENSION BASED ON RBF NEURAL NETWORK
    Liu, Hao-jie
    Bao, Chang-chun
    Liu, Xin
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 543 - 547
  • [4] Bandwidth extension method based on spectral envelope estimation
    Hang B.
    Hu R.
    Dong S.
    Ma Y.
    Journal of Multimedia, 2011, 6 (03): : 269 - 276
  • [5] Neural network-based estimation and compensation of friction for enhanced deep drawing process control
    Thiery, Sebastian
    El Abdine, Mazhar Zein
    Heger, Jens
    Ben Khalifa, Noomane
    MATERIAL FORMING, ESAFORM 2024, 2024, 41 : 1462 - 1471
  • [6] Artificial neural network-based approach to thermodynamic property estimation
    Van de Vijver, Ruben
    Plehiers, Pieter
    Verberckmoes, Pieter-Jan
    Marin, Guy
    Stevens, Christian
    Van Geem, Kevin
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2019, 258
  • [7] Neural Network-based Estimation of the MMSE
    Diaz, Mario
    Kairouz, Peter
    Liao, Jiachun
    Sankar, Lalitha
    2021 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2021, : 1023 - 1028
  • [8] Artificial Neural Network-Based Algorithm for ARMA Model Order Estimation
    Al-Qawasmi, Khaled E.
    Al-Smadi, Adnan M.
    Al-Hamami, Alaa
    NETWORKED DIGITAL TECHNOLOGIES, PT 2, 2010, 88 : 184 - +
  • [9] Artificial neural network-based hysteresis estimation of capacitive pressure sensor
    Dibi, Zohir
    Hafiane, M. Lamine
    PHYSICA STATUS SOLIDI B-BASIC SOLID STATE PHYSICS, 2007, 244 (01): : 468 - 473
  • [10] Artificial Neural Network-based Estimation of Individual Localization Errors in Fingerprinting
    Lemic, Filip
    Famaey, Jeroen
    2020 IEEE 17TH ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC 2020), 2020,