Phase-aware music super-resolution using generative adversarial networks

被引:10
|
作者
Hu, Shichao [1 ]
Zhang, Bin [1 ]
Liang, Beici [1 ]
Zhao, Ethan [1 ]
Lui, Simon [1 ]
机构
[1] Tencent Mus Entertainment TME, Shenzhen 518057, Peoples R China
来源
关键词
Music super-resolution; Bandwidth expansion; Generative adversarial network; Phase estimation; BANDWIDTH EXTENSION; NARROW-BAND; SPEECH;
D O I
10.21437/Interspeech.2020-2605
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
Audio super-resolution is a challenging task of recovering the missing high-resolution features from a low-resolution signal. To address this, generative adversarial networks (GAN) have been used to achieve promising results by training the mappings between magnitudes of the low and high-frequency components. However, phase information is not well-considered for waveform reconstruction in conventional methods. In this paper, we tackle the problem of music super-resolution and conduct a thorough investigation on the importance of phase for this task. We use GAN to predict the magnitudes of the high-frequency components. The corresponding phase information can be extracted using either a GAN-based waveform synthesis system or a modified Griffin-Lim algorithm. Experimental results show that phase information plays an important role in the improvement of the reconstructed music quality. Moreover, our proposed method significantly outperforms other state-of-the-art methods in terms of objective evaluations.
引用
收藏
页码:4074 / 4078
页数:5
相关论文
共 50 条
  • [21] IMAGE SUPER-RESOLUTION USING COMPLEX DENSE BLOCK ON GENERATIVE ADVERSARIAL NETWORKS
    Chen, Bo-Xun
    Liu, Tsung-Jung
    Liu, Kuan-Hsien
    Liu, Hsin-Hua
    Pei, Soo-Chang
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2866 - 2870
  • [22] Image Super-Resolution using Generative Adversarial Networks with EfficientNetV2
    AlTakrouri, Saleh
    Noor, Norliza Mohd
    Ahmad, Norulhusna
    Justinia, Taghreed
    Usman, Sahnius
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (02) : 879 - 887
  • [23] SOUP-GAN: Super-Resolution MRI Using Generative Adversarial Networks
    Zhang, Kuan
    Hu, Haoji
    Philbrick, Kenneth
    Conte, Gian Marco
    Sobek, Joseph D.
    Rouzrokh, Pouria
    Erickson, Bradley J.
    TOMOGRAPHY, 2022, 8 (02) : 905 - 919
  • [24] Multiframe infrared image super-resolution reconstruction using generative adversarial networks
    Li F.
    He X.
    Wei Z.
    He J.
    He D.
    2018, Chinese Society of Astronautics (47):
  • [25] Multispectral image fusion using super-resolution conditional generative adversarial networks
    Zhang, Junhao
    Shamsolmoali, Pourya
    Zhang, Pengpeng
    Feng, Deying
    Yang, Jie
    JOURNAL OF APPLIED REMOTE SENSING, 2018, 13 (02)
  • [26] Super-Resolution of Solar Active Region Patches Using Generative Adversarial Networks
    Alshehhi, Rasha
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT I, 2022, 13231 : 451 - 462
  • [27] Super-Resolution and Inpainting with Degraded and Upgraded Generative Adversarial Networks
    Huang, Yawen
    Zheng, Feng
    Wang, Danyang
    Jiang, Junyu
    Wang, Xiaoqian
    Shao, Ling
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 645 - 651
  • [28] GENERATIVE ADVERSARIAL NETWORKS AND PERCEPTUAL LOSSES FOR VIDEO SUPER-RESOLUTION
    Lucas, Alice
    Lopez-Tapia, Santiago
    Molina, Rafael
    Katsaggelos, Aggelos K.
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 51 - 55
  • [29] RankSRGAN: Generative Adversarial Networks with Ranker for Image Super-Resolution
    Zhang, Wenlong
    Liu, Yihao
    Dong, Chao
    Qiao, Yu
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3096 - 3105
  • [30] ID Preserving Face Super-Resolution Generative Adversarial Networks
    Li, Jinning
    Zhou, Yichen
    Ding, Jie
    Chen, Cen
    Yang, Xulei
    IEEE ACCESS, 2020, 8 : 138373 - 138381