Time-Frequency Filter Bank: A Simple Approach for Audio and Music Separation

被引:7
|
作者
Yang, Ning [1 ]
Usman, Muhammad [2 ]
He, Xiangjian [2 ]
Jan, Mian Ahmad [3 ]
Zhang, Liming [4 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian 710072, Shaanxi, Peoples R China
[2] Univ Technol Sydney, Sch Elect & Data Engn, Ultimo, NSW 2007, Australia
[3] Abdul Wali Khan Univ, Dept Comp Sci, Mardan 23200, Pakistan
[4] Univ Macau, Sch Comp Sci, Zhuhai 999078, Peoples R China
来源
IEEE ACCESS | 2017年 / 5卷
关键词
Blind Source Separation; Short Time Fourier Transform; OverLap-Add; SIR; SDR; BLIND SOURCE SEPARATION; FOURIER-TRANSFORM; BAYESIAN NONPARAMETRICS; SPEECH ENHANCEMENT; MIXTURES; SIGNALS; MODEL; STFT; DECOMPOSITION; FACTORIZATION;
D O I
10.1109/ACCESS.2017.2761741
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Blind Source Separation techniques are widely used in the field of wireless communication for a very long time to extract signals of interest from a set of multiple signals without training data. In this paper, we investigate the problem of separation of the human voice from a mixture of human voice and sounds from different musical instruments. The human voice may be a singing voice in a song or may be a part of some news, broadcast by a channel with background music. This paper proposes a generalized Short Time Fourier Transform (STFT)-based technique, combined with filter bank to extract vocals from background music. The main purpose is to design a filter bank and to eliminate background aliasing errors with best reconstruction conditions, having approximated scaling factors. Stereo signals in time-frequency domain are used in experiments. The input stereo signals are processed in the form of frames and passed through the proposed STFT-based technique. The output of the STFT-based technique is passed through the filter bank to minimize the background aliasing errors. For reconstruction, first an inverse STFT is applied and then the signals are reconstructed by the OverLap-Add method to get the final output, containing vocals only. The experiments show that the proposed approach performs better than the other state-of-the-art approaches, in terms of Signal-to-Interference Ratio (SIR) and Signal-to-Distortion Ratio (SDR), respectively.
引用
收藏
页码:27114 / 27125
页数:12
相关论文
共 50 条
  • [1] Adaptive Time-Frequency Analysis for Noise Reduction in an Audio Filter Bank With Low Delay
    Andersen, Kristian Timm
    Moonen, Marc
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2016, 24 (04) : 784 - 795
  • [2] AUDIO SOURCE SEPARATION WITH TIME-FREQUENCY VELOCITIES
    Wolf, Guy
    Mallat, Stephane
    Shamma, Shihab
    [J]. 2014 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2014,
  • [3] Exploiting Time-Frequency Conformers for Music Audio Enhancement
    Chae, Yunkee
    Koo, Junghyun
    Lee, Sungho
    Lee, Kyogu
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 2362 - 2370
  • [4] A NEW FILTER BANK THEORY FOR TIME-FREQUENCY REPRESENTATION
    SMITH, MJT
    BARNWELL, TP
    [J]. IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1987, 35 (03): : 314 - 327
  • [5] Audio source separation with multiple microphones on time-frequency representations
    Sawada, Hiroshi
    [J]. INDEPENDENT COMPONENT ANALYSES, COMPRESSIVE SAMPLING, WAVELETS, NEURAL NET, BIOSYSTEMS, AND NANOENGINEERING XI, 2013, 8750
  • [6] Music Files Compression Based on Time-Frequency Representation of Audio Signal
    Shekhirev, Andrew V.
    Rabinovich, Evgeniy V.
    [J]. IFOST 2008: PROCEEDING OF THE THIRD INTERNATIONAL FORUM ON STRATEGIC TECHNOLOGIES, 2008, : 340 - 342
  • [7] Time-frequency MUSIC
    Belouchrani, A
    Amin, MG
    [J]. IEEE SIGNAL PROCESSING LETTERS, 1999, 6 (05) : 109 - 110
  • [9] Maximum likelihood approach for blind audio source separation using time-frequency Gaussian source models
    Févotte, C
    Cardoso, JF
    [J]. 2005 WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA), 2005, : 78 - 81
  • [10] Time-Frequency Approach to Underdetermined Blind Source Separation
    Xie, Shengli
    Yang, Liu
    Yang, Jun-Mei
    Zhou, Guoxu
    Xiang, Yong
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (02) : 306 - 316