Unsupervised feature learning for environmental sound classification using Weighted Cycle-Consistent Generative Adversarial Network

被引:33
|
作者
Esmaeilpour, Mohammad [1 ]
Cardinal, Patrick [1 ]
Koerich, Alessandro Lameiras [1 ]
机构
[1] Univ Quebec, ETS, 1100 Notre Dame West, Montreal, PQ H3C 1K3, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Environmental sound classification; Generative Adversarial Network (GAN); Cycle-Consistent GAN; K-means plus; Random forests; QUALITY ASSESSMENT; AUDIO; RECOGNITION;
D O I
10.1016/j.asoc.2019.105912
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we propose a novel environmental sound classification approach incorporating unsupervised feature learning via the spherical K-Means++ algorithm and a new architecture for high-level data augmentation. The audio signal is transformed into a 2D representation using a discrete wavelet transform (DWT). The DWT spectrograms are then augmented by a novel architecture for cycle-consistent generative adversarial network. This high-level augmentation bootstraps generated spectrograms in both intra-and inter-class manners by translating structural features from sample to sample. A codebook is built by coding the DWT spectrograms with the speeded-up robust feature detector and the K-Means++ algorithm. The Random forest is the final learning algorithm which learns the environmental sound classification task from the code vectors. Experimental results in four benchmarking environmental sound datasets (ESC-10, ESC-50, UrbanSound8k, and DCASE-2017) have shown that the proposed classification approach outperforms most of the state-of-the-art classifiers, including convolutional neural networks such as AlexNet and GoogLeNet, improving the classification rate between 3.51% and 14.34%, depending on the dataset. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Adversarial sample attacks algorithm based on cycle-consistent generative networks
    Gao, Haoqi
    Yang, Xing
    Hu, Yihua
    Liang, Zhenyu
    Xu, Haoli
    Wang, Bingwen
    Mu, Hua
    Wang, Yangyang
    [J]. APPLIED SOFT COMPUTING, 2024, 162
  • [32] A fast least-squares reverse time migration method using cycle-consistent generative adversarial network
    Huang, Yunbo
    Huang, Jianping
    Ma, Yangyang
    [J]. FRONTIERS IN EARTH SCIENCE, 2022, 10
  • [33] Removal of Visual Disruption Caused by Rain Using Cycle-Consistent Generative Adversarial Networks
    Tang, Lai Meng
    Lim, Li Hong
    Siebert, Paul
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 551 - 566
  • [34] A Parallel-Data-Free Speech Enhancement Method Using Multi-Objective Learning Cycle-Consistent Generative Adversarial Network
    Xiang, Yang
    Bao, Changchun
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2020, 28 : 1826 - 1838
  • [35] ESA-CycleGAN: Edge feature and self-attention based cycle-consistent generative adversarial network for style transfer
    Wang, Li
    Wang, Lidan
    Chen, Shubai
    [J]. IET IMAGE PROCESSING, 2022, 16 (01) : 176 - 190
  • [36] Reinventing Web Security: An Enhanced Cycle-Consistent Generative Adversarial Network Approach to Intrusion Detection
    Fang, Menghao
    Wang, Yixiang
    Yang, Liangbin
    Wu, Haorui
    Yin, Zilin
    Liu, Xiang
    Xie, Zexian
    Kong, Zixiao
    [J]. ELECTRONICS, 2024, 13 (09)
  • [37] DFC-dehaze: an improved cycle-consistent generative adversarial network for unpaired image dehazing
    Shibin Wang
    Xueshu Mei
    Pengshuai Kang
    Yan Li
    Dong Liu
    [J]. The Visual Computer, 2024, 40 : 2807 - 2818
  • [38] Lund jet images from generative and cycle-consistent adversarial networks
    Carrazza, Stefano
    Dreyer, Frederic A.
    [J]. EUROPEAN PHYSICAL JOURNAL C, 2019, 79 (11):
  • [39] DFC-dehaze: an improved cycle-consistent generative adversarial network for unpaired image dehazing
    Wang, Shibin
    Mei, Xueshu
    Kang, Pengshuai
    Li, Yan
    Liu, Dong
    [J]. VISUAL COMPUTER, 2024, 40 (04): : 2807 - 2818
  • [40] Lund jet images from generative and cycle-consistent adversarial networks
    Stefano Carrazza
    Frédéric A. Dreyer
    [J]. The European Physical Journal C, 2019, 79