Urban sound classification using neural networks on embedded FPGAs

被引:1
|
作者
Belloch, Jose A. [1 ]
Coronado, Raul [1 ]
Valls, Oscar [2 ]
del Amor, Rocio [2 ]
Leon, German [3 ]
Naranjo, Valery [2 ]
Dolz, Manuel F. [3 ]
Amor-Martin, Adrian [4 ]
Pinero, Gema [5 ]
机构
[1] Univ Carlos III Madrid, Dept Tecnol Elect, Avda Univ 30, Leganes 28911, Madrid, Spain
[2] Univ Politecn Valencia, Inst Univ Invest Tecnol Centrada Ser Humano HUMAN, Camino Vera S-N, Valencia 46022, Spain
[3] Univ Jaume I Castellon, Dept Ingn & Ciencia Comp, Avda Sos Baynat s-n, Castellon de La Plana 12071, Spain
[4] Univ Carlos III Madrid, Dept Teoria Senal & Comunicac, Avda Univ 30, Madrid 28911, Spain
[5] Univ Politecn Valencia, Inst Telecomunicac & Aplicac Multimedia, Camino Vera S-N, E-46022 Valencia, Spain
来源
JOURNAL OF SUPERCOMPUTING | 2024年 / 80卷 / 09期
关键词
FPGA; Sound classification; Hardware acceleration; Convolutional neural networks; Deep learning;
D O I
10.1007/s11227-024-05947-8
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Sound classification using neural networks has recently produced very accurate results. A large number of different applications use this type of sound classifiers such as controlling and monitoring the type of activity in a city or identifying different types of animals in natural environments. While traditional acoustic processing applications have been developed on high-performance computing platforms equipped with expensive multi-channel audio interfaces, the Internet of Things (IoT) paradigm requires the use of more flexible and energy-efficient systems. Although software-based platforms exist for implementing general-purpose neural networks, they are not optimized for sound classification, wasting energy and computational resources. In this work, we have used FPGAs to develop an ad hoc system where only the hardware needed for our application is synthesized, resulting in faster and more energy-efficient circuits. The results show that our developments are accelerated by a factor of 35 compared to a software-based implementation on a Raspberry Pi.
引用
收藏
页码:13176 / 13186
页数:11
相关论文
共 50 条
  • [41] Environmental Sound Recognition on Embedded Systems: From FPGAs to TPUs
    Vandendriessche, Jurgen
    Wouters, Nick
    da Silva, Bruno
    Lamrini, Mimoun
    Chkouri, Mohamed Yassin
    Touhafi, Abdellah
    ELECTRONICS, 2021, 10 (21)
  • [42] Feature Aggregation in Joint Sound Classification and Localization Neural Networks
    Healy, Brendan
    Mcnamee, Patrick
    Ahmadabadi, Zahra Nili
    IEEE ACCESS, 2024, 12 : 109157 - 109170
  • [43] Classification and mapping of sound sources in local urban streets through AudioSet data and Bayesian optimized Neural Networks
    Verma, Deepank
    Jana, Arnab
    Ramamritham, Krithi
    NOISE MAPPING, 2019, 6 (01) : 52 - 71
  • [44] Selective Hardening for Neural Networks in FPGAs
    Libano, F.
    Wilson, B.
    Anderson, J.
    Wirthlin, M. J.
    Cazzaniga, C.
    Frost, C.
    Rech, P.
    IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2019, 66 (01) : 216 - 222
  • [45] FAQ-CNN: A Flexible Acceleration Framework for Quantized Convolutional Neural Networks on Embedded FPGAs
    Xie K.
    Lu Y.
    Jin Z.
    Liu Y.
    Gong C.
    Chen X.
    Li T.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2022, 59 (07): : 1409 - 1427
  • [46] Customisable Processing of Neural Networks for FPGAs
    Denholm, Stewart
    Luk, Wayne
    THE PROCEEDINGS OF THE 13TH INTERNATIONAL SYMPOSIUM ON HIGHLY EFFICIENT ACCELERATORS AND RECONFIGURABLE TECHNOLOGIES, HEART 2023, 2023, : 69 - 77
  • [47] Feature extraction and classification of heart sound using 1D convolutional neural networks
    Li, Fen
    Liu, Ming
    Zhao, Yuejin
    Kong, Lingqin
    Dong, Liquan
    Liu, Xiaohua
    Hui, Mei
    EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2019, 2019 (01)
  • [48] "Seeing Sound": Audio Classification Using theWigner-Ville Distribution and Convolutional Neural Networks
    Marios, Christonasis Antonios
    van Eijndhoven, Stef
    Duin, Peter
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 1, INTELLISYS 2023, 2024, 822 : 145 - 155
  • [49] Feature extraction and classification of heart sound using 1D convolutional neural networks
    Fen Li
    Ming Liu
    Yuejin Zhao
    Lingqin Kong
    Liquan Dong
    Xiaohua Liu
    Mei Hui
    EURASIP Journal on Advances in Signal Processing, 2019
  • [50] SHORT-SEGMENT HEART SOUND CLASSIFICATION USING AN ENSEMBLE OF DEEP CONVOLUTIONAL NEURAL NETWORKS
    Noman, Fuad
    Ting, Chee-Ming
    Salleh, Sh-Hussain
    Ombao, Hernando
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 1318 - 1322