SpikeExplorer: Hardware-Oriented Design Space Exploration for Spiking Neural Networks on FPGA

被引:1
|
作者
Padovano, Dario [1 ]
Carpegna, Alessio [1 ]
Savino, Alessandro [1 ]
Di Carlo, Stefano [1 ]
机构
[1] Politecn Torino, Control & Comp Engn Dept, I-10129 Turin, Italy
关键词
neuromorphic; Spiking Neural Networks; hardware accelerators; FPGA; Design Space Exploration; network architecture search; hyperparameter optimization;
D O I
10.3390/electronics13091744
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
One of today's main concerns is to bring artificial intelligence capabilities to embedded systems for edge applications. The hardware resources and power consumption required by state-of-the-art models are incompatible with the constrained environments observed in edge systems, such as IoT nodes and wearable devices. Spiking Neural Networks (SNNs) can represent a solution in this sense: inspired by neuroscience, they reach unparalleled power and resource efficiency when run on dedicated hardware accelerators. However, when designing such accelerators, the amount of choices that can be taken is huge. This paper presents SpikExplorer, a modular and flexible Python tool for hardware-oriented Automatic Design Space Exploration to automate the configuration of FPGA accelerators for SNNs. SpikExplorer enables hardware-centric multiobjective optimization, supporting target factors such as accuracy, area, latency, power, and various combinations during the exploration process. The tool searches the optimal network architecture, neuron model, and internal and training parameters leveraging Bayesian optimization, trying to reach the desired constraints imposed by the user. It allows for a straightforward network configuration, providing the full set of explored points for the user to pick the trade-off that best fits their needs. The potential of SpikExplorer is showcased using three benchmark datasets. It reaches 95.8% accuracy on the MNIST dataset, with a power consumption of 180 mW/image and a latency of 0.12 ms/image, making it a powerful tool for automatically optimizing SNNs.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Design Space Exploration of Hardware Spiking Neurons for Embedded Artificial Intelligence
    Abderrahmane, Nassim
    Lemaire, Edgar
    Miramond, Benoit
    NEURAL NETWORKS, 2020, 121 : 366 - 386
  • [22] Hardware-Oriented Dual Stream Object Recognition System using Binarized Neural Networks
    Yoshimoto, Yuma
    Tamukoh, Hakaru
    2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2020,
  • [23] A novel approach for the implementation of large scale spiking neural networks on FPGA hardware
    Glackin, B
    McGinnity, TM
    Maguire, LP
    Wu, Q
    Belatreche, A
    COMPUTATIONAL INTELLIGENCE AND BIOINSPIRED SYSTEMS, PROCEEDINGS, 2005, 3512 : 552 - 563
  • [24] DSCNN: Hardware-Oriented Optimization for Stochastic Computing Based Deep Convolutional Neural Networks
    Li, Zhe
    Ren, Ao
    Li, Ji
    Qiu, Qinru
    Wang, Yanzhi
    Yuan, Bo
    PROCEEDINGS OF THE 34TH IEEE INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD), 2016, : 678 - 681
  • [25] A Hardware-Oriented Random Number Generation Method and A Verification System for FPGA
    Hori, Sansei
    Tamukoh, Hakaru
    PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS (ICAROB 2021), 2021, : 12 - 15
  • [26] A New Hardware-oriented Spiking Neuron Model Based on SET and Its Properties
    Liu Wen-peng
    Chen Xu
    Lu Hua-xiang
    2011 INTERNATIONAL CONFERENCE ON PHYSICS SCIENCE AND TECHNOLOGY (ICPST), 2011, 22 : 170 - 176
  • [27] Toward the Optimal Design and FPGA Implementation of Spiking Neural Networks
    Guo, Wenzhe
    Yantir, Hasan Erdem
    Fouda, Mohammed E.
    Eltawil, Ahmed M.
    Salama, Khaled Nabil
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (08) : 3988 - 4002
  • [28] A Hardware-Oriented Random Number Generation Method and A Verification System for FPGA
    Hori, Sansei
    Tamukoh, Hakaru
    PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS (ICAROB 2021), 2021, : P79 - P79
  • [29] Spiking Neural Networks Design-Space Exploration Platform Supporting Online and Offline Learning
    El-Masry, Moamen
    Anees, Sohaib
    Weigel, Robert
    2023 IEEE 36TH INTERNATIONAL SYSTEM-ON-CHIP CONFERENCE, SOCC, 2023, : 319 - 323
  • [30] An Efficient Spiking Neuron Hardware System Based on the Hardware-Oriented Modified Izhikevich Neuron (HOMIN) Model
    Leigh, Alexander J.
    Mirhassani, Mitra
    Muscedere, Roberto
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2020, 67 (12) : 3377 - 3381