SpikeExplorer: Hardware-Oriented Design Space Exploration for Spiking Neural Networks on FPGA

被引:1
|
作者
Padovano, Dario [1 ]
Carpegna, Alessio [1 ]
Savino, Alessandro [1 ]
Di Carlo, Stefano [1 ]
机构
[1] Politecn Torino, Control & Comp Engn Dept, I-10129 Turin, Italy
关键词
neuromorphic; Spiking Neural Networks; hardware accelerators; FPGA; Design Space Exploration; network architecture search; hyperparameter optimization;
D O I
10.3390/electronics13091744
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
One of today's main concerns is to bring artificial intelligence capabilities to embedded systems for edge applications. The hardware resources and power consumption required by state-of-the-art models are incompatible with the constrained environments observed in edge systems, such as IoT nodes and wearable devices. Spiking Neural Networks (SNNs) can represent a solution in this sense: inspired by neuroscience, they reach unparalleled power and resource efficiency when run on dedicated hardware accelerators. However, when designing such accelerators, the amount of choices that can be taken is huge. This paper presents SpikExplorer, a modular and flexible Python tool for hardware-oriented Automatic Design Space Exploration to automate the configuration of FPGA accelerators for SNNs. SpikExplorer enables hardware-centric multiobjective optimization, supporting target factors such as accuracy, area, latency, power, and various combinations during the exploration process. The tool searches the optimal network architecture, neuron model, and internal and training parameters leveraging Bayesian optimization, trying to reach the desired constraints imposed by the user. It allows for a straightforward network configuration, providing the full set of explored points for the user to pick the trade-off that best fits their needs. The potential of SpikExplorer is showcased using three benchmark datasets. It reaches 95.8% accuracy on the MNIST dataset, with a power consumption of 180 mW/image and a latency of 0.12 ms/image, making it a powerful tool for automatically optimizing SNNs.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] The Deferred Event Model for Hardware-Oriented Spiking Neural Networks
    Rast, Alexander
    Jin, Xin
    Khan, Mukaram
    Furber, Steve
    ADVANCES IN NEURO-INFORMATION PROCESSING, PT II, 2009, 5507 : 1057 - 1064
  • [2] Hardware Implementation of Spiking Neural Networks on FPGA
    Han, Jianhui
    Li, Zhaolin
    Zheng, Weimin
    Zhang, Youhui
    TSINGHUA SCIENCE AND TECHNOLOGY, 2020, 25 (04) : 479 - 486
  • [3] Hardware Implementation of Spiking Neural Networks on FPGA
    Jianhui Han
    Zhaolin Li
    Weimin Zheng
    Youhui Zhang
    Tsinghua Science and Technology, 2020, 25 (04) : 479 - 486
  • [4] Hardware-oriented algorithm for associative memories on cellular neural networks
    Perfetti, R
    Salerno, M
    Costantini, G
    CELLULAR NEURAL NETWORKS AND THEIR APPLICATIONS, 2002, : 532 - 538
  • [5] A Hardware-oriented Learning Algorithm for a Digital Spiking Neuron
    Torikai, Hiroyuki
    Hashimoto, Sho
    2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, : 2472 - 2479
  • [6] Design Space Exploration of FPGA Accelerators for Convolutional Neural Networks
    Rahman, Atul
    Oh, Sangyun
    Lee, Jongeun
    Choi, Kiyoung
    PROCEEDINGS OF THE 2017 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE), 2017, : 1147 - 1152
  • [7] EMULATING SPIKING NEURAL NETWORKS FOR EDGE DETECTION ON FPGA HARDWARE
    Glackin, Brendan
    Harkin, Jitn
    McGinnity, Thomas M.
    Maguire, Liam P.
    Wu, Qingxiang
    FPL: 2009 INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE LOGIC AND APPLICATIONS, 2009, : 670 - 673
  • [8] A Novel Hardware-Oriented Stereo Matching Algorithm and Its Architecture Design in FPGA
    Li, Yanzhe
    Huang, Kai
    Claesen, Luc
    VLSI-SOC: SYSTEM-ON-CHIP IN THE NANOSCALE ERA - DESIGN, VERIFICATION AND RELIABILITY, 2017, 508 : 213 - 232
  • [9] A Hardware-Oriented Echo State Network for FPGA Implementation
    Honda, Kentaro
    Tamukoh, Hakaru
    PROCEEDINGS OF THE 2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS (ICAROB2020), 2020, : 187 - 190
  • [10] FPGA Implementation of Hardware-Oriented Chaotic Boltzmann Machines
    Kawashima, Ichiro
    Morie, Takashi
    Tamukoh, Hakaru
    IEEE ACCESS, 2020, 8 : 204360 - 204377