AxOSpike: Spiking Neural Networks-Driven Approximate Operator Design

被引:0
|
作者
Ullah, Salim [1 ]
Sahoo, Siva Satyendra [2 ]
Kumar, Akash [1 ]
机构
[1] Ruhr Univ Bochum, Chair Embedded Syst, D-44801 Bochum, Germany
[2] Interuniv Microelect Ctr, B-3001 Leuven, Belgium
关键词
Accuracy; Embedded systems; Computational modeling; Neurons; Spiking neural networks; Hardware; Space exploration; Integrated circuit modeling; Arithmetic; Resilience; Accelerator architecture; AxC; arithmetic circuit design; computer arithmetic; FPGAs; operator modeling; SNNs;
D O I
10.1109/TCAD.2024.3443000
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Approximate computing (AxC) is being widely researched as a viable approach to deploying compute-intensive artificial intelligence (AI) applications on resource-constrained embedded systems. In general, AxC aims to provide disproportionate gains in system-level power-performance-area (PPA) by leveraging the implicit error tolerance of an application. One of the more widely used methods in AxC involves circuit pruning of arithmetic operators used to process AI workloads. However, most related works adopt an application-agnostic approach to operator modeling for the design space exploration (DSE) of Approximate Operators (AxOs). To this end, we propose an application-driven approach to designing AxOs. Specifically, we use spiking neural network (SNN)-based inference to present an application-driven operator model resulting in AxOs with better-PPA-accuracy tradeoffs compared to traditional circuit pruning. Additionally, we present a novel FPGA-specific operator model to improve the quality of AxOs that can be obtained using circuit pruning. With the proposed methods, we report designs with up to 26.5% lower PDPxLUTs with similar application-level accuracy. Further, we report a considerably better set of design points than related works with up to 51% better-Pareto front hypervolume.
引用
收藏
页码:3324 / 3335
页数:12
相关论文
共 50 条
  • [41] Training Spiking Neural Networks with Accumulated Spiking Flow
    Wu, Hao
    Zhang, Yueyi
    Weng, Wenming
    Zhang, Yongting
    Xiong, Zhiwei
    Zha, Zheng-Jun
    Sun, Xiaoyan
    Wu, Feng
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10320 - 10328
  • [42] Spiking PointNet: Spiking Neural Networks for Point Clouds
    Ren, Dayong
    Ma, Zhe
    Chen, Yuanpei
    Peng, Weihang
    Liu, Xiaode
    Zhang, Yuhan
    Guo, Yufei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [43] A Survey of Intelligent Chip Design Research Based on Spiking Neural Networks
    Chen, Lu
    Xiong, Xingzhong
    Liu, Jun
    IEEE ACCESS, 2022, 10 : 89663 - 89686
  • [44] An FPGA design framework for large-scale spiking neural networks
    Wang, Runchun
    Hamilton, Tara Julia
    Tapson, Jonathan
    van Schaik, Andre
    2014 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2014, : 457 - 460
  • [45] Design of NbOx memristive neuron and its application in spiking neural networks
    Gu Ya-Na
    Liang Yan
    Wang Guang-Yi
    Xia Chen-Yang
    ACTA PHYSICA SINICA, 2022, 71 (11)
  • [46] Neural Architecture Search for Spiking Neural Networks
    Kim, Youngeun
    Li, Yuhang
    Park, Hyoungseob
    Venkatesha, Yeshwanth
    Panda, Priyadarshini
    COMPUTER VISION, ECCV 2022, PT XXIV, 2022, 13684 : 36 - 56
  • [47] Incremental Neural Synthesis for Spiking Neural Networks
    Huy Le Nguyen
    Chu, Dominique
    2022 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2022, : 649 - 656
  • [48] An approximate gradient descent algorithm for Spiking Neural Network
    Chen, Wenjie
    Li, Chuandong
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4690 - 4694
  • [49] Neural networks for the approximate analysis and design of double layer grids
    Kaveh, A.
    Servati, H.
    International Journal of Space Structures, 2002, 17 (01) : 77 - 89
  • [50] Design and Implementation of an Approximate Softmax Layer for Deep Neural Networks
    Gao, Yue
    Liu, Weiqiang
    Lombardi, Fabrizio
    2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2020,