Enabling Resource-Aware Mapping of Spiking Neural Networks via Spatial Decomposition

被引:11
|
作者
Balaji, Adarsha [1 ]
Song, Shihao [1 ]
Das, Anup [1 ]
Krichmar, Jeffrey [2 ]
Dutt, Nikil [2 ]
Shackleford, James [1 ]
Kandasamy, Nagarajan [1 ]
Catthoor, Francky [3 ,4 ]
机构
[1] Drexel Univ, Dept Elect & Comp Engn, Philadelphia, PA 19104 USA
[2] Univ Calif Irvine, Dept Comp Sci, Irvine, CA 92697 USA
[3] IMEC, B-3001 Leuven, Belgium
[4] Katholieke Univ Leuven, ESAT, B-3000 Leuven, Belgium
基金
美国国家科学基金会;
关键词
Computation graph; machine learning; neuromorphic computing; spiking neural networks (SNNs); TRADE-OFFS;
D O I
10.1109/LES.2020.3025873
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With growing model complexity, mapping spiking neural network (SNN)-based applications to tile-based neuromorphic hardware is becoming increasingly challenging. This is because the synaptic storage resources on a tile, viz., a crossbar, can accommodate only a fixed number of presynaptic connections per postsynaptic neuron. For complex SNN models that have many presynaptic connections per neuron, some connections may need to be pruned after training to fit onto the tile resources, leading to a loss in the model quality, e.g., accuracy. In this letter, we propose a novel unrolling technique that decomposes a neuron function with many presynaptic connections into a sequence of homogeneous neural units, where each neural unit is a function computation node, with two presynaptic connections. This spatial decomposition technique significantly improves crossbar utilization and retains all presynaptic connections, resulting in no loss of the model quality derived from connection pruning. We integrate the proposed technique within an existing SNN mapping framework and evaluate it using machine learning applications on the DYNAP-SE state-of-the-art neuromorphic hardware. Our results demonstrate an average 60% lower crossbar requirement, $9\times $ higher synapse utilization, 62% lower wasted energy on the hardware, and between 0.8% and 4.6% increase in the model quality.
引用
收藏
页码:142 / 145
页数:4
相关论文
共 50 条
  • [1] RAMP: Resource-Aware Mapping for CGRAs
    Dave, Shail
    Balasubramanian, Mahesh
    Shrivastava, Aviral
    [J]. 2018 55TH ACM/ESDA/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2018,
  • [2] An Efficient and Resource-Aware Hashtag Recommendation Using Deep Neural Networks
    Kao, David
    Lai, Kuan-Ting
    Chen, Ming-Syan
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2019, PT II, 2019, 11440 : 150 - 162
  • [3] FPGA Resource-aware Structured Pruning for Real-Time Neural Networks
    Ramhorst, Benjamin
    Loncar, Vladimir
    Constantinides, George A.
    [J]. 2023 INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE TECHNOLOGY, ICFPT, 2023, : 282 - 283
  • [4] Resource-Aware Saliency-Guided Differentiable Pruning for Deep Neural Networks
    Kallakuri, Uttej
    Humes, Edward
    Mohsenin, Tinoosh
    [J]. PROCEEDING OF THE GREAT LAKES SYMPOSIUM ON VLSI 2024, GLSVLSI 2024, 2024, : 694 - 699
  • [5] Resource-aware speculative prefetching in wireless networks
    Tuah, NJ
    Kumar, M
    Venkatesh, S
    [J]. WIRELESS NETWORKS, 2003, 9 (01) : 61 - 72
  • [6] Resource-aware Speculative Prefetching in Wireless Networks
    N.J. Tuah
    M. Kumar
    S. Venkatesh
    [J]. Wireless Networks, 2003, 9 : 61 - 72
  • [7] Endurance-Aware Mapping of Spiking Neural Networks to Neuromorphic Hardware
    Titirsha, Twisha
    Song, Shihao
    Das, Anup
    Krichmar, Jeffrey
    Dutt, Nikil
    Kandasamy, Nagarajan
    Catthoor, Francky
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (02) : 288 - 301
  • [8] Resource-Aware Video Multicasting via Access Gateways in Wireless Mesh Networks
    Tu, Wanqing
    Sreenan, Cormac J.
    Chou, Chun Tung
    Misra, Archan
    Jha, Sanjay K.
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2012, 11 (06) : 881 - 895
  • [9] Resource-aware Video Multicasting via Access Gateways in Wireless Mesh Networks
    Tu, Wanqing
    Sreenan, Cormac J.
    Chou, Chun Tung
    Misra, Archan
    Jha, Sanjay
    [J]. 16TH IEEE INTERNATIONAL CONFERENCE ON NETWORK PROTOCOLS: ICNP'08, 2008, : 43 - +
  • [10] Resource-aware conference key establishment for heterogeneous networks
    Trappe, W
    Wang, Y
    Liu, KJR
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2005, 13 (01) : 134 - 146