Synapse Compression for Event-Based Convolutional-Neural-Network Accelerators

被引:2
|
作者
Bamberg, Lennart [1 ]
Pourtaherian, Arash [1 ]
Waeijen, Luc [1 ]
Chahar, Anupam [1 ]
Moreira, Orlando [1 ]
机构
[1] GrAI Matter Labs, F-75012 Paris, France
关键词
CNN; compression; dataflow; event-based; hardware accelerator; near-memory compute; neuromorphic; sparsity; spiking;
D O I
10.1109/TPDS.2023.3239517
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Manufacturing-viable neuromorphic chips require novel compute architectures to achieve the massively parallel and efficient information processing the brain supports so effortlessly. The most promising architectures for that are spiking/event-based, which enables massive parallelism at low complexity. However, the large memory requirements for synaptic connectivity are a showstopper for the execution of modern convolutional neural networks (CNNs) on massively parallel, event-based architectures. The present work overcomes this roadblock by contributing a lightweight hardware scheme to compress the synaptic memory requirements by several thousand times-enabling the execution of complex CNNs on a single chip of small form factor. A silicon implementation in a 12-nm technology shows that the technique achieves a total memory-footprint reduction of up to 374x compared to the best previously published technique at a negligible area overhead.
引用
收藏
页码:1227 / 1240
页数:14
相关论文
共 50 条
  • [1] Convolutional Neural Network for Detection and Classification with Event-based Data
    Damien, Joubert
    Hubert, Konik
    Frederic, Chausse
    PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 200 - 208
  • [2] Convolutional-Neural-Network Based License Plate Location Algorithm
    Jiang Ce
    Hu Anming
    He Wei
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (02)
  • [3] Deep Convolutional Network: an Event-based approach
    Gigena Ivanovich, D.
    Rodriguez, N.
    Pasciaroni, A.
    Julian, P.
    2021 ARGENTINE CONFERENCE ON ELECTRONICS (CAE 2021), 2021, : 50 - 54
  • [4] Using Data Compression for Optimizing FPGA-Based Convolutional Neural Network Accelerators
    Guan, Yijin
    Xu, Ningyi
    Zhang, Chen
    Yuan, Zhihang
    Cong, Jason
    ADVANCED PARALLEL PROCESSING TECHNOLOGIES, 2017, 10561 : 14 - 26
  • [5] Convolutional neural network for improved event-based Shack-Hartmann wavefront reconstruction
    Grose, Mitchell
    Schmidt, Jason D.
    Hirakawa, Keigo
    APPLIED OPTICS, 2024, 63 (16) : E35 - E47
  • [6] Convolutional-neural-network based breast thickness correction in digital breast tomosynthesis
    Lee, Seoyoung
    Kim, Hyeongseok
    Lee, Hoyeon
    Jeong, Uijin
    Cho, Seungryong
    15TH INTERNATIONAL WORKSHOP ON BREAST IMAGING (IWBI2020), 2020, 11513
  • [7] Extended Bit-Plane Compression for Convolutional Neural Network Accelerators
    Cavigelli, Lukas
    Benini, Luca
    2019 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2019), 2019, : 279 - 283
  • [8] A Feature Map Lossless Compression Framework for Convolutional Neural Network Accelerators
    Zhang, Zekun
    Jiao, Xin
    Xu, Chengyu
    2024 IEEE 6TH INTERNATIONAL CONFERENCE ON AI CIRCUITS AND SYSTEMS, AICAS 2024, 2024, : 422 - 426
  • [9] Enhanced Convolutional-Neural-Network Architecture for Crop Classification
    Moreno-Revelo, Monica Y.
    Guachi-Guachi, Lorena
    Gomez-Mendoza, Juan Bernardo
    Revelo-Fuelagan, Javier
    Peluffo-Ordonez, Diego H.
    APPLIED SCIENCES-BASEL, 2021, 11 (09):
  • [10] Intelligent and Convolutional-Neural-Network based Smart Hospital and Patient Scheduling System
    Rajakumari, K.
    Madhunisha, M.
    2020 INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND INFORMATICS (ICCCI - 2020), 2020, : 438 - 442