A Feature Map Lossless Compression Framework for Convolutional Neural Network Accelerators

被引:0
|
作者
Zhang, Zekun [1 ,2 ]
Jiao, Xin [2 ]
Xu, Chengyu [2 ]
机构
[1] Fudan Univ, State Key Lab ASIC & Syst, Shanghai, Peoples R China
[2] SenseTime Res, Shanghai, Peoples R China
关键词
Feature map compression; deep learning; convolutional neural networks; hardware acceleration;
D O I
10.1109/AICAS59952.2024.10595980
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a predictor-based lossless compression algorithm for the feature maps present within convolutional neural networks (CNNs), which provides the possibility to solve the system bandwidth bottleneck and excessive power consumption problem of hardware acceleration. It is also an algorithm-hardware co-design methodology, yielding a hardware-friendly compression approach with low power consumption. The performance of the algorithm is evaluated in the detection, recognition, and segment CNN tasks respectively. Results show that an average compression ratio of 3.03x and a gain of nearly 50% over existing methods can be achieved for VGG-16; 2.78x and a gain of around 51% for ResNet-18; 2.45 and a gain of nearly 38% for SegNet.
引用
下载
收藏
页码:422 / 426
页数:5
相关论文
共 50 条
  • [21] Optimizing Memory Efficiency for Deep Convolutional Neural Network Accelerators
    Li, Xiaowei
    Li, Jiajun
    Yan, Guihai
    JOURNAL OF LOW POWER ELECTRONICS, 2018, 14 (04) : 496 - 507
  • [22] Lossless Reconstruction of Convolutional Neural Network for Channel-Based Network Pruning
    Lee, Donghyeon
    Lee, Eunho
    Hwang, Youngbae
    SENSORS, 2023, 23 (04)
  • [23] Essential genes identification model based on sequence feature map and graph convolutional neural network
    Hu, Wenxing
    Li, Mengshan
    Xiao, Haiyang
    Guan, Lixin
    BMC GENOMICS, 2024, 25 (01)
  • [24] Essential genes identification model based on sequence feature map and graph convolutional neural network
    Wenxing Hu
    Mengshan Li
    Haiyang Xiao
    Lixin Guan
    BMC Genomics, 25
  • [25] Fused feature encoding in convolutional neural network
    Lu Huo
    Tianrong Rao
    Leijie Zhang
    Multimedia Tools and Applications, 2019, 78 : 1635 - 1648
  • [26] Fused feature encoding in convolutional neural network
    Huo, Lu
    Rao, Tianrong
    Zhang, Leijie
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (02) : 1635 - 1648
  • [27] Lossless data compression scheme based on neural network and SVM
    Hujin
    Yang, Guowei
    Wang, Shoujue
    Gao, Xuhui
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES A-MATHEMATICAL ANALYSIS, 2006, 13 : 638 - 641
  • [28] Lossless compression of EEG data using neural network predictors
    Sriraam, N
    Kannan, R
    Eswaran, C
    ICONIP'02: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING: COMPUTATIONAL INTELLIGENCE FOR THE E-AGE, 2002, : 2046 - 2048
  • [29] Structured pruning via feature channels similarity and mutual learning for convolutional neural network compression
    Wei Yang
    Yancai Xiao
    Applied Intelligence, 2022, 52 : 14560 - 14570
  • [30] Lossless Neural Network Model Compression Through Exponent Sharing
    Kashikar, Prachi
    Sentieys, Olivier
    Sinha, Sharad
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2023, 31 (11) : 1816 - 1825