A Feature Map Lossless Compression Framework for Convolutional Neural Network Accelerators

被引:0
|
作者
Zhang, Zekun [1 ,2 ]
Jiao, Xin [2 ]
Xu, Chengyu [2 ]
机构
[1] Fudan Univ, State Key Lab ASIC & Syst, Shanghai, Peoples R China
[2] SenseTime Res, Shanghai, Peoples R China
关键词
Feature map compression; deep learning; convolutional neural networks; hardware acceleration;
D O I
10.1109/AICAS59952.2024.10595980
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a predictor-based lossless compression algorithm for the feature maps present within convolutional neural networks (CNNs), which provides the possibility to solve the system bandwidth bottleneck and excessive power consumption problem of hardware acceleration. It is also an algorithm-hardware co-design methodology, yielding a hardware-friendly compression approach with low power consumption. The performance of the algorithm is evaluated in the detection, recognition, and segment CNN tasks respectively. Results show that an average compression ratio of 3.03x and a gain of nearly 50% over existing methods can be achieved for VGG-16; 2.78x and a gain of around 51% for ResNet-18; 2.45 and a gain of nearly 38% for SegNet.
引用
下载
收藏
页码:422 / 426
页数:5
相关论文
共 50 条
  • [41] Model Compression for Data Compression: Neural Network Based Lossless Compressor Made Practical
    Qin, Liang
    Sun, Jie
    2023 DATA COMPRESSION CONFERENCE, DCC, 2023, : 52 - 61
  • [42] Parallel Convolutional Neural Network (CNN) Accelerators Based on Stochastic Computing
    Zhang, Yawen
    Zhang, Xinyue
    Song, Jiahao
    Wang, Yuan
    Huang, Ru
    Wang, Runsheng
    PROCEEDINGS OF THE 2019 IEEE INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS 2019), 2019, : 19 - 24
  • [43] Hardware Accelerators for a Convolutional Neural Network in Condition Monitoring of CNC Machines
    Hoyer, Ingo
    Berg, Oscar
    Krupp, Lukas
    Utz, Alexander
    Wiede, Christian
    Seidl, Karsten
    2023 IEEE SENSORS, 2023,
  • [44] Spatial Data Dependence Graph Simulator for Convolutional Neural Network Accelerators
    Wang, Jooho
    Kim, Jiwon
    Moon, Sungmin
    Kim, Sunwoo
    Park, Sungkyung
    Park, Chester Sungchung
    2019 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2019), 2019, : 309 - 310
  • [45] CNNWire: Boosting Convolutional Neural Network with Winograd on ReRAM based Accelerators
    Lin, Jilan
    Li, Shuangchen
    Hu, Xing
    Deng, Lei
    Xie, Yuan
    GLSVLSI '19 - PROCEEDINGS OF THE 2019 ON GREAT LAKES SYMPOSIUM ON VLSI, 2019, : 283 - 286
  • [46] Lossless Image Compression Using Reversible Integer Wavelet Transforms and Convolutional Neural Networks
    Ahanonu, E.
    Marcellin, M. W.
    Bilgin, A.
    2018 DATA COMPRESSION CONFERENCE (DCC 2018), 2018, : 395 - 395
  • [47] A Convolutional Neural Network Image Compression Algorithm for UAVs
    Dai, Yongdong
    Tan, Jing
    Wang, Maofei
    Jiang, Chengling
    Li, Mingjiang
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2024, 33 (12)
  • [48] Learning Filter Basis for Convolutional Neural Network Compression
    Li, Yawei
    Gu, Shuhang
    Van Gool, Luc
    Timofte, Radu
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 5622 - 5631
  • [49] A prediction-based neural network scheme for lossless data compression
    Logeswaran, R
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2002, 32 (04): : 358 - 365
  • [50] Lossless data compression with neural network based on maximum entropy theory
    Fu, Yan
    Zhou, Jun-Lin
    Wu, Yue
    Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2007, 36 (06): : 1245 - 1248