A Feature Map Lossless Compression Framework for Convolutional Neural Network Accelerators

被引:0
|
作者
Zhang, Zekun [1 ,2 ]
Jiao, Xin [2 ]
Xu, Chengyu [2 ]
机构
[1] Fudan Univ, State Key Lab ASIC & Syst, Shanghai, Peoples R China
[2] SenseTime Res, Shanghai, Peoples R China
关键词
Feature map compression; deep learning; convolutional neural networks; hardware acceleration;
D O I
10.1109/AICAS59952.2024.10595980
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a predictor-based lossless compression algorithm for the feature maps present within convolutional neural networks (CNNs), which provides the possibility to solve the system bandwidth bottleneck and excessive power consumption problem of hardware acceleration. It is also an algorithm-hardware co-design methodology, yielding a hardware-friendly compression approach with low power consumption. The performance of the algorithm is evaluated in the detection, recognition, and segment CNN tasks respectively. Results show that an average compression ratio of 3.03x and a gain of nearly 50% over existing methods can be achieved for VGG-16; 2.78x and a gain of around 51% for ResNet-18; 2.45 and a gain of nearly 38% for SegNet.
引用
下载
收藏
页码:422 / 426
页数:5
相关论文
共 50 条
  • [31] Structured pruning via feature channels similarity and mutual learning for convolutional neural network compression
    Yang, Wei
    Xiao, Yancai
    APPLIED INTELLIGENCE, 2022, 52 (12) : 14560 - 14570
  • [32] Perceptron based neural network predictors in lossless data compression
    Logeswaran, R
    2000 5TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS, VOLS I-III, 2000, : 1709 - 1713
  • [33] Scientific data lossless compression using fast neural network
    Zhou, Jun-Lin
    Fu, Yan
    ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 1, 2006, 3971 : 1293 - 1298
  • [34] Accelerating Convolutional Neural Networks via Activation Map Compression
    Georgiadis, Georgios
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7078 - 7088
  • [35] Deep Neural Network Interlayer Feature Map Compression Based on Least-Squares Fitting
    Xie, Chenjia
    Shao, Zhuang
    Xu, Hang
    Chen, Xiaoliang
    Du, Li
    Du, Yuan
    Wang, Zhongfeng
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 3398 - 3402
  • [36] A Novel Framework With Weighted Decision Map Based on Convolutional Neural Network for Cardiac MR Segmentation
    Li, Fei Yan
    Li, Weisheng
    Gao, Xinbo
    Xiao, Bin
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (05) : 2228 - 2239
  • [37] An Image Compression Framework Based on Multi-scale Convolutional Neural Network for Deformation Images
    Liu, Zhenbing
    Li, Xinlong
    Li, Weiwei
    Lan, Rushi
    Luo, Xiaonan
    2019 TENTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2019, : 174 - 179
  • [38] A Convolutional Neural Network and Graph Convolutional Network Based Framework for AD Classification
    Lin, Lan
    Xiong, Min
    Zhang, Ge
    Kang, Wenjie
    Sun, Shen
    Wu, Shuicai
    SENSORS, 2023, 23 (04)
  • [39] Spotlight SAR Image Recognition Based on Dual-Channel Feature Map Convolutional Neural Network
    Liu, Junjie
    Fu, Xiongjun
    Liu, Kaiqiang
    Wang, Miao
    Zhang, Chengyan
    Su, Qinning
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP 2019), 2019, : 65 - 69
  • [40] Convolutional neural network pruning based on multi-objective feature map selection for image classification
    Jiang, Pengcheng
    Xue, Yu
    Neri, Ferrante
    APPLIED SOFT COMPUTING, 2023, 139