Convolutional Neural Network Channel Pruning Based on Regularized Sparse

被引:0
|
作者
Bao, Chun [1 ]
Yu, Chongchong [1 ]
Xie, Tao [1 ]
Hu, Xinyu [1 ]
机构
[1] Beijing Technol & Business Univ, Beijing Key Lab Big Data Technol Food Safety, Beijing, Peoples R China
关键词
channel pruning; convolutional neural network model compression; sparsity function; regularized sparse;
D O I
10.1109/siprocess.2019.8868491
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Aiming at the problem that the parameters of the deep learning model are too large and the application is limited at the embedded end, a channel pruning model compression method based on channel sparsity is proposed. This method defines the sparsity function of each channel in the convolutional neural network. By calculating the sparsity index of each channel, the channel sparsity characteristics of the convolutional neural network are obtained, and the channel sparsity is used to perform channel pruning. Furthermore, the L2 regularization is added to the sparsity degree, and the channel function is constructed by combining with the sparsity function. The channel sparsity index is obtained through the channel function operation. This pruning method is applied to the three classic convolutional neural networks of VGGNet, GoogleNet and ResNet on the CIFAR-10 and CIFAR-100 data sets. While maintaining the accuracy of the model, the model sizes are compressed to 2.1MB, 1.7MB and 0.64MB respectively.
引用
收藏
页码:679 / 684
页数:6
相关论文
共 50 条
  • [1] Channel pruning based on convolutional neural network sensitivity
    Yang, Chenbin
    Liu, Huiyi
    [J]. NEUROCOMPUTING, 2022, 507 : 97 - 106
  • [2] Lossless Reconstruction of Convolutional Neural Network for Channel-Based Network Pruning
    Lee, Donghyeon
    Lee, Eunho
    Hwang, Youngbae
    [J]. SENSORS, 2023, 23 (04)
  • [3] CORNET: COMPOSITE-REGULARIZED NEURAL NETWORK FOR CONVOLUTIONAL SPARSE CODING
    Jawali, Dhruv
    Pokala, Praveen Kumar
    Seelamantula, Chandra Sekhar
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 818 - 822
  • [4] Convolutional neural network pruning based on misclassification cost
    Ahmadluei, Saeed
    Faez, Karim
    Masoumi, Behrooz
    [J]. JOURNAL OF SUPERCOMPUTING, 2023, 79 (18): : 21185 - 21234
  • [5] Convolutional neural network pruning based on misclassification cost
    Saeed Ahmadluei
    Karim Faez
    Behrooz Masoumi
    [J]. The Journal of Supercomputing, 2023, 79 : 21185 - 21234
  • [6] Performance Aware Convolutional Neural Network Channel Pruning for Embedded GPUs
    Radu, Valentin
    Kaszyk, Kuba
    Wen, Yuan
    Turner, Jack
    Cano, Jose
    Crowley, Elliot J.
    Franke, Bjoern
    Storkey, Amos
    O'Boyle, Michael
    [J]. PROCEEDINGS OF THE 2019 IEEE INTERNATIONAL SYMPOSIUM ON WORKLOAD CHARACTERIZATION (IISWC 2019), 2019, : 24 - 34
  • [7] SVD-BASED CHANNEL PRUNING FOR CONVOLUTIONAL NEURAL NETWORK IN ACOUSTIC SCENE CLASSIFICATION MODEL
    Wang, Jun
    Li, Shengchen
    Wang, Wenwu
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2019, : 390 - 395
  • [8] Variational Convolutional Neural Network Pruning
    Zhao, Chenglong
    Ni, Bingbing
    Zhang, Jian
    Zhao, Qiwei
    Zhang, Wenjun
    Tian, Qi
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2775 - 2784
  • [9] Convolutional Neural Network Pruning: A Survey
    Xu, Sheng
    Huang, Anran
    Chen, Lei
    Zhang, Baochang
    [J]. PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 7458 - 7463
  • [10] Manifold Regularized Convolutional Neural Network
    Samad, Manar D.
    Sekmen, Ali
    [J]. 2021 7TH INTERNATIONAL CONFERENCE ON ENGINEERING AND EMERGING TECHNOLOGIES (ICEET 2021), 2021, : 55 - 60