Pruning algorithm of convolutional neural network based on optimal threshold

被引:0
|
作者
Wang, Jianjun [1 ]
Liu, Leshan [1 ]
Pan, Ximeng [1 ]
机构
[1] Hebei Univ Econ & Business, Shijiazhuang, Hebei, Peoples R China
关键词
Convolutional Neural Network; Network Pruning; Network Acceleration; Greedy Algorithm; Optimal Threshold;
D O I
10.1145/3395260.3395300
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the process of pruning, in order to automatically obtain an optimal pruning threshold that can balance the maximum sparse rate and the minimum error. This paper proposes a convolutional neural network pruning algorithm based on the optimal threshold. The algorithm uses the optimization ability of the greedy algorithm to select an optimal threshold, and uses the sensitivity and correlation of the node as factors to determine whether the node is important. Then by deleting the nodes whose importance is below the optimal threshold, the purpose of pruning the network is achieved. Experiments show that under the premise of loss accuracy within 2%, the algorithm can test the Lenet-5 network pruning on the M-NIST data set, which can accelerate 36.62%. This algorithm tests the VggNet network pruning on the CIFAR-10 dataset, which can speed up 43.86%. Experiments show that the algorithm effectively reduces network parameters and reduces running time.
引用
收藏
页码:50 / 54
页数:5
相关论文
共 50 条
  • [1] Adaptive pruning threshold based convolutional neural network for object detection
    Guo, Zhendong
    Li, Xiaohong
    Zhang, Kai
    Guo, Xiaoyong
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 43 (06) : 7821 - 7831
  • [2] Convolutional neural network acceleration algorithm based on filters pruning
    Li, Hao
    Zhao, Wen-Jie
    Han, Bo
    [J]. Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2019, 53 (10): : 1994 - 2002
  • [3] Pruning and quantization algorithm with applications in memristor-based convolutional neural network
    Mei Guo
    Yurui Sun
    Yongliang Zhu
    Mingqiao Han
    Gang Dou
    Shiping Wen
    [J]. Cognitive Neurodynamics, 2024, 18 : 233 - 245
  • [4] Pruning and quantization algorithm with applications in memristor-based convolutional neural network
    Guo, Mei
    Sun, Yurui
    Zhu, Yongliang
    Han, Mingqiao
    Dou, Gang
    Wen, Shiping
    [J]. COGNITIVE NEURODYNAMICS, 2024, 18 (01) : 233 - 245
  • [5] Channel pruning based on convolutional neural network sensitivity
    Yang, Chenbin
    Liu, Huiyi
    [J]. NEUROCOMPUTING, 2022, 507 : 97 - 106
  • [6] Convolutional neural network pruning based on misclassification cost
    Ahmadluei, Saeed
    Faez, Karim
    Masoumi, Behrooz
    [J]. JOURNAL OF SUPERCOMPUTING, 2023, 79 (18): : 21185 - 21234
  • [7] Convolutional neural network pruning based on misclassification cost
    Saeed Ahmadluei
    Karim Faez
    Behrooz Masoumi
    [J]. The Journal of Supercomputing, 2023, 79 : 21185 - 21234
  • [8] A Lightweight Convolutional Network Based on Pruning Algorithm for YOLO
    Liu, Guanyu
    Li, Yuzhao
    Song, Yuanchen
    Liu, Yumeng
    Xu, Xiaofeng
    Zhao, Zhen
    Zhang, Ruiheng
    [J]. FOURTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING, ICGIP 2022, 2022, 12705
  • [9] An FPGA Realization of a Deep Convolutional Neural Network Using a Threshold Neuron Pruning
    Fujii, Tomoya
    Sato, Simpei
    Nakahara, Hiroki
    Motomura, Masato
    [J]. APPLIED RECONFIGURABLE COMPUTING, 2017, 10216 : 268 - 280
  • [10] Variational Convolutional Neural Network Pruning
    Zhao, Chenglong
    Ni, Bingbing
    Zhang, Jian
    Zhao, Qiwei
    Zhang, Wenjun
    Tian, Qi
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2775 - 2784