Pruning algorithm of convolutional neural network based on optimal threshold

被引:0
|
作者
Wang, Jianjun [1 ]
Liu, Leshan [1 ]
Pan, Ximeng [1 ]
机构
[1] Hebei Univ Econ & Business, Shijiazhuang, Hebei, Peoples R China
关键词
Convolutional Neural Network; Network Pruning; Network Acceleration; Greedy Algorithm; Optimal Threshold;
D O I
10.1145/3395260.3395300
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the process of pruning, in order to automatically obtain an optimal pruning threshold that can balance the maximum sparse rate and the minimum error. This paper proposes a convolutional neural network pruning algorithm based on the optimal threshold. The algorithm uses the optimization ability of the greedy algorithm to select an optimal threshold, and uses the sensitivity and correlation of the node as factors to determine whether the node is important. Then by deleting the nodes whose importance is below the optimal threshold, the purpose of pruning the network is achieved. Experiments show that under the premise of loss accuracy within 2%, the algorithm can test the Lenet-5 network pruning on the M-NIST data set, which can accelerate 36.62%. This algorithm tests the VggNet network pruning on the CIFAR-10 dataset, which can speed up 43.86%. Experiments show that the algorithm effectively reduces network parameters and reduces running time.
引用
收藏
页码:50 / 54
页数:5
相关论文
共 50 条
  • [41] An Improved Pruning Algorithm for Fuzzy Neural Network
    Ai Fangju
    [J]. INFORMATION TECHNOLOGY APPLICATIONS IN INDUSTRY II, PTS 1-4, 2013, 411-414 : 2031 - 2036
  • [42] A-optimal convolutional neural network
    Zihong Yin
    Dehui Kong
    Guoxia Shao
    Xinran Ning
    Warren Jin
    Jing-Yan Wang
    [J]. Neural Computing and Applications, 2018, 30 : 2295 - 2304
  • [43] Optimal design of convolutional neural network for EEG -based authentication
    Lee H.
    Kim G.
    Kim J.
    Kang Y.
    Park C.
    [J]. IEIE Transactions on Smart Processing and Computing, 2021, 10 (03): : 199 - 203
  • [44] A-optimal convolutional neural network
    Yin, Zihong
    Kong, Dehui
    Shao, Guoxia
    Ning, Xinran
    Jin, Warren
    Wang, Jing-Yan
    [J]. NEURAL COMPUTING & APPLICATIONS, 2018, 30 (07): : 2295 - 2304
  • [45] Improve Convolutional Neural Network Pruning by Maximizing Filter Variety
    Hubens, Nathan
    Mancas, Matei
    Gosselin, Bernard
    Preda, Marius
    Zaharia, Titus
    [J]. IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT I, 2022, 13231 : 379 - 390
  • [46] THREE-DIMENSIONAL CONVOLUTIONAL NEURAL NETWORK PRUNING WITH REGULARIZATION-BASED METHOD
    Zhang, Yuxin
    Wang, Huan
    Luo, Yang
    Yu, Lu
    Hu, Haoji
    Shan, Hangguan
    Quek, Tony Q. S.
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 4270 - 4274
  • [47] Convolutional neural network simplification via feature map pruning
    Zou, Junhua
    Rui, Ting
    Zhou, You
    Yang, Chengsong
    Zhang, Sai
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2018, 70 : 950 - 958
  • [48] A node pruning algorithm based on optimal brain surgeon for feedforward neural networks
    Xu, Jinhua
    Ho, Daniel W. C.
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 1, 2006, 3971 : 524 - 529
  • [49] A TWO-STEP FALL DETECTION ALGORITHM COMBINING THRESHOLD-BASED METHOD AND CONVOLUTIONAL NEURAL NETWORK
    Xu, Tao
    Se, Haifeng
    Liu, Jiahui
    [J]. METROLOGY AND MEASUREMENT SYSTEMS, 2021, 28 (01) : 23 - 40
  • [50] Optimal Diagnosis of COVID-19 Based on Convolutional Neural Network and Red Fox Optimization Algorithm
    Khorami, Ehsan
    Babaei, Fatemeh Mahdi
    Azadeh, Aidin
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2021, 2021