Convolutional neural network pruning based on misclassification cost

被引:1
|
作者
Ahmadluei, Saeed [1 ]
Faez, Karim [2 ]
Masoumi, Behrooz [1 ]
机构
[1] Islamic Azad Univ, Dept Comp & Informat Technol Engn, Qazvin Branch, Qazvin, Iran
[2] Amirkabir Univ Technol, Elect Engn Dept, Hafez Ave, Tehran 1591634311, Iran
来源
JOURNAL OF SUPERCOMPUTING | 2023年 / 79卷 / 18期
关键词
Convolutional neural networks; Pruning; Misclassification cost; DEEP; CLASSIFICATION;
D O I
10.1007/s11227-023-05487-7
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In a convolutional neural network (CNN), overparameterization increases the risk of overfitting, decelerates the inference, and impedes edge computing. To resolve these challenges, one possible solution is to prune CNN parameters. The essence of pruning is to identify and eliminate unimportant filters, which should yield the highest speed increase and the lowest accuracy loss. In contrast with other pruning methods and in conformity with the real-world, this paper does not evaluate the accuracy of a CNN as its overall performance but analyzes different misclassification costs. This modification accelerates the pruning process and improves the prune ratio. The proposed algorithm determines the expected specificity/sensitivity for each class and finds the smallest CNN that is consistent with them. The layer-wise relevance propagation is employed to measure the contribution of each filter to every class discrimination. The importance of each filter is determined by integrating its local (usefulness in its layer) and global (contribution to the network output) usefulness. Since the proposed algorithm frequently fluctuates between pruning and recovery, further fine-tuning is unnecessary. According to simulation results, the proposed algorithm was efficient in both pruning a CNN and attaining the desired sensitivity/specificity of classes.
引用
收藏
页码:21185 / 21234
页数:50
相关论文
共 50 条
  • [21] A Mixed-Pruning Based Framework for Embedded Convolutional Neural Network Acceleration
    Chang, Xuepeng
    Pan, Huihui
    Lin, Weiyang
    Gao, Huijun
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2021, 68 (04) : 1706 - 1715
  • [22] Pruning and quantization algorithm with applications in memristor-based convolutional neural network
    Guo, Mei
    Sun, Yurui
    Zhu, Yongliang
    Han, Mingqiao
    Dou, Gang
    Wen, Shiping
    [J]. COGNITIVE NEURODYNAMICS, 2024, 18 (01) : 233 - 245
  • [23] Method of Convolutional Neural Network Model Pruning Based on Gray Correlation Analysis
    Huang Shiqing
    Bai Ruilin
    Qin Gaoe
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (04)
  • [24] Improve Convolutional Neural Network Pruning by Maximizing Filter Variety
    Hubens, Nathan
    Mancas, Matei
    Gosselin, Bernard
    Preda, Marius
    Zaharia, Titus
    [J]. IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT I, 2022, 13231 : 379 - 390
  • [25] THREE-DIMENSIONAL CONVOLUTIONAL NEURAL NETWORK PRUNING WITH REGULARIZATION-BASED METHOD
    Zhang, Yuxin
    Wang, Huan
    Luo, Yang
    Yu, Lu
    Hu, Haoji
    Shan, Hangguan
    Quek, Tony Q. S.
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 4270 - 4274
  • [26] Convolutional neural network simplification via feature map pruning
    Zou, Junhua
    Rui, Ting
    Zhou, You
    Yang, Chengsong
    Zhang, Sai
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2018, 70 : 950 - 958
  • [27] ScoringNet: A Neural Network Based Pruning Criteria for Structured Pruning
    Wang S.
    Zhang Z.
    [J]. Scientific Programming, 2023, 2023
  • [28] An Efficient FPGA-based Depthwise Separable Convolutional Neural Network Accelerator with Hardware Pruning
    Liu, Zhengyan
    Liu, Qiang
    Yan, Shun
    Cheung, Ray C. C.
    [J]. ACM TRANSACTIONS ON RECONFIGURABLE TECHNOLOGY AND SYSTEMS, 2024, 17 (01)
  • [29] A Pruning method based on conditional misclassification
    Xu Weixiang
    Xu Jing
    Liu Xumin
    Dong Rui
    [J]. FRONTIERS OF MANUFACTURING AND DESIGN SCIENCE, PTS 1-4, 2011, 44-47 : 3448 - +
  • [30] D-Pruner: Filter-Based Pruning Method for Deep Convolutional Neural Network
    Huynh, Loc N.
    Lee, Youngki
    Balan, Rajesh Krishna
    [J]. PROCEEDINGS OF THE 2018 INTERNATIONAL WORKSHOP ON EMBEDDED AND MOBILE DEEP LEARNING (EMDL '18), 2018, : 7 - 12