EACP: An effective automatic channel pruning for neural networks

被引:28
|
作者
Liu, Yajun [1 ]
Wu, Dakui [1 ]
Zhou, Wenju [1 ]
Fan, Kefeng [2 ]
Zhou, Zhiheng [3 ]
机构
[1] Shanghai Univ, Sch Mechatron Engn & Automat, Shanghai 200444, Peoples R China
[2] China Elect Standardizat Inst, Beijing 100007, Peoples R China
[3] South China Univ Technol, Guangzhou 510640, Peoples R China
关键词
Automatic channel pruning; K -means plus plus; Similar features; Social group optimization (SGO); CNN models;
D O I
10.1016/j.neucom.2023.01.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The large data scale and computational resources required by Convolutional Neural Networks (CNNs) hinder the practical application on mobile devices. However, channel pruning has become one of the most efficient methods for addressing this problem, with many existing researches proving its practica-bility in the field of model compression. The current channel pruning methods mainly start with the per-spective of assessing the importance of channels or manual setting of the evaluation criteria, which requires unnecessary human intervention and shows the lack of certain automaticity. In this paper, an effective automatic channel pruning (EACP) method for neural networks is proposed. Specifically, we adopt the k-means++ method to cluster filters with similar features hierarchically in each convolutional layer, forming an initial compact compression structure. Subsequently, we use an improved social group optimization (SGO) algorithm to iteratively search and optimize the compression process of the post -clustered structure to find the optimal compressed structure. The effectiveness of the proposed approach is tested with respect to three leading CNN models on two image classification datasets. In CIFAR-10, our method reduces the FLOPs of GoogLeNet by 58.10 % and improves the accuracy by 0.20 % compared to the baseline.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页码:131 / 142
页数:12
相关论文
共 50 条
  • [1] Compression of Deep Convolutional Neural Networks Using Effective Channel Pruning
    Guo, Qingbei
    Wu, Xiao-Jun
    Zhao, Xiuyang
    IMAGE AND GRAPHICS, ICIG 2019, PT I, 2019, 11901 : 760 - 772
  • [2] Automatic Pruning for Quantized Neural Networks
    Guerra, Luis
    Drummond, Tom
    2021 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA 2021), 2021, : 290 - 297
  • [3] ACP: Automatic Channel Pruning Method by Introducing Additional Loss for Deep Neural Networks
    Yu, Haoran
    Zhang, Weiwei
    Ji, Ming
    Zhen, Chenghui
    NEURAL PROCESSING LETTERS, 2023, 55 (02) : 1071 - 1085
  • [4] Variational Automatic Channel Pruning Algorithm Based on Structure Optimization for Convolutional Neural Networks
    Han, Shuo
    Zhan, Yufei
    Liu, Xingang
    JOURNAL OF INTERNET TECHNOLOGY, 2021, 22 (02): : 339 - 351
  • [5] ACP: Automatic Channel Pruning Method by Introducing Additional Loss for Deep Neural Networks
    Haoran Yu
    Weiwei Zhang
    Ming Ji
    Chenghui Zhen
    Neural Processing Letters, 2023, 55 : 1071 - 1085
  • [6] Automatic Pruning Rate Derivation for Structured Pruning of Deep Neural Networks
    Sakai, Yasufumi
    Iwakawa, Akinori
    Tabaru, Tsuguchika
    Inoue, Atsuki
    Kawaguchi, Hiroshi
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2561 - 2567
  • [7] MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning
    Liu, Zechun
    Mu, Haoyuan
    Zhang, Xiangyu
    Guo, Zichao
    Yang, Xin
    Cheng, Tim Kwang-Ting
    Sun, Jian
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3295 - 3304
  • [8] Gator: Customizable Channel Pruning of Neural Networks with Gating
    Passov, Eli
    David, Eli O.
    Netanyahu, Nathan S.
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT IV, 2021, 12894 : 46 - 58
  • [9] ACP: ADAPTIVE CHANNEL PRUNING FOR EFFICIENT NEURAL NETWORKS
    Zhang, Yuan
    Yuan, Yuan
    Wang, Qi
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 4488 - 4492
  • [10] Accelerating Convolutional Neural Networks with Dynamic Channel Pruning
    Zhang, Chiliang
    Hu, Tao
    Guan, Yingda
    Ye, Zuochang
    2019 DATA COMPRESSION CONFERENCE (DCC), 2019, : 563 - 563