Channel pruning method driven by similarity of feature extraction capability

被引:0
|
作者
Sun, Chuanmeng [1 ,2 ]
Chen, Jiaxin [1 ,2 ]
Li, Yong [3 ]
Wang, Yu [1 ,2 ]
Ma, Tiehua [1 ,2 ]
机构
[1] State Key Laboratory of Dynamic Measurement Technology, North University of China, Shanxi, Taiyuan,030051, China
[2] School of Electrical and Control Engineering, North University of China, Shanxi, Taiyuan,030051, China
[3] State Key Laboratory of Coal Mine Disaster Dynamics and Control, Chongqing University, Chongqing,400044, China
关键词
Channel coding - Mapping;
D O I
10.1007/s00500-025-10470-w
中图分类号
学科分类号
摘要
Channel pruning is a method to compress convolutional neural networks, which can significantly reduce the number of model parameters and the computational amount. Current methods that focus on the internal parameters of a model and feature mapping information rely on artificially set a priori criteria or reflect filter attributes by partial feature mapping, which lack the ability to analyze and discriminate the channel feature extraction and ignore the basic reasons for the similarity of the channels. This study developed a pruning method based on similar structural features of channels, called SSF. This method focuses on analysing the ability to extract similar features between channels and exploring the characteristics of channels producing similar feature mapping. First, adaptive threshold coding was introduced to numerically transform the channel characteristics into structural features, and channels with similar coding results could generate highly similar feature mapping. Secondly, the spatial distance was calculated for the structural features matrix to obtain the similarity between channels. Moreover, in order to keep rich channel classes in the pruned network, different class cuts were made on the basis of similarity to randomly remove some of the channels. Thirdly, considering the differences in the overall similarity of different layers, this study determined the appropriate pruning ratio for different layers on the basis of the channel dispersion degree reflected by the similarity. Finally, extensive experiments were conducted on image classification tasks, and the experimental results demonstrated the superiority of the SSF method over many existing techniques. On ILSVRC-2012, the SSF method reduced the floating-point operations (FLOPs) of the ResNet-50 model by 57.70% while reducing the Top-1 accuracy only by 1.01%. © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2025.
引用
收藏
页码:1207 / 1226
页数:19
相关论文
共 50 条
  • [1] A Pruning Method Based on Feature Abstraction Capability of Filters
    Tang, Yi
    Zhang, Xiang
    Zhu, Ce
    IMAGE AND GRAPHICS, ICIG 2019, PT II, 2019, 11902 : 642 - 654
  • [2] A Pruning Method Based on Feature Map Similarity Score
    Cui, Jihua
    Wang, Zhenbang
    Yang, Ziheng
    Guan, Xin
    BIG DATA AND COGNITIVE COMPUTING, 2023, 7 (04)
  • [3] A pruning method based on the measurement of feature extraction ability
    Wu, Honggang
    Tang, Yi
    Zhang, Xiang
    MACHINE VISION AND APPLICATIONS, 2021, 32 (01)
  • [4] A pruning method based on the measurement of feature extraction ability
    Honggang Wu
    Yi Tang
    Xiang Zhang
    Machine Vision and Applications, 2021, 32
  • [5] Model switching by channel fusion for network pruning and efficient feature extraction
    Kameyama, K
    Kosugi, Y
    IEEE WORLD CONGRESS ON COMPUTATIONAL INTELLIGENCE, 1998, : 1861 - 1866
  • [6] Exploiting Channel Similarity for Network Pruning
    Zhao, Chenglong
    Zhang, Yunxiang
    Ni, Bingbing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (09) : 5049 - 5061
  • [7] Filter pruning by quantifying feature similarity and entropy of feature maps
    Liu, Yajun
    Fan, Kefeng
    Wu, Dakui
    Zhou, Wenju
    NEUROCOMPUTING, 2023, 544
  • [8] lAKECP: Adaptive Knowledge Extraction from Feature Maps for Fast and Efficient Channel Pruning
    Zhang, Haonan
    Liu, Longjun
    Zhou, Hengyi
    Hou, Wenxuan
    Sun, Hongbin
    Zheng, Nanning
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 648 - 657
  • [9] Similarity Feature Extraction of EEG
    Mu, Zhendong
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON MANAGEMENT, EDUCATION, INFORMATION AND CONTROL, 2015, 125 : 1250 - 1253
  • [10] Linear Combination Approximation of Feature for Channel Pruning
    Joo, Donggyu
    Kim, Doyeon
    Yi, Eojindl
    Kim, Junmo
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 2771 - 2780