Channel pruning method driven by similarity of feature extraction capability

被引:0
|
作者
Sun, Chuanmeng [1 ,2 ]
Chen, Jiaxin [1 ,2 ]
Li, Yong [3 ]
Wang, Yu [1 ,2 ]
Ma, Tiehua [1 ,2 ]
机构
[1] State Key Laboratory of Dynamic Measurement Technology, North University of China, Shanxi, Taiyuan,030051, China
[2] School of Electrical and Control Engineering, North University of China, Shanxi, Taiyuan,030051, China
[3] State Key Laboratory of Coal Mine Disaster Dynamics and Control, Chongqing University, Chongqing,400044, China
关键词
Channel coding - Mapping;
D O I
10.1007/s00500-025-10470-w
中图分类号
学科分类号
摘要
Channel pruning is a method to compress convolutional neural networks, which can significantly reduce the number of model parameters and the computational amount. Current methods that focus on the internal parameters of a model and feature mapping information rely on artificially set a priori criteria or reflect filter attributes by partial feature mapping, which lack the ability to analyze and discriminate the channel feature extraction and ignore the basic reasons for the similarity of the channels. This study developed a pruning method based on similar structural features of channels, called SSF. This method focuses on analysing the ability to extract similar features between channels and exploring the characteristics of channels producing similar feature mapping. First, adaptive threshold coding was introduced to numerically transform the channel characteristics into structural features, and channels with similar coding results could generate highly similar feature mapping. Secondly, the spatial distance was calculated for the structural features matrix to obtain the similarity between channels. Moreover, in order to keep rich channel classes in the pruned network, different class cuts were made on the basis of similarity to randomly remove some of the channels. Thirdly, considering the differences in the overall similarity of different layers, this study determined the appropriate pruning ratio for different layers on the basis of the channel dispersion degree reflected by the similarity. Finally, extensive experiments were conducted on image classification tasks, and the experimental results demonstrated the superiority of the SSF method over many existing techniques. On ILSVRC-2012, the SSF method reduced the floating-point operations (FLOPs) of the ResNet-50 model by 57.70% while reducing the Top-1 accuracy only by 1.01%. © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2025.
引用
收藏
页码:1207 / 1226
页数:19
相关论文
共 50 条
  • [31] AFMPM: adaptive feature map pruning method based on feature distillation
    Yufeng Guo
    Weiwei Zhang
    Junhuang Wang
    Ming Ji
    Chenghui Zhen
    Zhengzheng Guo
    International Journal of Machine Learning and Cybernetics, 2024, 15 : 573 - 588
  • [32] A Feature Fusion Method for Feature Extraction
    Tang, Dejun
    Zhang, Weishi
    Qu, Xiaolu
    Wang, Dujuan
    FOURTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2012), 2012, 8334
  • [33] A graphical approach for filter pruning by exploring the similarity relation between feature maps
    Li, Jiang
    Shao, Haijian
    Zhai, Shengjie
    Jiang, Yingtao
    Deng, Xing
    PATTERN RECOGNITION LETTERS, 2023, 166 : 69 - 75
  • [34] The Research of Wireless Channel Feature Extraction and Channel Discrimination
    Cao, Wenchang
    Wu, Lan
    INTERNATIONAL JOURNAL OF FUTURE GENERATION COMMUNICATION AND NETWORKING, 2016, 9 (11): : 239 - 251
  • [35] Loss-Driven Channel Pruning of Convolutional Neural Networks
    Long, Xin
    Zeng, Xiangrong
    Chen, Chen
    Xiao, Huaxin
    Zhang, Maojun
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2020, E103D (05) : 1190 - 1194
  • [36] Modeling aircraft similarity with musical auditory feature extraction
    Mobley, Frank S.
    Bowers, Gregory
    Ugolini, Margaret
    Fox, Elizabeth
    Gillespie, Nathan
    APPLIED ACOUSTICS, 2023, 214
  • [37] An unsupervised anomalous sound detection method based on similarity-driven automatic feature selection
    Zhang, Yi
    Feng, Jie
    Zhang, Qiaoling
    Hu, Junyao
    Zhang, Weiwei
    DIGITAL SIGNAL PROCESSING, 2025, 161
  • [38] Distance similarity entropy: A sensitive nonlinear feature extraction method for rolling bearing fault diagnosis
    Wang, Tao
    Khoo, Shin Yee
    Ong, Zhi Chao
    Siow, Pei Yi
    Wang, Teng
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2025, 255
  • [39] A Diversified Feature Extraction Approach for Program Similarity Analysis
    Wang, Ying
    Jin, Dahai
    Gong, Yunzhan
    PROCEEDINGS OF THE 2019 2ND INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND INFORMATION MANAGEMENT (ICSIM 2019) / 2019 2ND INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (ICBDSC 2019), 2019, : 96 - 101
  • [40] Feature Extraction of Gameplays for Similarity Calculation in Gameplay Recommendation
    Mori, Kazuki
    Ito, Suguru
    Harada, Tomohiro
    Thawonmas, Ruck
    Kim, Kyung-Joong
    2017 IEEE 10TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL INTELLIGENCE AND APPLICATIONS (IWCIA), 2017, : 171 - 176