Channel pruning method driven by similarity of feature extraction capability

被引:0
|
作者
Sun, Chuanmeng [1 ,2 ]
Chen, Jiaxin [1 ,2 ]
Li, Yong [3 ]
Wang, Yu [1 ,2 ]
Ma, Tiehua [1 ,2 ]
机构
[1] State Key Laboratory of Dynamic Measurement Technology, North University of China, Shanxi, Taiyuan,030051, China
[2] School of Electrical and Control Engineering, North University of China, Shanxi, Taiyuan,030051, China
[3] State Key Laboratory of Coal Mine Disaster Dynamics and Control, Chongqing University, Chongqing,400044, China
关键词
Channel coding - Mapping;
D O I
10.1007/s00500-025-10470-w
中图分类号
学科分类号
摘要
Channel pruning is a method to compress convolutional neural networks, which can significantly reduce the number of model parameters and the computational amount. Current methods that focus on the internal parameters of a model and feature mapping information rely on artificially set a priori criteria or reflect filter attributes by partial feature mapping, which lack the ability to analyze and discriminate the channel feature extraction and ignore the basic reasons for the similarity of the channels. This study developed a pruning method based on similar structural features of channels, called SSF. This method focuses on analysing the ability to extract similar features between channels and exploring the characteristics of channels producing similar feature mapping. First, adaptive threshold coding was introduced to numerically transform the channel characteristics into structural features, and channels with similar coding results could generate highly similar feature mapping. Secondly, the spatial distance was calculated for the structural features matrix to obtain the similarity between channels. Moreover, in order to keep rich channel classes in the pruned network, different class cuts were made on the basis of similarity to randomly remove some of the channels. Thirdly, considering the differences in the overall similarity of different layers, this study determined the appropriate pruning ratio for different layers on the basis of the channel dispersion degree reflected by the similarity. Finally, extensive experiments were conducted on image classification tasks, and the experimental results demonstrated the superiority of the SSF method over many existing techniques. On ILSVRC-2012, the SSF method reduced the floating-point operations (FLOPs) of the ResNet-50 model by 57.70% while reducing the Top-1 accuracy only by 1.01%. © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2025.
引用
收藏
页码:1207 / 1226
页数:19
相关论文
共 50 条
  • [21] Fusion of gradient and feature similarity for Keyframe extraction
    Reddy Mounika Bommisetty
    Ashish Khare
    Tanveer J. Siddiqui
    P. Palanisamy
    Multimedia Tools and Applications, 2021, 80 : 15429 - 15467
  • [22] A dynamic CNN pruning method based on matrix similarity
    Mingwen Shao
    Junhui Dai
    Jiandong Kuang
    Deyu Meng
    Signal, Image and Video Processing, 2021, 15 : 381 - 389
  • [23] A dynamic CNN pruning method based on matrix similarity
    Shao, Mingwen
    Dai, Junhui
    Kuang, Jiandong
    Meng, Deyu
    SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (02) : 381 - 389
  • [24] A SIMILARITY MEASURING METHOD FOR IMAGES BASED ON THE FEATURE EXTRACTION ALGORITHM USING REFERENCE VECTORS
    Ohno, Asako
    Murao, Hajime
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2009, 5 (03): : 763 - 771
  • [25] A Gene Feature Extraction Method Based on Across-view Similarity Order Preserving
    Su, Shuzhi
    Zhang, Kaiyu
    Wang, Ziying
    Zhang, Maoyan
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (01) : 317 - 324
  • [26] Information Extraction and Noisy Feature Pruning for Mandarin Speech Recognition
    Gao, Guozhi
    Duan, Zhikui
    Yang, Guangguang
    Li, Shiren
    Yu, Xinmei
    Zhao, Xiaomeng
    Ruan, Jinbiao
    JOURNAL OF THE AUDIO ENGINEERING SOCIETY, 2024, 72 (1-2): : 59 - 70
  • [27] Design of Deep Learning Acoustic Sonar Receiver with Temporal/ Spatial Underwater Channel Feature Extraction Capability
    Yen, Chih-Ta
    Chen, Un-Hung
    INTERNATIONAL JOURNAL OF ENGINEERING AND TECHNOLOGY INNOVATION, 2024, 14 (02) : 115 - 136
  • [28] FPC: Feature Map Pruning using Channel Attention Mechanism
    Liu, Yang
    Hu, Jianqiang
    Zhou, Xiaobao
    Wu, Jiaxin
    INTERNATIONAL CONFERENCE ON INTELLIGENT TRAFFIC SYSTEMS AND SMART CITY (ITSSC 2021), 2022, 12165
  • [29] Learning Compact Networks via Similarity-aware Channel Pruning
    Zhang, Quan
    Shi, Yemin
    Zhang, Lechun
    Wang, Yaowei
    Tian, Yonghong
    THIRD INTERNATIONAL CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2020), 2020, : 149 - 152
  • [30] AFMPM: adaptive feature map pruning method based on feature distillation
    Guo, Yufeng
    Zhang, Weiwei
    Wang, Junhuang
    Ji, Ming
    Zhen, Chenghui
    Guo, Zhengzheng
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (02) : 573 - 588