Iterative magnitude pruning-based light-version of AlexNet for skin cancer classification

被引:4
|
作者
Medhat, Sara [1 ]
Abdel-Galil, Hala [2 ]
Aboutabl, Amal Elsayed [2 ]
Saleh, Hassan [1 ]
机构
[1] Egyptian Atom Energy Author, Radiat Engn Dept, Natl Ctr Radiat Res & Technol, Cairo, Egypt
[2] Helwan Univ, Comp Sci Dept, Fac Comp & Artificial Intelligence, Cairo, Egypt
来源
NEURAL COMPUTING & APPLICATIONS | 2024年 / 36卷 / 03期
关键词
Convolutional neural network; Iterative magnitude pruning; AlexNet; Deep learning; Skin cancer diagnosis; Transfer learning; NEURAL-NETWORKS; DEEP;
D O I
10.1007/s00521-023-09111-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional Neural Networks (CNN) with different architectures have shown promising results in skin cancer diagnosis. However, CNN has a high computational cost, which makes the need for a light version of CNN a desirable step. This version can be used on small devices, such as mobile phones or tablets. A light version can be created using pruning techniques. In this study, iterative magnitude pruning (IMP) is utilized. This method depends on pruning the network iteratively. The IMP method is applied on AlexNet with transfer learning (TL) and data augmentation. The proposed IMP AlexNet with TL is applied on three different skin cancer datasets which are PAD-UFES-20, MED-NODE, and PH2 dataset. The datasets used are a combination of smartphone, dermoscopic, and non-dermoscopic images. Different CNN versions are applied on the same datasets for comparison with IMP AlexNet. The CNNs used are VGG-16, ShuffleNet, SqueezNet, DarkNet-19, DarkNet-53, and Inception-v3. The proposed IMP AlexNet achieved accuracies of 97.62%, 96.79%, and 96.75%, with accuracy losses of 1.53%, 2.3%, and 2.2%, respectively, compared to the original AlexNet. In addition, the proposed IMP AlexNet requires less running time and memory usage than the traditional AlexNet. The average running time for IMP AlexNet is 0.45 min, 0.28 min, and 0.3 min, for PAD-UFES-20, MED-NODE, and PH2 datasets, respectively. The average RAM usage with IMP AlexNet is 1.8 GB, 1.6 GB, and 1.7 GB, respectively. IMP AlexNet accelerates the average running time by approximately 15 times that of the traditional AlexNet and reduces the average RAM used by 40%.
引用
收藏
页码:1413 / 1428
页数:16
相关论文
共 50 条
  • [1] Neuron Pruning-Based Discriminative Extreme Learning Machine for Pattern Classification
    Guo, Tan
    Zhang, Lei
    Tan, Xiaoheng
    COGNITIVE COMPUTATION, 2017, 9 (04) : 581 - 595
  • [2] Neuron Pruning-Based Discriminative Extreme Learning Machine for Pattern Classification
    Tan Guo
    Lei Zhang
    Xiaoheng Tan
    Cognitive Computation, 2017, 9 : 581 - 595
  • [3] Iterative Pruning-based Model Compression for Pose Estimation on Resource-constrained Devices
    Choi, Sunghyun
    Choi, Wonje
    Lee, Youngseok
    Woo, Honguk
    PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND APPLICATIONS, ICMVA 2022, 2022, : 110 - 115
  • [4] A Synaptic Pruning-Based Spiking Neural Network for Hand-Written Digits Classification
    Faghihi, Faramarz
    Alashwal, Hany
    Moustafa, Ahmed A. A.
    FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2022, 5
  • [5] Martian image classification based on iterative pruning VGGNet
    Liu, Meng
    Liu, Jin
    Yin, Li -jun
    Kang, Zhi-wei
    Ma, Xin
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2023, 38 (04) : 507 - 514
  • [6] Optimization of a Deep Learning Model for Skin Cancer Detection with Magnitude-Based Weight Pruning
    Manuel Cabrejos-Yalan, Victor
    Aurelio Rosales-Huamani, Jimmy
    Luis Arenas-Niquin, Jose
    INFORMATION SYSTEMS AND TECHNOLOGIES, WORLDCIST 2022, VOL 1, 2022, 468 : 624 - 629
  • [7] Detection Method of Multi-objective Cows Feeding Behavior Based on Iterative Magnitude Pruning
    Liu Y.
    Bian H.
    He Y.
    Guo W.
    Zhang X.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2022, 53 (02): : 274 - 281
  • [8] Classification of skin cancer using deep batch-normalized elu alexnet with fractional sparrow ladybug optimization
    Gayatri, Erapaneni
    Aarthy, S.L.
    Multimedia Tools and Applications, 2024, 83 (14) : 42319 - 42347
  • [9] Classification of skin cancer using deep batch-normalized elu alexnet with fractional sparrow ladybug optimization
    Gayatri, Erapaneni
    Aarthy, S. L.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (14) : 42319 - 42347
  • [10] Classification of skin cancer using deep batch-normalized elu alexnet with fractional sparrow ladybug optimization
    Erapaneni Gayatri
    S. L. Aarthy
    Multimedia Tools and Applications, 2024, 83 : 42319 - 42347