SkinSwinViT: A Lightweight Transformer-Based Method for Multiclass Skin Lesion Classification with Enhanced Generalization Capabilities

被引:0
|
作者
Tang, Kun [1 ]
Su, Jing [1 ]
Chen, Ruihan [1 ,2 ]
Huang, Rui [1 ]
Dai, Ming [1 ]
Li, Yongjiang [1 ]
机构
[1] Guangdong Ocean Univ, Sch Math & Comp, Zhanjiang 524008, Peoples R China
[2] Int Macau Inst Acad Res, Artificial Intelligence Res Inst, Taipa 999078, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 10期
关键词
skin lesions; ISIC2018; transformer; data enhancement; multiclassification; MACHINE; NETWORK;
D O I
10.3390/app14104005
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
In recent decades, skin cancer has emerged as a significant global health concern, demanding timely detection and effective therapeutic interventions. Automated image classification via computational algorithms holds substantial promise in significantly improving the efficacy of clinical diagnoses. This study is committed to mitigating the challenge of diagnostic accuracy in the classification of multiclass skin lesions. This endeavor is inherently formidable owing to the resemblances among various lesions and the constraints associated with extracting precise global and local image features within diverse dimensional spaces using conventional convolutional neural network methodologies. Consequently, this study introduces the SkinSwinViT methodology for skin lesion classification, a pioneering model grounded in the Swin Transformer framework featuring a global attention mechanism. Leveraging the inherent cross-window attention mechanism within the Swin Transformer architecture, the model adeptly captures local features and interdependencies within skin lesion images while additionally incorporating a global self-attention mechanism to discern overarching features and contextual information effectively. The evaluation of the model's performance involved the ISIC2018 challenge dataset. Furthermore, data augmentation techniques augmented training dataset size and enhanced model performance. Experimental results highlight the superiority of the SkinSwinViT method, achieving notable metrics of accuracy, recall, precision, specificity, and F1 score at 97.88%, 97.55%, 97.83%, 99.36%, and 97.79%, respectively.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Transformer-Based Multi-Modal Data Fusion Method for COPD Classification and Physiological and Biochemical Indicators Identification
    Xie, Weidong
    Fang, Yushan
    Yang, Guicheng
    Yu, Kun
    Li, Wei
    BIOMOLECULES, 2023, 13 (09)
  • [42] A new method of hybrid time window embedding with transformer-based traffic data classification in IoT-networked environment
    Rafał Kozik
    Marek Pawlicki
    Michał Choraś
    Pattern Analysis and Applications, 2021, 24 : 1441 - 1449
  • [43] A new method of hybrid time window embedding with transformer-based traffic data classification in IoT-networked environment
    Kozik, Rafal
    Pawlicki, Marek
    Choras, Michal
    PATTERN ANALYSIS AND APPLICATIONS, 2021, 24 (04) : 1441 - 1449
  • [44] Research on Multi-Scale CNN and Transformer-Based Multi-Level Multi-Classification Method for Images
    Gou, Quandeng
    Ren, Yuheng
    IEEE ACCESS, 2024, 12 : 103049 - 103059
  • [45] SSD-KD: A self-supervised diverse knowledge distillation method for lightweight skin lesion classification using dermoscopic images
    Wang, Yongwei
    Wang, Yuheng
    Cai, Jiayue
    Lee, Tim K.
    Miao, Chunyan
    Wang, Z. Jane
    MEDICAL IMAGE ANALYSIS, 2023, 84
  • [46] Ptr4BERT: Automatic Semisupervised Chinese Government Message Text Classification Method Based on Transformer-Based Pointer Generator Network
    Li, Mingxin
    Yin, Kaiqian
    Wang, Minghao
    ADVANCES IN MULTIMEDIA, 2022, 2022
  • [47] An enhanced skin lesion detection and classification model using hybrid convolution-based ensemble learning model
    Nagadevi D.
    Suman K.
    Lakshmi P.S.
    Research on Biomedical Engineering, 2024, 40 (02) : 347 - 372
  • [48] LSNet: a deep learning based method for skin lesion classification using limited samples and transfer learning
    Deng, Xiaodan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (22) : 61469 - 61489
  • [49] CCJ-SLC: A Skin Lesion Image Classification Method Based on Contrastive Clustering and Jigsaw Puzzle
    Zhang, Yuwei
    Xu, Guoyan
    Wu, Chunyan
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XIII, 2024, 14437 : 27 - 39
  • [50] A GAN-Based Data Augmentation Method for Imbalanced Multi-Class Skin Lesion Classification
    Su, Qichen
    Hamed, Haza Nuzly Abdull
    Isa, Mohd Adham
    Hao, Xue
    Dai, Xin
    IEEE ACCESS, 2024, 12 : 16498 - 16513