SkinSwinViT: A Lightweight Transformer-Based Method for Multiclass Skin Lesion Classification with Enhanced Generalization Capabilities

被引:0
|
作者
Tang, Kun [1 ]
Su, Jing [1 ]
Chen, Ruihan [1 ,2 ]
Huang, Rui [1 ]
Dai, Ming [1 ]
Li, Yongjiang [1 ]
机构
[1] Guangdong Ocean Univ, Sch Math & Comp, Zhanjiang 524008, Peoples R China
[2] Int Macau Inst Acad Res, Artificial Intelligence Res Inst, Taipa 999078, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 10期
关键词
skin lesions; ISIC2018; transformer; data enhancement; multiclassification; MACHINE; NETWORK;
D O I
10.3390/app14104005
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
In recent decades, skin cancer has emerged as a significant global health concern, demanding timely detection and effective therapeutic interventions. Automated image classification via computational algorithms holds substantial promise in significantly improving the efficacy of clinical diagnoses. This study is committed to mitigating the challenge of diagnostic accuracy in the classification of multiclass skin lesions. This endeavor is inherently formidable owing to the resemblances among various lesions and the constraints associated with extracting precise global and local image features within diverse dimensional spaces using conventional convolutional neural network methodologies. Consequently, this study introduces the SkinSwinViT methodology for skin lesion classification, a pioneering model grounded in the Swin Transformer framework featuring a global attention mechanism. Leveraging the inherent cross-window attention mechanism within the Swin Transformer architecture, the model adeptly captures local features and interdependencies within skin lesion images while additionally incorporating a global self-attention mechanism to discern overarching features and contextual information effectively. The evaluation of the model's performance involved the ISIC2018 challenge dataset. Furthermore, data augmentation techniques augmented training dataset size and enhanced model performance. Experimental results highlight the superiority of the SkinSwinViT method, achieving notable metrics of accuracy, recall, precision, specificity, and F1 score at 97.88%, 97.55%, 97.83%, 99.36%, and 97.79%, respectively.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] Vision transformer and CNN-based skin lesion analysis: classification of monkeypox
    Yolcu Oztel G.
    Multimedia Tools and Applications, 2024, 83 (28) : 71909 - 71923
  • [22] HyperSFormer: A Transformer-Based End-to-End Hyperspectral Image Classification Method for Crop Classification
    Xie, Jiaxing
    Hua, Jiajun
    Chen, Shaonan
    Wu, Peiwen
    Gao, Peng
    Sun, Daozong
    Lyu, Zhendong
    Lyu, Shilei
    Xue, Xiuyun
    Lu, Jianqiang
    REMOTE SENSING, 2023, 15 (14)
  • [23] EEGformer: A transformer-based brain activity classification method using EEG signal
    Wan, Zhijiang
    Li, Manyu
    Liu, Shichang
    Huang, Jiajin
    Tan, Hai
    Duan, Wenfeng
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [24] Enhanced Image-Based Malware Classification Using Transformer-Based Convolutional Neural Networks (CNNs)
    Ashawa, Moses
    Owoh, Nsikak
    Hosseinzadeh, Salaheddin
    Osamor, Jude
    ELECTRONICS, 2024, 13 (20)
  • [25] Attention Fusion of Transformer-Based and Scale-Based Method for Hyperspectral and LiDAR Joint Classification
    Zhang, Maqun
    Gao, Feng
    Zhang, Tiange
    Gan, Yanhai
    Dong, Junyu
    Yu, Hui
    REMOTE SENSING, 2023, 15 (03)
  • [26] Transformer-Based Few-Shot and Fine-Grained Image Classification Method
    Lu, Yan
    Wang, Yangping
    Wang, Wenrun
    Computer Engineering and Applications, 2023, 59 (23) : 219 - 227
  • [27] An Enhanced Method on Transformer-Based Model for ONE2SEQ Keyphrase Generation
    Shen, Lingyun
    Le, Xiaoqiu
    ELECTRONICS, 2023, 12 (13)
  • [28] A GAN-based image synthesis method for skin lesion classification
    Qin, Zhiwei
    Liu, Zhao
    Zhu, Ping
    Xue, Yongbo
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2020, 195
  • [29] ENHANCED TRANSFORMER-BASED DEEP KERNEL FUSED SELF ATTENTION MODEL FOR LUNG NODULE SEGMENTATION AND CLASSIFICATION
    Saritha, R. Rani
    Gunasundari, R.
    ARCHIVES FOR TECHNICAL SCIENCES, 2024, (31): : 175 - 191
  • [30] Multiclass skin lesion localization and classification using deep learning based features fusion and selection framework for smart healthcare
    Maqsood, Sarmad
    Damasevicius, Robertas
    NEURAL NETWORKS, 2023, 160 : 238 - 258