Mobile-friendly skin lesion detection using an attention-driven lightweight model

被引:0
|
作者
Hu, Mingzhe [1 ]
Yang, Xiaofeng [2 ,3 ]
机构
[1] Emory Univ, Dept Comp Sci & Informat, Atlanta, GA 30322 USA
[2] Emory Univ, Dept Radiat Oncol, Atlanta, GA 30322 USA
[3] Emory Univ, Winship Canc Inst, Atlanta, GA 30322 USA
关键词
Skin Lesion; GhostNet; Lightweight; Mobile Devices; Attention;
D O I
10.1117/12.3006822
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study presents a lightweight pipeline for skin lesion detection, addressing the challenges posed by imbalanced class distribution and subtle or atypical appearances of some lesions. The pipeline is built around a lightweight model that leverages ghosted features and the DFC attention mechanism to reduce computational complexity while maintaining high performance. The model was trained on the HAM10000 dataset, which includes various types of skin lesions. To address the class imbalance in the dataset, the synthetic minority over-sampling technique and various image augmentation techniques were used. The model also incorporates a knowledge-based loss weighting technique, which assigns different weights to the loss function at the class level and the instance level, helping the model focus on minority classes and challenging samples. This technique involves assigning different weights to the loss function on two levels - the class level and the instance level. By applying appropriate loss weights, the model pays more attention to the minority classes and challenging samples, thus improving its ability to correctly detect and classify different skin lesions. The model achieved an accuracy of 92.4%, a precision of 84.2%, a recall of 86.9%, a f1-score of 85.4% with particularly strong performance in identifying Benign Keratosis-like lesions (BKL) and Nevus (NV). Despite its superior performance, the model's computational cost is considerably lower than some models with less accuracy, making it an optimal solution for real-world applications where both accuracy and efficiency are essential.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] A lightweight attention-driven distillation model for human pose estimation
    Wei, Falai
    Hu, Xiaofang
    [J]. PATTERN RECOGNITION LETTERS, 2024, 185 : 247 - 253
  • [2] A MODEL OF ATTENTION-DRIVEN SCENE ANALYSIS
    Slaney, Malcolm
    Agus, Trevor
    Liu, Shih-Chii
    Kaya, Merve
    Elhilali, Mounya
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 145 - 148
  • [3] Attention-Driven Driving Maneuver Detection System
    Peng, Xishuai
    Zhao, Ava
    Wang, Song
    Murphey, Yi Lu
    Li, Yuanxiang
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [4] Attention-driven RetinaNet for Parasitic Egg Detection
    Pho, Khoa
    Lam, Han
    Tung Le
    Huy Tien Nguyen
    Yoshitaka, Atsuo
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2022, : 265 - 272
  • [5] Attention-Driven Transfer Learning Model for Improved IoT Intrusion Detection
    Abdelhamid, Salma
    Hegazy, Islam
    Aref, Mostafa
    Roushdy, Mohamed
    [J]. BIG DATA AND COGNITIVE COMPUTING, 2024, 8 (09)
  • [6] Attention-driven parts-based object detection
    Autio, I
    Lindgren, JT
    [J]. ECAI 2004: 16TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2004, 110 : 917 - 921
  • [7] A deep attention-driven model to forecast solar irradiance
    Dairi, Abdelkader
    Harrou, Fouzi
    Sun, Ying
    [J]. 2021 IEEE 19TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), 2021,
  • [8] Attention-Driven Loss for Anomaly Detection in Video Surveillance
    Zhou, Joey Tianyi
    Zhang, Le
    Fang, Zhiwen
    Du, Jiawei
    Peng, Xi
    Xiao, Yang
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (12) : 4639 - 4647
  • [9] Attention-driven Factor Model for Explainable Personalized Recommendation
    Chen, Jingwu
    Zhuang, Fuzhen
    Hong, Xin
    Ao, Xiang
    Xie, Xing
    He, Qing
    [J]. ACM/SIGIR PROCEEDINGS 2018, 2018, : 909 - 912
  • [10] Lightweight Tensor Attention-Driven ConvLSTM Neural Network for Hyperspectral Image Classification
    Hu, Wen-Shuai
    Li, Heng-Chao
    Deng, Yang-Jun
    Sun, Xian
    Du, Qian
    Plaza, Antonio
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2021, 15 (03) : 734 - 745