Facia-fix: mobile application for bell's palsy diagnosis and assessment using computer vision and deep learning

被引:0
|
作者
Mohamed, Amira [1 ]
Eid, Doha [1 ]
Ezzat, Mariam M. [1 ]
Ehab, Mayar [1 ]
Khaled, Maye [1 ]
Gaber, Sarah [2 ]
Gaber, Amira [1 ]
机构
[1] Cairo Univ, Fac Engn, Dept Syst & Biomed, Giza, Egypt
[2] Cairo Univ, Fac Phys Therapy, Dept Neuromuscular Disorder & Its Surg, Giza, Egypt
来源
关键词
quantitative assessment; facial paralysis; mobile application; bell's palsy diagnosis; deep learning; computer vision; ELECTRONEUROGRAPHY;
D O I
10.1088/2057-1976/ad8094
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Facial paralysis (FP) is a condition characterized by the inability to move some or all of the muscles on one or both sides of the face. Diagnosing FP presents challenges due to the limitations of traditional methods, which are time-consuming, uncomfortable for patients, and require specialized clinicians. Additionally, more advanced tools are often uncommonly available to all healthcare providers. Early and accurate detection of FP is crucial, as timely intervention can prevent long-term complications and improve patient outcomes. To address these challenges, our research introduces Facia-Fix, a mobile application for Bell's palsy diagnosis, integrating computer vision and deep learning techniques to provide real-time analysis of facial landmarks. The classification algorithms are trained on the publicly available YouTube FP (YFP) dataset, which is labeled using the House-Brackmann (HB) method, a standardized system for assessing the severity of FP. Different deep learning models were employed to classify the FP severity, such as MobileNet, CNN, MLP, VGG16, and Vision Transformer. The MobileNet model which uses transfer learning, achieved the highest performance (Accuracy: 0.9812, Precision: 0.9753, Recall: 0.9727, F1 Score: 0.974), establishing it as the optimal choice among the evaluated models. The innovation of this approach lies in its use of advanced deep learning models to provide accurate, objective, non-invasive and real-time comprehensive quantitative assessment of FP severity. Preliminary results highlight the potential of Facia-Fix to significantly improve the diagnostic and follow-up experiences for both clinicians and patients.
引用
收藏
页数:14
相关论文
共 12 条
  • [1] The assessment of deep learning computer vision algorithms for the diagnosis of prostatic adenocarcinoma Diagnosis of prostatic adenocarcinoma using computer vision
    Bukhari, Syed Usama Khalid
    Mehtab, Ubeer
    Hussain, Syed Shahzad
    Syed, Asmara
    Armaghan, Syed Umar
    Shah, Syed Sajid Hussain
    ANNALS OF CLINICAL AND ANALYTICAL MEDICINE, 2021, 12 : 31 - 34
  • [2] Deep Learning for Roasting Coffee Bean Quality Assessment Using Computer Vision in Mobile Environment
    Hakim, Muslih
    Djatna, Taufik
    Yuliasih, Indah
    ICACSIS 2020: 2020 12TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTER SCIENCE AND INFORMATION SYSTEMS (ICACSIS), 2020, : 363 - 369
  • [3] Application of Computer Vision and Deep Learning in Breast Cancer Assisted Diagnosis
    Gu Yunchao
    Yang Jiayao
    PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND SOFT COMPUTING (ICMLSC 2019), 2019, : 186 - 191
  • [4] Advancing Eosinophilic Esophagitis Diagnosis and Phenotype Assessment with Deep Learning Computer Vision
    Adorno, William, III
    Catalano, Alexis
    Ehsan, Lubaina
    von Eckstaedt, Hans
    Barnes, Barrett
    McGowan, Emily
    Syed, Sana
    Brown, Donald
    BIOIMAGING: PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON BIOMEDICAL ENGINEERING SYSTEMS AND TECHNOLOGIES - VOL. 2: BIOIMAGING, 2021, : 44 - 55
  • [5] Visual Computing Unified Application Using Deep Learning and Computer Vision Techniques
    Sowmya, B.J.
    Meeradevi
    Seema, S.
    Dayananda, P.
    Supreeth, S.
    Shruthi, G.
    Rohith, S.
    International Journal of Interactive Mobile Technologies, 2024, 18 (01): : 59 - 74
  • [6] Deep learning-driven diagnosis: A multi-task approach for segmenting stroke and Bell's palsy
    Umirzakova, Sabina
    Ahmad, Shabir
    Mardieva, Sevara
    Muksimova, Shakhnoza
    Whangbo, Taeg Keun
    PATTERN RECOGNITION, 2023, 144
  • [7] Vehicle Detection, Tracking, and Speed Estimation Using Deep Learning and Computer Vision: An Application Perspective
    Jaiswal, Shiksha
    Kotaiah, Shristi, V
    Chaurasia, Sandeep
    SMART SYSTEMS: INNOVATIONS IN COMPUTING (SSIC 2021), 2022, 235 : 515 - 522
  • [8] An Innovative Approach of Textile Fabrics Identification from Mobile Images using Computer Vision based on Deep Transfer Learning
    da Silva Barros, Antonio Carlos
    Ohata, Elene Firmeza
    da Silva, Suane Pires P.
    Almeida, Jefferson Silva
    Reboucas Filho, Pedro Pedrosa
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [9] Jump power assessment using computer vision-based deep learning motion analysis to detect possible sarcopenia
    Cho, Sang Wouk
    Park, Eun-young
    Park, Na-rae
    Han, Sookyeong
    Rhee, Yumie
    Hong, Namki
    JOURNAL OF BONE AND MINERAL RESEARCH, 2023, 38 : 387 - 387
  • [10] A Multi-Stage Approach for Cardiovascular Risk Assessment from Retinal Images Using an Amalgamation of Deep Learning and Computer Vision Techniques
    Prasad, Deepthi K.
    Manjunath, Madhura Prakash
    Kulkarni, Meghna S.
    Kullambettu, Spoorthi
    Srinivasan, Venkatakrishnan
    Chakravarthi, Madhulika
    Ramesh, Anusha
    DIAGNOSTICS, 2024, 14 (09)