Enhancing communication: Deep learning for Arabic sign language translation

被引:0
|
作者
Hassan, Mosab A. [1 ]
Ali, Alaa H. [1 ]
Sabri, Atheer A. [2 ]
机构
[1] Univ Technol Baghdad, Dept Elect Engn, Baghdad, Iraq
[2] Univ Technol Baghdad, Dept Commun Engn, Baghdad, Iraq
来源
OPEN ENGINEERING | 2024年 / 14卷 / 01期
关键词
sign language recognition; principal component analysis; linear discriminant analysis; deep learning; convolutional neural network;
D O I
10.1515/eng-2024-0025
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
This study explores the field of sign language recognition through machine learning, focusing on the development and comparative evaluation of various algorithms designed to interpret sign language. With the prevalence of hearing impairment affecting millions globally, efficient sign language recognition systems are increasingly critical for enhancing communication for the deaf and hard-of-hearing community. We review several studies, showcasing algorithms with accuracies ranging from 63.5 to 99.6%. Building on these works, we introduce a novel algorithm that has been rigorously tested and has demonstrated a perfect accuracy of 99.7%. Our proposed algorithm utilizes a sophisticated convolutional neural network architecture that outperforms existing models. This work details the methodology of the proposed system, which includes preprocessing, feature extraction, and a multi-layered CNN approach. The remarkable performance of our algorithm sets a new benchmark in the field and suggests significant potential for real-world application in assistive technologies. We conclude by discussing the impact of these findings and propose directions for future research to further improve the accessibility and effectiveness of sign language recognition systems.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Real-time Arabic avatar for deaf-mute communication enabled by deep learning sign language translation
    Talaat, Fatma M.
    El-Shafai, Walid
    Soliman, Naglaa F.
    Algarni, Abeer D.
    El-Samie, Fathi E. Abd
    Siam, Ali I.
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 119
  • [2] Empowering Communication: A Deep Learning Framework for Arabic Sign Language Recognition with an Attention Mechanism
    Ameer, R. S. Abdul
    Ahmed, M. A.
    Al-Qaysi, Z. T.
    Salih, M. M.
    Shuwandy, Moceheb Lazam
    COMPUTERS, 2024, 13 (06)
  • [3] Deep Learning Methods for Sign Language Translation
    Ananthanarayana, Tejaswini
    Srivastava, Priyanshu
    Chintha, Akash
    Santha, Akhil
    Landy, Brian
    Panaro, Joseph
    Webster, Andre
    Kotecha, Nikunj
    Sah, Shagan
    Sarchet, Thomastine
    Ptucha, Raymond
    Nwogu, Ifeoma
    ACM TRANSACTIONS ON ACCESSIBLE COMPUTING, 2021, 14 (04)
  • [4] Enhancing Arabic Alphabet Sign Language Recognition with VGG16 Deep Learning Investigation
    Elshaer, A. M.
    Ambioh, Yousef
    Soliman, Ziad
    Ahmed, Omar
    Elnakib, Miral
    Safwat, Mohamed
    Elsayed, Salma M.
    Khalid, Mahmoud
    2024 14TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, ICEENG 2024, 2024, : 184 - 186
  • [5] Arabic Sign Language Recognition Using Deep Learning Models
    Al-Barham, Muhammad
    Abu Sa'aleek, Ahmad
    Al-Odat, Mohammad
    Hamad, Ghada
    Al-Yaman, Musa
    Elnagar, Ashraf
    2022 13TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2022, : 226 - 231
  • [6] Arabic Sign Language Recognition Using Deep Machine Learning
    Suliman, Wael
    Deriche, Mohamed
    Luqman, Hamzah
    Mohandes, Mohamed
    2021 4TH INTERNATIONAL SYMPOSIUM ON ADVANCED ELECTRICAL AND COMMUNICATION TECHNOLOGIES (ISAECT), 2021,
  • [7] A Robust Model for Translating Arabic Sign Language into Spoken Arabic Using Deep Learning
    Nahar, Khalid M. O.
    Almomani, Ammar
    Shatnawi, Nahlah
    Alauthman, Mohammad
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 37 (02): : 2037 - 2057
  • [8] Automatic translation of Arabic text-to-Arabic sign language
    Luqman, Hamzah
    Mahmoud, Sabri A.
    UNIVERSAL ACCESS IN THE INFORMATION SOCIETY, 2019, 18 (04) : 939 - 951
  • [9] Automatic Translation from Arabic to Arabic Sign Language: A Review
    Ayadi, Kamel
    ElHadj, Yahya O. M.
    Ferchichi, Ahmed
    2018 JCCO JOINT INTERNATIONAL CONFERENCE ON ICT IN EDUCATION AND TRAINING, INTERNATIONAL CONFERENCE ON COMPUTING IN ARABIC, AND INTERNATIONAL CONFERENCE ON GEOCOMPUTING (JCCO: TICET-ICCA-GECO), 2018, : 11 - 15
  • [10] A machine translation system from Arabic sign language to Arabic
    Luqman, Hamzah
    Mahmoud, Sabri A.
    UNIVERSAL ACCESS IN THE INFORMATION SOCIETY, 2020, 19 (04) : 891 - 904