Enhancing communication: Deep learning for Arabic sign language translation

被引:0
|
作者
Hassan, Mosab A. [1 ]
Ali, Alaa H. [1 ]
Sabri, Atheer A. [2 ]
机构
[1] Univ Technol Baghdad, Dept Elect Engn, Baghdad, Iraq
[2] Univ Technol Baghdad, Dept Commun Engn, Baghdad, Iraq
来源
OPEN ENGINEERING | 2024年 / 14卷 / 01期
关键词
sign language recognition; principal component analysis; linear discriminant analysis; deep learning; convolutional neural network;
D O I
10.1515/eng-2024-0025
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
This study explores the field of sign language recognition through machine learning, focusing on the development and comparative evaluation of various algorithms designed to interpret sign language. With the prevalence of hearing impairment affecting millions globally, efficient sign language recognition systems are increasingly critical for enhancing communication for the deaf and hard-of-hearing community. We review several studies, showcasing algorithms with accuracies ranging from 63.5 to 99.6%. Building on these works, we introduce a novel algorithm that has been rigorously tested and has demonstrated a perfect accuracy of 99.7%. Our proposed algorithm utilizes a sophisticated convolutional neural network architecture that outperforms existing models. This work details the methodology of the proposed system, which includes preprocessing, feature extraction, and a multi-layered CNN approach. The remarkable performance of our algorithm sets a new benchmark in the field and suggests significant potential for real-world application in assistive technologies. We conclude by discussing the impact of these findings and propose directions for future research to further improve the accessibility and effectiveness of sign language recognition systems.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] A Kinect-based system for Arabic sign language to speech translation
    Fraiwan, Mohammad
    Khasawneh, Natheer
    Ershedat, Hosam
    Al-Alali, Ibrahim
    Al-Kofahi, Hamza
    INTERNATIONAL JOURNAL OF COMPUTER APPLICATIONS IN TECHNOLOGY, 2015, 52 (2-3) : 117 - 126
  • [42] Contrastive Learning for Sign Language Recognition and Translation
    Gan, Shiwei
    Yin, Yafeng
    Jiang, Zhiwei
    Xia, Kang
    Xie, Lei
    Lu, Sanglu
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 763 - 772
  • [43] Data Augmentation for Human Keypoint Estimation Deep Learning based Sign Language Translation
    Park, Chan-Il
    Sohn, Chae-Bong
    ELECTRONICS, 2020, 9 (08) : 1 - 9
  • [44] A Portable Hong Kong Sign Language Translation Platform with Deep Learning and Jetson Nano
    Zhou, Zhenxing
    Neo, Yisiang
    Lui, King-Shan
    Tam, Vincent W. L.
    Lam, Edmund Y.
    Wong, Ngai
    22ND INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY (ASSETS '20), 2020,
  • [45] Synthetic Corpus Generation for Deep Learning-Based Translation of Spanish Sign Language
    Perea-Trigo, Marina
    Botella-Lopez, Celia
    Martinez-del-Amor, Miguel Angel
    Alvarez-Garcia, Juan Antonio
    Soria-Morillo, Luis Miguel
    Vegas-Olmos, Juan Jose
    SENSORS, 2024, 24 (05)
  • [46] An Avatar Based Translation System from Arabic Speech to Arabic Sign Language for Deaf People
    Halawani, Sami M.
    Daman, Daut
    Kari, Sarudin
    Ahmad, Ab Rahman
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2013, 13 (12): : 43 - 52
  • [47] A vision-based deep learning approach for independent-users Arabic sign language interpretation
    Mostafa Magdy Balaha
    Sara El-Kady
    Hossam Magdy Balaha
    Mohamed Salama
    Eslam Emad
    Muhammed Hassan
    Mahmoud M. Saafan
    Multimedia Tools and Applications, 2023, 82 : 6807 - 6826
  • [48] ESMAANI: A Static and Dynamic Arabic Sign Language Recognition System Based on Machine and Deep Learning Models
    Hisham, Essam
    Saleh, Sherine Nagy
    2022 5TH INTERNATIONAL CONFERENCE ON COMMUNICATIONS, SIGNAL PROCESSING, AND THEIR APPLICATIONS (ICCSPA), 2022,
  • [49] A vision-based deep learning approach for independent-users Arabic sign language interpretation
    Balaha, Mostafa Magdy
    El-Kady, Sara
    Balaha, Hossam Magdy
    Salama, Mohamed
    Emad, Eslam
    Hassan, Muhammed
    Saafan, Mahmoud M.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (05) : 6807 - 6826
  • [50] Image-Based Arabic Sign Language Recognition System Using Transfer Deep Learning Models
    Bani Baker, Qanita
    Alqudah, Nour
    Alsmadi, Tibra
    Awawdeh, Rasha
    APPLIED COMPUTATIONAL INTELLIGENCE AND SOFT COMPUTING, 2023, 2023