A Robust Model for Translating Arabic Sign Language into Spoken Arabic Using Deep Learning

被引:4
|
作者
Nahar, Khalid M. O. [1 ]
Almomani, Ammar [2 ,3 ]
Shatnawi, Nahlah [1 ]
Alauthman, Mohammad [4 ]
机构
[1] Yarmouk Univ Irbid, Fac Informat Technol & Comp Sci, Dept Comp Sci, Irbid 21163, Jordan
[2] Skyline Univ Coll, Sch Comp, POB 1797, Sharjah, U Arab Emirates
[3] Al Balqa Appl Univ, Al Huson Univ Coll, IT Dept, POB 50, Irbid, Jordan
[4] Univ Petra, Fac Informat Technol, Dept Informat Secur, Amman, Jordan
来源
关键词
Sign language; deep learning; transfer learning; machine learning; automatic translation of sign language; natural language processing; Arabic sign language; SUPPORT VECTOR MACHINE; RECOGNITION; CLASSIFICATION; TRANSFORM;
D O I
10.32604/iasc.2023.038235
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study presents a novel and innovative approach to automatically translating Arabic Sign Language (ATSL) into spoken Arabic. The proposed solution utilizes a deep learning-based classification approach and the transfer learning technique to retrain 12 image recognition models. The image-based translation method maps sign language gestures to corresponding letters or words using distance measures and classification as a machine learning technique. The results show that the proposed model is more accurate and faster than traditional image-based models in classifying Arabiclanguage signs, with a translation accuracy of 93.7%. This research makes a significant contribution to the field of ATSL. It offers a practical solution for improving communication for individuals with special needs, such as the deaf and mute community. This work demonstrates the potential of deep learning techniques in translating sign language into natural language and highlights the importance of ATSL in facilitating communication for individuals with disabilities.
引用
收藏
页码:2037 / 2057
页数:21
相关论文
共 50 条
  • [1] Arabic Sign Language Recognition Using Deep Learning Models
    Al-Barham, Muhammad
    Abu Sa'aleek, Ahmad
    Al-Odat, Mohammad
    Hamad, Ghada
    Al-Yaman, Musa
    Elnagar, Ashraf
    [J]. 2022 13TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2022, : 226 - 231
  • [2] Arabic Sign Language Recognition Using Deep Machine Learning
    Suliman, Wael
    Deriche, Mohamed
    Luqman, Hamzah
    Mohandes, Mohamed
    [J]. 2021 4TH INTERNATIONAL SYMPOSIUM ON ADVANCED ELECTRICAL AND COMMUNICATION TECHNOLOGIES (ISAECT), 2021,
  • [3] Spoken Arabic Digits Recognition Using Deep Learning
    Wazir, Abdulaziz Saleh Mahfoudh B. A.
    Chuah, Joon Huang
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC CONTROL AND INTELLIGENT SYSTEMS (I2CACIS), 2019, : 339 - 344
  • [4] Real-Time Arabic Sign Language Recognition Using a Hybrid Deep Learning Model
    Noor, Talal H.
    Noor, Ayman
    Alharbi, Ahmed F.
    Faisal, Ahmed
    Alrashidi, Rakan
    Alsaedi, Ahmed S.
    Alharbi, Ghada
    Alsanoosy, Tawfeeq
    Alsaeedi, Abdullah
    [J]. SENSORS, 2024, 24 (11)
  • [5] Signer-Independent Arabic Sign Language Recognition System Using Deep Learning Model
    Podder, Kanchon Kanti
    Ezeddin, Maymouna
    Chowdhury, Muhammad E. H.
    Sumon, Md. Shaheenur Islam
    Tahir, Anas M.
    Ayari, Mohamed Arselene
    Dutta, Proma
    Khandakar, Amith
    Mahbub, Zaid Bin
    Kadir, Muhammad Abdul
    [J]. SENSORS, 2023, 23 (16)
  • [6] Arabic Sign Language Detection Using Deep Learning Based Pose Estimation
    Ismail, Mohammad H.
    Dawwd, Shefa A.
    Ali, Fakhrulddin H.
    [J]. PROCEEDING OF 2021 2ND INFORMATION TECHNOLOGY TO ENHANCE E-LEARNING AND OTHER APPLICATION (IT-ELA 2021), 2021, : 161 - 166
  • [7] Enhancing communication: Deep learning for Arabic sign language translation
    Hassan, Mosab A.
    Ali, Alaa H.
    Sabri, Atheer A.
    [J]. OPEN ENGINEERING, 2024, 14 (01):
  • [8] A Real Time Arabic Sign Language Alphabets (ArSLA) Recognition Model Using Deep Learning Architecture
    Alsaadi, Zaran
    Alshamani, Easa
    Alrehaili, Mohammed
    Alrashdi, Abdulmajeed Ayesh D.
    Albelwi, Saleh
    Elfaki, Abdelrahman Osman
    [J]. COMPUTERS, 2022, 11 (05)
  • [9] EDUCATED SPOKEN ARABIC AND THE ARABIC LANGUAGE CONTINUUM
    MEISELES, G
    [J]. ARCHIVUM LINGUISTICUM, 1980, 11 (02): : 118 - 148
  • [10] A Bidirectional Arabic Sign Language Framework Using Deep Learning and Fuzzy Matching Score
    Mosleh, Mogeeb A. A.
    Assiri, Adel
    Gumaei, Abdu H.
    Alkhamees, Bader Fahad
    Al-Qahtani, Manal
    [J]. MATHEMATICS, 2024, 12 (08)