A Robust Model for Translating Arabic Sign Language into Spoken Arabic Using Deep Learning

被引:4
|
作者
Nahar, Khalid M. O. [1 ]
Almomani, Ammar [2 ,3 ]
Shatnawi, Nahlah [1 ]
Alauthman, Mohammad [4 ]
机构
[1] Yarmouk Univ Irbid, Fac Informat Technol & Comp Sci, Dept Comp Sci, Irbid 21163, Jordan
[2] Skyline Univ Coll, Sch Comp, POB 1797, Sharjah, U Arab Emirates
[3] Al Balqa Appl Univ, Al Huson Univ Coll, IT Dept, POB 50, Irbid, Jordan
[4] Univ Petra, Fac Informat Technol, Dept Informat Secur, Amman, Jordan
来源
关键词
Sign language; deep learning; transfer learning; machine learning; automatic translation of sign language; natural language processing; Arabic sign language; SUPPORT VECTOR MACHINE; RECOGNITION; CLASSIFICATION; TRANSFORM;
D O I
10.32604/iasc.2023.038235
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study presents a novel and innovative approach to automatically translating Arabic Sign Language (ATSL) into spoken Arabic. The proposed solution utilizes a deep learning-based classification approach and the transfer learning technique to retrain 12 image recognition models. The image-based translation method maps sign language gestures to corresponding letters or words using distance measures and classification as a machine learning technique. The results show that the proposed model is more accurate and faster than traditional image-based models in classifying Arabiclanguage signs, with a translation accuracy of 93.7%. This research makes a significant contribution to the field of ATSL. It offers a practical solution for improving communication for individuals with special needs, such as the deaf and mute community. This work demonstrates the potential of deep learning techniques in translating sign language into natural language and highlights the importance of ATSL in facilitating communication for individuals with disabilities.
引用
收藏
页码:2037 / 2057
页数:21
相关论文
共 50 条
  • [41] Arabic/English automatic spoken language identification
    Nofal, Maged
    Abdel-Reheem, Esam
    El Henawy, Hadia
    [J]. IEEE Pacific RIM Conference on Communications, Computers, and Signal Processing - Proceedings, 1999, : 400 - 403
  • [42] ATLASLang NMT: Arabic text language into Arabic sign language neural machine translation
    Brour, Mourad
    Benabbou, Abderrahim
    [J]. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2021, 33 (09) : 1121 - 1131
  • [43] Prototype for Learning and Teaching Arabic Sign Language Using 3D Animations
    Ayadi, Kamel
    Elhadj, Yahya O. M.
    Ferchichi, Ahmed
    [J]. 2018 INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS), 2018, : 51 - 57
  • [44] Integrated Mediapipe with a CNN Model for Arabic Sign Language Recognition
    AL Moustafa, Ahmad M. J.
    Rahim, Mohd Shafry Mohd
    Bouallegue, Belgacem
    Khattab, Mahmoud M.
    Soliman, Amr Mohmed
    Tharwat, Gamal
    Ahmed, Abdelmoty M.
    [J]. JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2023, 2023
  • [45] Using Deep Learning in Arabic-English Cross Language Information Retrieval
    Attia, Omar
    Azmy, Michael
    Abu Emeira, Ahmed
    El Azzouni, Karim
    Hussein, Omar
    El-Makky, Nagwa M.
    Nagi, Khaled
    [J]. KDIR: PROCEEDINGS OF THE 8TH INTERNATIONAL JOINT CONFERENCE ON KNOWLEDGE DISCOVERY, KNOWLEDGE ENGINEERING AND KNOWLEDGE MANAGEMENT - VOL. 1, 2016, : 367 - 374
  • [46] Recognition of arabic sign language alphabet using polynomial classifiers
    [J]. Assaleh, K. (kassaleh@ausharjah.edu), 1600, Hindawi Publishing Corporation (2005):
  • [47] Arabic Sign Language (ArSL) Recognition System Using HMM
    Youssif, Aliaa A. A.
    Aboutabl, Amal Elsayed
    Ali, Heba Hamdy
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2011, 2 (11) : 45 - 51
  • [48] Arabic Sign Language Recognition Using Leap Motion Sensor
    Elons, A. S.
    Ahmed, Menna
    Shedid, Hwaidaa
    Tolba, M. F.
    [J]. 2014 9TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING & SYSTEMS (ICCES), 2014, : 368 - 373
  • [49] Arabic Sign Language Recognition using the Leap Motion Controller
    Mohandes, M.
    Aliyu, S.
    Deriche, M.
    [J]. 2014 IEEE 23RD INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2014, : 960 - 965
  • [50] Recognition of Arabic Sign Language Alphabet Using Polynomial Classifiers
    Khaled Assaleh
    M. Al-Rousan
    [J]. EURASIP Journal on Advances in Signal Processing, 2005