Improved Recognition of Kurdish Sign Language Using Modified CNN

被引:1
|
作者
Hama Rawf, Karwan Mahdi [1 ]
Abdulrahman, Ayub Othman [1 ]
Mohammed, Aree Ali [1 ,2 ]
机构
[1] Univ Halabja, Coll Sci, Comp Sci Dept, Halabja 46018, Krg, Iraq
[2] Univ Sulaimani, Coll Sci, Comp Sci Dept, Sulaimani 334, Iraq
关键词
sign language recognition (SLR); Kurdish alphabet; Kurdish sign language (KuSL); real-time recognition; CNN; gesture recognition hand shape; KuSL2023; human-computer interaction; computer vision;
D O I
10.3390/computers13020037
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The deaf society supports Sign Language Recognition (SLR) since it is used to educate individuals in communication, education, and socialization. In this study, the results of using the modified Convolutional Neural Network (CNN) technique to develop a model for real-time Kurdish sign recognition are presented. Recognizing the Kurdish alphabet is the primary focus of this investigation. Using a variety of activation functions over several iterations, the model was trained and then used to make predictions on the KuSL2023 dataset. There are a total of 71,400 pictures in the dataset, drawn from two separate sources, representing the 34 sign languages and alphabets used by the Kurds. A large collection of real user images is used to evaluate the accuracy of the suggested strategy. A novel Kurdish Sign Language (KuSL) model for classification is presented in this research. Furthermore, the hand region must be identified in a picture with a complex backdrop, including lighting, ambience, and image color changes of varying intensities. Using a genuine public dataset, real-time classification, and personal independence while maintaining high classification accuracy, the proposed technique is an improvement over previous research on KuSL detection. The collected findings demonstrate that the performance of the proposed system offers improvements, with an average training accuracy of 99.05% for both classification and prediction models. Compared to earlier research on KuSL, these outcomes indicate very strong performance.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Continuous Chinese Sign Language Recognition with CNN-LSTM
    Yang, Su
    Zhu, Qing
    NINTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2017), 2017, 10420
  • [22] Indian sign language alphabet recognition system using CNN with diffGrad optimizer and stochastic pooling
    Nandi, Utpal
    Ghorai, Anudyuti
    Singh, Moirangthem Marjit
    Changdar, Chiranjit
    Bhakta, Shubhankar
    Pal, Rajat Kumar
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (07) : 9627 - 9648
  • [23] Indian sign language alphabet recognition system using CNN with diffGrad optimizer and stochastic pooling
    Utpal Nandi
    Anudyuti Ghorai
    Moirangthem Marjit Singh
    Chiranjit Changdar
    Shubhankar Bhakta
    Rajat Kumar Pal
    Multimedia Tools and Applications, 2023, 82 : 9627 - 9648
  • [24] A Comparative Study on Performance of SVM and CNN in Tanzania Sign Language Translation Using Image Recognition
    Myagila, Kasian
    Kilavo, Hassan
    APPLIED ARTIFICIAL INTELLIGENCE, 2022, 36 (01)
  • [25] A Modified LSTM Model for Continuous Sign Language Recognition Using Leap Motion
    Mittal, Anshul
    Kumar, Pradeep
    Roy, Partha Pratim
    Balasubramanian, Raman
    Chaudhuri, Bidyut B.
    IEEE SENSORS JOURNAL, 2019, 19 (16) : 7056 - 7063
  • [26] Regional-CNN-based enhanced Turkish sign language recognition
    Yirtici, Tolga
    Yurtkan, Kamil
    SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (05) : 1305 - 1311
  • [27] Regional-CNN-based enhanced Turkish sign language recognition
    Tolga Yirtici
    Kamil Yurtkan
    Signal, Image and Video Processing, 2022, 16 : 1305 - 1311
  • [28] Web Based Recognition and Translation of American Sign Language with CNN and RNN
    Bendarkar, Dhanashree Shyam
    Somase, Pratiksha Appasaheb
    Rebari, Preety Kalyansingh
    Paturkar, Renuka Ramkrishna
    Khan, Arjumand Masood
    INTERNATIONAL JOURNAL OF ONLINE AND BIOMEDICAL ENGINEERING, 2021, 17 (01) : 34 - 50
  • [29] Sign Language Recognition Using Kinect
    Lang, Simon
    Block, Marco
    Rojas, Raul
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, PT I, 2012, 7267 : 394 - 402
  • [30] Bangla Sign Language Detection using SIFT and CNN
    Shanta, Shirin Sultana
    Anwar, Saif Taifur
    Kabir, Md. Rayhanul
    2018 9TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING TECHNOLOGIES (ICCCNT), 2018,