Deep learning-based sign language recognition system for static signs

被引:95
|
作者
Wadhawan, Ankita [1 ]
Kumar, Parteek [1 ]
机构
[1] Thapar Inst Engn & Technol, Comp Sci & Engn Dept, Patiala, Punjab, India
来源
NEURAL COMPUTING & APPLICATIONS | 2020年 / 32卷 / 12期
关键词
Sign language; Data acquisition; Convolutional neural network; Max-pooling; Softmax; Optimizer; GESTURE; HAND;
D O I
10.1007/s00521-019-04691-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sign language for communication is efficacious for humans, and vital research is in progress in computer vision systems. The earliest work in Indian Sign Language (ISL) recognition considers the recognition of significant differentiable hand signs and therefore often selecting a few signs from the ISL for recognition. This paper deals with robust modeling of static signs in the context of sign language recognition using deep learning-based convolutional neural networks (CNN). In this research, total 35,000 sign images of 100 static signs are collected from different users. The efficiency of the proposed system is evaluated on approximately 50 CNN models. The results are also evaluated on the basis of different optimizers, and it has been observed that the proposed approach has achieved the highest training accuracy of 99.72% and 99.90% on colored and grayscale images, respectively. The performance of the proposed system has also been evaluated on the basis of precision, recall andF-score. The system also demonstrates its effectiveness over the earlier works in which only a few hand signs are considered for recognition.
引用
收藏
页码:7957 / 7968
页数:12
相关论文
共 50 条
  • [31] Deep learning-based idiomatic expression recognition for the Amharic language
    Endalie, Demeke
    Haile, Getamesay
    Taye, Wondmagegn
    [J]. PLOS ONE, 2023, 18 (12):
  • [32] A Deep Learning based Approach for Recognition of Arabic Sign Language Letters
    Hdioud, Boutaina
    Tirari, Mohammed El Haj
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (04) : 424 - 429
  • [33] Synthetic Corpus Generation for Deep Learning-Based Translation of Spanish Sign Language
    Perea-Trigo, Marina
    Botella-Lopez, Celia
    Martinez-del-Amor, Miguel Angel
    Alvarez-Garcia, Juan Antonio
    Soria-Morillo, Luis Miguel
    Vegas-Olmos, Juan Jose
    [J]. SENSORS, 2024, 24 (05)
  • [34] A Light-Weight Deep Learning-Based Architecture for Sign Language Classification
    Nareshkumar, M. Daniel
    Jaison, B.
    [J]. INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 35 (03): : 3501 - 3515
  • [35] Deep Leaning Based Static Indian-Gujarati Sign Language Gesture Recognition
    Patel D.U.
    Joshi J.M.
    [J]. SN Computer Science, 3 (5)
  • [36] Continuous Sign Language Recognition System Using Deep Learning with MediaPipe Holistic
    Srivastava, Sharvani
    Singh, Sudhakar
    Pooja, Shiv
    Prakash, Shiv
    [J]. WIRELESS PERSONAL COMMUNICATIONS, 2024, 137 (03) : 1455 - 1468
  • [37] DEEP MACHINE LEARNING-BASED ANALYSIS FOR INTELLIGENT PHONETIC LANGUAGE RECOGNITION
    Liu, Yumei
    Luo, Qiang
    [J]. SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2024, 25 (03): : 1557 - 1563
  • [38] DEEP MACHINE LEARNING-BASED ANALYSIS FOR INTELLIGENT PHONETIC LANGUAGE RECOGNITION
    Liu, Yumei
    Luo, Qiang
    [J]. Scalable Computing, 2024, 25 (03): : 1557 - 1563
  • [39] Ghanaian Sign Language Recognition Using Deep Learning
    Odartey, Lamptey K.
    Huang, Yonfeng
    Asantewaa, Effah E.
    Agbedanu, Promise R.
    [J]. PROCEEDINGS OF 2019 INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE (PRAI 2019), 2019, : 81 - 86
  • [40] Recent Advances on Deep Learning for Sign Language Recognition
    Zhang, Yanqiong
    Jiang, Xianwei
    [J]. CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2024, 139 (03): : 2399 - 2450