Deep learning-based sign language recognition system for static signs

被引:95
|
作者
Wadhawan, Ankita [1 ]
Kumar, Parteek [1 ]
机构
[1] Thapar Inst Engn & Technol, Comp Sci & Engn Dept, Patiala, Punjab, India
来源
NEURAL COMPUTING & APPLICATIONS | 2020年 / 32卷 / 12期
关键词
Sign language; Data acquisition; Convolutional neural network; Max-pooling; Softmax; Optimizer; GESTURE; HAND;
D O I
10.1007/s00521-019-04691-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sign language for communication is efficacious for humans, and vital research is in progress in computer vision systems. The earliest work in Indian Sign Language (ISL) recognition considers the recognition of significant differentiable hand signs and therefore often selecting a few signs from the ISL for recognition. This paper deals with robust modeling of static signs in the context of sign language recognition using deep learning-based convolutional neural networks (CNN). In this research, total 35,000 sign images of 100 static signs are collected from different users. The efficiency of the proposed system is evaluated on approximately 50 CNN models. The results are also evaluated on the basis of different optimizers, and it has been observed that the proposed approach has achieved the highest training accuracy of 99.72% and 99.90% on colored and grayscale images, respectively. The performance of the proposed system has also been evaluated on the basis of precision, recall andF-score. The system also demonstrates its effectiveness over the earlier works in which only a few hand signs are considered for recognition.
引用
收藏
页码:7957 / 7968
页数:12
相关论文
共 50 条
  • [1] Deep learning-based sign language recognition system for static signs
    Ankita Wadhawan
    Parteek Kumar
    [J]. Neural Computing and Applications, 2020, 32 : 7957 - 7968
  • [2] Deep Learning-Based Sign Language Recognition System for Cognitive Development
    Jebali, Maher
    Dakhli, Abdesselem
    Bakari, Wided
    [J]. COGNITIVE COMPUTATION, 2023, 15 (06) : 2189 - 2201
  • [3] Deep Learning-Based Sign Language Recognition System for Cognitive Development
    Maher Jebali
    Abdesselem Dakhli
    Wided Bakari
    [J]. Cognitive Computation, 2023, 15 : 2189 - 2201
  • [4] Deep Learning in Sign Language Recognition: A Hybrid Approach for the Recognition of Static and Dynamic Signs
    Buttar, Ahmed Mateen
    Ahmad, Usama
    Gumaei, Abdu H.
    Assiri, Adel
    Akbar, Muhammad Azeem
    Alkhamees, Bader Fahad
    [J]. MATHEMATICS, 2023, 11 (17)
  • [5] Efhamni: A Deep Learning-Based Saudi Sign Language Recognition Application
    Al Khuzayem, Lama
    Shafi, Suha
    Aljahdali, Safia
    Alkhamesie, Rawan
    Alzamzami, Ohoud
    [J]. SENSORS, 2024, 24 (10)
  • [6] A Comprehensive Study on Deep Learning-Based Methods for Sign Language Recognition
    Adaloglou, Nikolas
    Chatzis, Theocharis
    Papastratis, Ilias
    Stergioulas, Andreas
    Papadopoulos, Georgios Th.
    Zacharopoulou, Vassia
    Xydopoulos, George J.
    Atzakas, Klimnis
    Papazachariou, Dimitris
    Daras, Petros
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1750 - 1762
  • [7] A sensing data and deep learning-based sign language recognition approach
    Hao, Wei
    Hou, Chen
    Zhang, Zhihao
    Zhai, Xueyu
    Wang, Li
    Lv, Guanghao
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2024, 118
  • [8] A Deep Learning based Recognition System for Yemeni Sign Language
    Dabwan, Basel A.
    Jadhav, Mukti E.
    [J]. 2021 INTERNATIONAL CONFERENCE OF MODERN TRENDS IN INFORMATION AND COMMUNICATION TECHNOLOGY INDUSTRY (MTICTI 2021), 2021, : 20 - 24
  • [9] Deep Learning-Based Sign Language Recognition for Hearing and Speaking Impaired People
    Alnfiai, Mrim M.
    [J]. INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 36 (02): : 1653 - 1669
  • [10] ESMAANI: A Static and Dynamic Arabic Sign Language Recognition System Based on Machine and Deep Learning Models
    Hisham, Essam
    Saleh, Sherine Nagy
    [J]. 2022 5TH INTERNATIONAL CONFERENCE ON COMMUNICATIONS, SIGNAL PROCESSING, AND THEIR APPLICATIONS (ICCSPA), 2022,