Recognition of user-dependent and independent static hand gestures: Application to sign language*

被引:15
|
作者
Sadeddine, Khadidja [1 ]
Chelali, Zohra Fatma [1 ]
Djeradi, Rachida [1 ]
Djeradi, Amar [1 ]
Benabderrahmane, Sidahmed [2 ]
机构
[1] Univ Sci & Technol Houari Boumed, Elect & Comp Sci Fac, Bab Ezzouar, Algeria
[2] Paris 8 Univ, CS Dept, LIASD, 2 Rue Liberte, F-93526 St Denis, France
关键词
Static hand gesture recognition; Sign language recognition; GLAC; Gabor wavelet; Curvelet transform; Combined classifiers; FACE RECOGNITION; FEATURE-EXTRACTION; GABOR FILTER; CLASSIFICATION; TRANSFORM; POSTURES; FEATURES; SYSTEM;
D O I
10.1016/j.jvcir.2021.103193
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Static hand gesture (HG) recognition for both user-dependent and user-independent is a challenging problem, especially when there are changes in lighting, hand position, and background, the recognition becomes more complex. To solve this problem, this paper proposes a static hand gesture recognition based on a set of image descriptors: Gradient Local Auto-Correlation (GLAC), Gabor Wavelet Transform (GWT), and Fast Discrete Curve Transform (FDCT). Principal Component Analysis (PCA) was used to reduce dimensionality. Tests were performed on three sign language datasets and one hand posture dataset using neural network classifiers, K-Nearest Neighbor (KNN) classifiers, and combined classifiers. The results obtained were compared to the state of the art and show an accuracy of 100% for user-independent and 98.33% for user-dependent gestures, despite the difficult acquisition conditions of the datasets.
引用
收藏
页数:22
相关论文
共 50 条
  • [31] Application of Convolutional Neural Networks for Static Hand Gestures Recognition Under Different Invariant Features
    Flores C, Jose L.
    Cutipa A, E. Gladys
    Enciso R, Lauro
    PROCEEDINGS OF THE 2017 IEEE XXIV INTERNATIONAL CONFERENCE ON ELECTRONICS, ELECTRICAL ENGINEERING AND COMPUTING (INTERCON), 2017,
  • [32] User-independent recognition of Arabic sign language for facilitating communication with the deaf community
    Shanableh, T.
    Assaleh, K.
    DIGITAL SIGNAL PROCESSING, 2011, 21 (04) : 535 - 542
  • [33] Recognition of Gestures in Pakistani Sign Language using Fuzzy Classifier
    Kausar, Sumaira
    Javed, M. Younus
    Sohail, Shaleeza
    ISCGAV'08: PROCEEDINGS OF THE 8TH WSEAS INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, COMPUTATIONAL GEOMETRY AND ARTIFICIAL VISION, 2008, : 101 - 105
  • [34] Hand Localization and Fingers Features Extraction: Application to Digit Recognition in Sign Language
    Ben Jmaa, A.
    Mahdi, W.
    Ben Jemaa, Y.
    Ben Hamadou, A.
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING, PROCEEDINGS, 2009, 5788 : 151 - 159
  • [35] Albanian Sign Language (AlbSL) Number Recognition from Both Hand's Gestures Acquired by Kinect Sensors
    Gani, Eriglen
    Kika, Alda
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2016, 7 (07) : 216 - 220
  • [36] Static Hand Gesture Recognition of Indonesian Sign Language System Based on Backpropagation Neural Networks
    Asriani, Farida
    Susilawati, Hesti
    MAKARA JOURNAL OF TECHNOLOGY, 2010, 14 (02): : 150 - 154
  • [37] Static Hand Gesture Recognition for American Sign Language using Deep Convolutional Neural Network
    Das, Prangon
    Ahmed, Tanvir
    Ali, Md Firoj
    2020 IEEE REGION 10 SYMPOSIUM (TENSYMP) - TECHNOLOGY FOR IMPACTFUL SUSTAINABLE DEVELOPMENT, 2020, : 762 - 765
  • [38] Static hand gesture recognition for Vietnamese sign language (VSL) using principle components analysis
    Thao Nguyen Thi Huong
    Tien Vu Huu
    Thanh Le Xuan
    San Vu Van
    2015 INTERNATIONAL CONFERENCE ON COMMUNICATIONS, MANAGEMENT AND TELECOMMUNICATIONS (COMMANTEL), 2015, : 138 - 141
  • [39] Transfer Learning with L2 Norm Regularization for classifying static Two Hand Hindi Sign Language Gestures
    Jaiswal, Mohita
    Sharma, Vaidehi
    Sharma, Abhishek
    Tomar, Raghuvir
    2020 IEEE 9TH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS AND NETWORK TECHNOLOGIES (CSNT 2020), 2020, : 44 - 48
  • [40] Hierarchical recognition of dynamic hand gestures for telerobotic application
    Mammen, JP
    Chaudhury, S
    Agrawal, T
    IETE JOURNAL OF RESEARCH, 2002, 48 (3-4) : 245 - 252