GyGSLA: A Portable Glove System for Learning Sign Language Alphabet

被引:3
|
作者
Sousa, Luis [1 ]
Rodrigues, Joao M. F. [1 ]
Monterio, Janio [2 ]
Cardoso, Pedro J. S. [1 ]
Lam, Roberto [1 ]
机构
[1] Univ Algarve, LARSyS & ISE, P-8005 Faro, Portugal
[2] Univ Algarve, INEC ID Lisbon & ISE, P-8005 Faro, Portugal
关键词
HCI; Gesture recognition; Sign Language; Assistive technologies;
D O I
10.1007/978-3-319-40238-3_16
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The communication between people with normal hearing with those having hearing or speech impairment is difficult. Learning a new alphabet is not always easy, especially when it is a sign language alphabet, which requires both hand skills and practice. This paper presents the GyGSLA system, standing as a completely portable setup created to help inexperienced people in the process of learning a new sign language alphabet. To achieve it, a computer/mobile game-interface and an hardware device, a wearable glove, were developed. When interacting with the computer or mobile device, using the wearable glove, the user is asked to represent alphabet letters and digits, by replicating the hand and fingers positions shown in a screen. The glove then sends the hand and fingers positions to the computer/mobile device using a wireless interface, which interprets the letter or digit that is being done by the user, and gives it a corresponding score. The system was tested with three completely inexperience sign language subjects, achieving a 76% average recognition ratio for the Portuguese sign language alphabet.
引用
收藏
页码:159 / 170
页数:12
相关论文
共 50 条
  • [41] Development of a hybrid word recognition system and dataset for the Azerbaijani Sign Language dactyl alphabet
    Hasanov, Jamaladdin
    Alishzade, Nigar
    Nazimzade, Aykhan
    Dadashzade, Samir
    Tahirov, Toghrul
    [J]. SPEECH COMMUNICATION, 2023, 153
  • [42] Data-Glove for Japanese Sign Language Training System with Gyro-Sensor
    Mori, Yuichiro
    Toyonaga, Masahiko
    [J]. 2018 JOINT 10TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 19TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS), 2018, : 1354 - 1357
  • [43] Low Complexity Classification System for Glove-Based Arabic Sign Language Recognition
    Assaleh, Khaled
    Shanableh, Tamer
    Zourob, Mohammed
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2012, PT III, 2012, 7665 : 262 - 268
  • [44] AI-Based Sensory Glove System to Recognize Bengali Sign Language (BaSL)
    Begum, Halima
    Chowdhury, Oishik
    Hridoy, Md. Shakib Rahman
    Islam, Muhammed Mazharul
    [J]. IEEE Access, 2024, 12 : 145003 - 145017
  • [45] A deep learning based approach for Arabic Sign language alphabet recognition using electromyographic signals
    Ben Hej Amor, Amina
    El Ghoul, Oussema
    Jemni, Mohamed
    [J]. 2021 8TH INTERNATIONAL CONFERENCE ON ICT & ACCESSIBILITY (ICTA), 2021,
  • [46] Building an Application for Learning the Finger Alphabet of Swiss German Sign Language through Use of the Kinect
    Phuoc Loc Nguyen
    Falk, Vivienne
    Ebling, Sarah
    [J]. COMPUTERS HELPING PEOPLE WITH SPECIAL NEEDS, ICCHP 2014, PT II, 2014, 8548 : 404 - 407
  • [47] Enhancing Arabic Alphabet Sign Language Recognition with VGG16 Deep Learning Investigation
    Elshaer, A. M.
    Ambioh, Yousef
    Soliman, Ziad
    Ahmed, Omar
    Elnakib, Miral
    Safwat, Mohamed
    Elsayed, Salma M.
    Khalid, Mahmoud
    [J]. 2024 14TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, ICEENG 2024, 2024, : 184 - 186
  • [48] The Serbian Sign Language Alphabet: A Unique Authentic Dataset of Letter Sign Gestures
    Radakovic, Mladen
    Marjanovic, Marina
    Ristic, Ivana
    Kuleto, Valentin
    Ilic, Milena P.
    Dabic-Miletic, Svetlana
    [J]. MATHEMATICS, 2024, 12 (04)
  • [49] Indian sign language alphabet recognition system using CNN with diffGrad optimizer and stochastic pooling
    Nandi, Utpal
    Ghorai, Anudyuti
    Singh, Moirangthem Marjit
    Changdar, Chiranjit
    Bhakta, Shubhankar
    Pal, Rajat Kumar
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (07) : 9627 - 9648
  • [50] Recognition system for alphabet Arabic sign language using neutrosophic and fuzzy c-means
    Elatawy, Safaa M.
    Hawa, Doaa M.
    Ewees, A.
    Saad, Abeer M.
    [J]. EDUCATION AND INFORMATION TECHNOLOGIES, 2020, 25 (06) : 5601 - 5616