GyGSLA: A Portable Glove System for Learning Sign Language Alphabet

被引:3
|
作者
Sousa, Luis [1 ]
Rodrigues, Joao M. F. [1 ]
Monterio, Janio [2 ]
Cardoso, Pedro J. S. [1 ]
Lam, Roberto [1 ]
机构
[1] Univ Algarve, LARSyS & ISE, P-8005 Faro, Portugal
[2] Univ Algarve, INEC ID Lisbon & ISE, P-8005 Faro, Portugal
关键词
HCI; Gesture recognition; Sign Language; Assistive technologies;
D O I
10.1007/978-3-319-40238-3_16
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The communication between people with normal hearing with those having hearing or speech impairment is difficult. Learning a new alphabet is not always easy, especially when it is a sign language alphabet, which requires both hand skills and practice. This paper presents the GyGSLA system, standing as a completely portable setup created to help inexperienced people in the process of learning a new sign language alphabet. To achieve it, a computer/mobile game-interface and an hardware device, a wearable glove, were developed. When interacting with the computer or mobile device, using the wearable glove, the user is asked to represent alphabet letters and digits, by replicating the hand and fingers positions shown in a screen. The glove then sends the hand and fingers positions to the computer/mobile device using a wireless interface, which interprets the letter or digit that is being done by the user, and gives it a corresponding score. The system was tested with three completely inexperience sign language subjects, achieving a 76% average recognition ratio for the Portuguese sign language alphabet.
引用
收藏
页码:159 / 170
页数:12
相关论文
共 50 条
  • [1] An Instrumented Glove for Recognition of Brazilian Sign Language Alphabet
    Dias, Thiago Simoes
    Alves Mendes Junior, Jose Jair
    Pichorim, Sergio Francisco
    [J]. IEEE SENSORS JOURNAL, 2022, 22 (03) : 2518 - 2529
  • [2] Detection of the Turkish Sign Language Alphabet with Strain Sensor Based Data Glove
    Kaya, Fatih
    Tuncer, Ahmet Furkan
    Yildiz, Solen Kumbay
    [J]. 2018 26TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2018,
  • [3] Alphabet Classification of Indian Sign Language with Deep Learning
    Dangarwala, Kruti J.
    Hiran, Dilendra
    [J]. INNOVATIVE DATA COMMUNICATION TECHNOLOGIES AND APPLICATION, 2020, 46 : 569 - 576
  • [4] Visual learning curves for American sign language (ASL) alphabet
    Rojas-Murillo, Salvador
    Pancho, Alyssa B.
    Cariaso, Michael J.
    Speicher, Alexander
    Mato, Alejandro
    Segal, Oren
    [J]. INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS, 2021, 81
  • [5] Alphabet Sign Language Image Classification Using Deep Learning
    Daroya, Rangel
    Peralta, Daryl
    Naval, Prospero, Jr.
    [J]. PROCEEDINGS OF TENCON 2018 - 2018 IEEE REGION 10 CONFERENCE, 2018, : 0646 - 0650
  • [6] Deep Learning Technology to Recognize American Sign Language Alphabet
    Alsharif, Bader
    Altaher, Ali Salem
    Altaher, Ahmed
    Ilyas, Mohammad
    Alalwany, Easa
    [J]. SENSORS, 2023, 23 (18)
  • [7] Machine-Learning-Assisted Soft Fiber Optic Glove System for Sign Language Recognition
    Zhu, Renjie
    Fan, Dongliang
    Lin, Jiang
    Feng, Huijuan
    Wang, Hongqiang
    Dai, Jian S.
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (02) : 1540 - 1547
  • [8] American Sign Language Alphabet Recognition Using Inertial Motion Capture System with Deep Learning
    Gu, Yutong
    Sherrine, Sherrine
    Wei, Weiyi
    Li, Xinya
    Yuan, Jianan
    Todoh, Masahiro
    [J]. INVENTIONS, 2022, 7 (04)
  • [9] A simple sign language recognition system based on data glove
    Wu, JQ
    Gao, W
    Song, YB
    Liu, W
    Pang, B
    [J]. ICSP '98: 1998 FOURTH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, PROCEEDINGS, VOLS I AND II, 1998, : 1257 - 1260
  • [10] Implementation of wearable glove for sign language expression based on deep learning
    Hyeon-Jun Kim
    Soo-Whang Baek
    [J]. Microsystem Technologies, 2023, 29 : 1147 - 1163