A New Data Glove Approach for Malaysian Sign Language Detection

被引:69
|
作者
Shukor, Ahmad Zaki [1 ]
Miskon, Muhammad Fahmi [1 ]
Jamaluddin, Muhammad Herman [1 ]
Ibrahim, Fariz Bin Ali [1 ]
Asyraf, Mohd Fareed [1 ]
Bin Bahar, Mohd Bazli [1 ]
机构
[1] UTeM, FKE, CeRIA, RIA, Durian Tunggal, Malaysia
关键词
Malaysian sign language; data glove; gesture recognition; Bluetooth communication; TILT SENSORS;
D O I
10.1016/j.procs.2015.12.276
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
A normal human being sees, listens, and reacts to his/her surroundings. There are some individuals who do not have this important blessing. Such individuals, mainly deaf and dumb, depend on communication via sign language to interact with others. However, communication with ordinary individuals is a major concern for them since not everyone can comprehend their sign language. Furthermore, this will cause a problem for the deaf and dumb communities to interact with others, particularly when they attempt to involve with educational, social and work environments. In this research, the objectives are to develop a sign language translation system in order to assist the hearing or speech impaired people to communicate with normal people, and also to test the accuracy of the system in interpreting the sign language. As a first step, the best method in gesture recognition was chosen after reviewing previous researches. The configuration of the data glove includes 10 tilt sensors to capture the finger flexion, an accelerometer for recognizing the motion of the hand, a microcontroller and Bluetooth module to send the interpreted information to a mobile phone. Firstly the performance of the tilt sensor was tested. Then after assembling all connections, the accuracy of the data glove in translating some selected alphabets, numbers and words from Malaysian Sign Language is performed. The result for the first experiment shows that tilt sensor need to be tilted more than 85 degree to successfully change the digital state. For the accuracy of 4 individuals who tested this device, total average accuracy for translating alphabets is 95%, numbers is 93.33% and gestures is 78.33%. The average accuracy of data glove for translating all type of gestures is 89%. This fusion of tilt sensors and accelerometer could be improved in the future by adding more training and test data as well as underlying frameworks such as Hidden Markov Model. (C) 2015 Published by Elsevier B.V.
引用
收藏
页码:60 / 67
页数:8
相关论文
共 50 条
  • [1] Detection of the Turkish Sign Language Alphabet with Strain Sensor Based Data Glove
    Kaya, Fatih
    Tuncer, Ahmet Furkan
    Yildiz, Solen Kumbay
    [J]. 2018 26TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2018,
  • [2] A New Approach for Designing a Smart Glove for Arabic Sign Language Recognition System Based on the Statistical Analysis of the Sign Language
    Sadek, Mina I.
    Mikhael, Michael N.
    Mansour, Hala A.
    [J]. 2017 34TH NATIONAL RADIO SCIENCE CONFERENCE (NRSC), 2017, : 380 - 388
  • [3] A simple sign language recognition system based on data glove
    Wu, JQ
    Gao, W
    Song, YB
    Liu, W
    Pang, B
    [J]. ICSP '98: 1998 FOURTH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, PROCEEDINGS, VOLS I AND II, 1998, : 1257 - 1260
  • [4] Recognition of sign language with an inertial sensor-based data glove
    Kim, Kyung-Won
    Lee, Mi-So
    Soon, Bo-Ram
    Ryu, Mun-Ho
    Kim, Je-Nam
    [J]. TECHNOLOGY AND HEALTH CARE, 2016, 24 : S223 - S230
  • [5] Smart glove does sign language
    不详
    [J]. PHYSICS WORLD, 2017, 30 (08) : 5 - 5
  • [6] Smart Glove for Sign Language Communications
    Das, Abhinandan
    Yadav, Lavish
    Singhal, Mayank
    Sachan, Raman
    Goyal, Hemang
    Taparia, Keshav
    Gulati, Raghav
    Singh, Ankit
    Trivedi, Gaurav
    [J]. 2016 INTERNATIONAL CONFERENCE ON ACCESSIBILITY TO DIGITAL WORLD (ICADW), 2016, : 27 - 31
  • [7] Intelligent glove for sign language communication
    Navaitthiporn, Nitipon
    Rithcharung, Preeyarat
    Hattapath, Phitnaree
    Pintavirooj, C.
    [J]. 2019 12TH BIOMEDICAL ENGINEERING INTERNATIONAL CONFERENCE (BMEICON 2019), 2019,
  • [8] Assistive Glove for Pakistani Sign Language Translation Pakistani Sign Language Translator
    Kanwal, Kehkashan
    Abdullah, Saad
    Ahmed, Yusra Binte
    Saher, Yusra
    Jafri, Ali Raza
    [J]. 17TH IEEE INTERNATIONAL MULTI TOPIC CONFERENCE 2014, 2014, : 173 - 176
  • [9] Data glove-based sign language translation with convolutional neural networks
    Castillo Cervera, Marco
    Lopez Meza, Diego
    Huamanchahua, Deyby
    [J]. 2022 INTERNATIONAL CONFERENCE ON MECHANICAL, AUTOMATION AND ELECTRICAL ENGINEERING, CMAEE, 2022, : 67 - 74
  • [10] Recognition of Malaysian Sign Language Using Skeleton Data with Neural Network
    Sutarman
    Zain, Jasni Binti Mohamad
    Majid, Mazlina Binti Abdul
    Hermawan, Arief
    [J]. 2015 INTERNATIONAL CONFERENCE ON SCIENCE IN INFORMATION TECHNOLOGY (ICSITECH), 2015, : 231 - 236