Double handed dynamic Turkish Sign Language recognition using Leap Motion with meta learning approach

被引:2
|
作者
Katilmis, Zekeriya [1 ]
Karakuzu, Cihan [2 ]
机构
[1] Kutahya Hlth Sci Univ, Dept Comp Engn, TR-43020 Kutahya, Turkiye
[2] Bilecik Seyh Edebali Univ, Dept Comp Engn, TR-11210 Bilecik, Turkiye
关键词
Dynamic hand gesture recognition; Sign language; Feature fusion; Leap Motion; Meta-ELM; Constrained-ELMs; GESTURE RECOGNITION; NEURAL-NETWORK; CLASSIFICATION; INTERFACES; FRAMEWORK; MACHINE; DESIGN; SYSTEM; MODEL; ELM;
D O I
10.1016/j.eswa.2023.120453
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sign language is one of the most important communication tools for hearing impaired people. In this study, the recognition of two-handed dynamic words in Turkish Sign Language (TSL) was studied using the LMC device. As a result of the repetition of 26 dynamic words, which were determined by considering the similarities and differences between them, by 6 participants, two data sets were obtained by extracting two types of feature sets. By applying a three-stage strategy to these feature sets, word recognition performances are presented by considering many aspects. These stages are data regularization, feature selection and dimension reduction. By performing these stages, new datasets with less dimension were obtained. The recognition performance was tested with six different ELM networks and the results were compared. Five-fold cross-validation was used to test the validity of the proposed system and accuracy of the obtained results. According to the results obtained with a comprehensive analysis, it has been seen that the Meta-ELM classifier maintains its performance rate and gives the highest performance. At the same time it has been observed that the Meta-ELM classifier has a stable structure that offers less user intervention.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Turkish Sign Language Recognition With Leap Motion
    Demircioglu, Burcak
    Bulbul, Gullu
    Kose, Hatice
    [J]. 2016 24TH SIGNAL PROCESSING AND COMMUNICATION APPLICATION CONFERENCE (SIU), 2016, : 589 - 592
  • [2] American Sign Language Recognition Using Leap Motion Controller with Machine Learning Approach
    Chong, Teak-Wei
    Lee, Boon-Giin
    [J]. SENSORS, 2018, 18 (10)
  • [3] Leap Motion based Myanmar Sign Language Recognition using Machine Learning
    Hein, Zaw
    Htoo, Thet Paing
    Aye, Bawin
    Htet, Sai Myo
    Ye, Kyaw Zaw
    [J]. PROCEEDINGS OF THE 2021 IEEE CONFERENCE OF RUSSIAN YOUNG RESEARCHERS IN ELECTRICAL AND ELECTRONIC ENGINEERING (ELCONRUS), 2021, : 2304 - 2310
  • [4] Sign Language Recognition Using Leap Motion A Support Vector Machine Approach
    Quesada, Luis
    Lopez, Gustavo
    Guerrero, Luis A.
    [J]. UBIQUITOUS COMPUTING AND AMBIENT INTELLIGENCE: SENSING, PROCESSING, AND USING ENVIRONMENTAL INFORMATION, 2015, 9454 : 277 - 288
  • [5] American Sign Language Recognition Using Leap Motion Sensor
    Chuan, Ching-Hua
    Regina, Eric
    Guardino, Caroline
    [J]. 2014 13TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2014, : 541 - 544
  • [6] A Chinese Sign Language Recognition System Using Leap Motion
    Xue, Yaofeng
    Gao, Shang
    Sun, Huali
    Qin, Wei
    [J]. 2017 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION (ICVRV 2017), 2017, : 180 - 185
  • [7] Indonesian Sign Language Recognition Using Leap Motion Controller
    Wibowo, Midarto Dwi
    Nurtanio, Ingrid
    Ilham, Amil Ahmad
    [J]. PROCEEDINGS OF 2017 11TH INTERNATIONAL CONFERENCE ON INFORMATION & COMMUNICATION TECHNOLOGY AND SYSTEMS (ICTS), 2017, : 67 - 71
  • [8] Arabic Sign Language Recognition Using Leap Motion Sensor
    Elons, A. S.
    Ahmed, Menna
    Shedid, Hwaidaa
    Tolba, M. F.
    [J]. 2014 9TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING & SYSTEMS (ICCES), 2014, : 368 - 373
  • [9] Arabic Sign Language Recognition using the Leap Motion Controller
    Mohandes, M.
    Aliyu, S.
    Deriche, M.
    [J]. 2014 IEEE 23RD INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2014, : 960 - 965
  • [10] Recognition of Continuous Sign Language Alphabet Using Leap Motion Controller
    Cohen, Miri Weiss
    Ben Zikri, Nir Nir
    Velkovich, Alexander
    [J]. 2018 11TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTION (HSI), 2018, : 193 - 199