Sign Language Recognition System Based on Weighted Hidden Markov Model

被引:7
|
作者
Yang, Wenwen [1 ]
Tao, Jinxu [1 ]
Xi, Changfeng [1 ]
Ye, Zhongfu [1 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei, Anhui, Peoples R China
关键词
sign language recognition; hidden markov model; weighted hidden markov model; kinect;
D O I
10.1109/ISCID.2015.254
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sign language recognition (SLR) plays an important role in communication between deaf and hearing society. However, the recognition result is still worse for signer independent recognition. The reason is that there exists large variation between the signs from different subjects. In this paper, weighted hidden markov model (HMM) is proposed to deal with the variation. Unlike traditional HMM, WHMM assigns each sign samples with different weights. For the sign sample with big variation, the sample weight is big accordingly. Furthermore, we utilize Kinect to produce robust sign features to improve recognition rate. Our system is evaluated on one Chinese sign language dataset of 156 isolated sign words. Experimental result shows our proposed method outperforms other methods with a high recognition rate of 94.74%.
引用
收藏
页码:449 / 452
页数:4
相关论文
共 50 条
  • [1] Continuous Hidden Markov Model Based Dynamic Persian Sign Language Recognition
    Azar, Saeideh Ghanbari
    Seyedarabi, Hadi
    [J]. 2016 24TH IRANIAN CONFERENCE ON ELECTRICAL ENGINEERING (ICEE), 2016, : 1107 - 1112
  • [2] Continuous gesture recognition system for Korean Sign Language based on fuzzy logic and Hidden Markov Model
    Kim, JB
    Park, KH
    Bang, WC
    Bien, ZZ
    [J]. PROCEEDINGS OF THE 2002 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOL 1 & 2, 2002, : 1574 - 1579
  • [3] Continuous sign language recognition using level building based on fast hidden Markov model
    Yang, Wenwen
    Tao, Jinxu
    Ye, Zhongfu
    [J]. PATTERN RECOGNITION LETTERS, 2016, 78 : 28 - 35
  • [4] Trajectory-based recognition of dynamic Persian sign language using hidden Markov model
    Azar, Saeideh Ghanbari
    Seyedarabi, Hadi
    [J]. COMPUTER SPEECH AND LANGUAGE, 2020, 61
  • [5] Hidden Markov models for Greek sign language recognition
    Pashaloudi, Vassilia N.
    Margaritis, Konstantinos G.
    [J]. Advances in Communications and Software Technologies, 2002, : 265 - 270
  • [6] An Efficient Sign Language Recognition (SLR) System Using Camshift Tracker and Hidden Markov Model (HMM)
    Roy P.P.
    Kumar P.
    Kim B.-G.
    [J]. SN Computer Science, 2021, 2 (2)
  • [7] Multimodal Fusion Based on LSTM and a Couple Conditional Hidden Markov Model for Chinese Sign Language Recognition
    Xiao, Qinkun
    Qin, Minying
    Guo, Peng
    Zhao, Yidan
    [J]. IEEE ACCESS, 2019, 7 : 112258 - 112268
  • [8] The Comparison of Some Hidden Markov Models for Sign Language Recognition
    Suharjito
    Gunawan, Herman
    Thiracitta, Narada
    Witjaksono, Gunawan
    [J]. 2018 INDONESIAN ASSOCIATION FOR PATTERN RECOGNITION INTERNATIONAL CONFERENCE (INAPR), 2018, : 6 - 10
  • [9] Isolated sign language recognition using hidden Markov models
    Grobel, K
    Assan, M
    [J]. SMC '97 CONFERENCE PROCEEDINGS - 1997 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5: CONFERENCE THEME: COMPUTATIONAL CYBERNETICS AND SIMULATION, 1997, : 162 - 167
  • [10] Investigation of Feature Elements and Performance Improvement for Sign Language Recognition by Hidden Markov Model
    Ozawa, Tatsunori
    Shibata, Hirotoshi
    Nishimura, Hiromitsu
    Tanaka, Hiroshi
    [J]. UNIVERSAL ACCESS IN HUMAN-COMPUTER INTERACTION: DESIGNING NOVEL INTERACTIONS, PT II, 2017, 10278 : 76 - 88