HMM-based gesture recognition for eye-swipe typing

被引:2
|
作者
Mifsud, Matthew [1 ]
Camilleri, Tracey A. [2 ]
Camilleri, Kenneth P. [1 ,2 ]
机构
[1] Univ Malta, Ctr Biomed Cybernet, MSD-2080 Msida, Malta
[2] Univ Malta, Dept Syst & Control Engn, MSD-2080 Msida, Malta
关键词
Eye typing; Virtual keyboard; Hidden Markov models; Electrooculography;
D O I
10.1016/j.bspc.2023.105161
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Eye-swipe typing requires users to simply look in the vicinity of the keys forming the desired word, similar to swiping their finger on a touch screen device. This work presents a novel HMM-based approach for swipe typing which can be used with any eye movement recording technique. In this study, three different HMMbased methods are developed, tested, and compared to the state-of-the-art performing LCSMapping algorithm with eye movement data acquired from the electrooculogram (EOG). When tested by ten subjects, the top performing Key-based HMM yielded an average top-five rate of 91.00 +/- 6.63% in comparison to an average top-five rate of 76.00 +/- 12.61% achieved by the LCSMapping algorithm. This study also presents the analysis of a real-time eye controlled swipe typing application which yielded an average typing speed of 12.85 +/- 2.14 WPM in contrast to an average typing speed of 3.83 +/- 1.24 WPM achieved using a dwell-based alternative.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Kernel PCA for HMM-Based Cursive Handwriting Recognition
    Fischer, Andreas
    Bunke, Horst
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS, PROCEEDINGS, 2009, 5702 : 181 - 188
  • [22] Modified Viterbi Scoring for HMM-Based Speech Recognition
    Jo, Jihyuck
    Kim, Han-Gyu
    Park, In-Cheol
    Jung, Bang Chul
    Yoo, Hoyoung
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2019, 25 (02): : 351 - 358
  • [23] A HMM based operational gesture recognition method
    Ma, GY
    Lin, XY
    IMAGE MATCHING AND ANALYSIS, 2001, 4552 : 207 - 212
  • [24] Normalized training for HMM-based visual speech recognition
    Nankaku, Y
    Tokuda, K
    Kitamura, T
    Kobayashi, T
    2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL III, PROCEEDINGS, 2000, : 234 - 237
  • [25] Simplified scoring methods for HMM-based speech recognition
    Paramonov, Pavel
    Sutula, Nadezhda
    SOFT COMPUTING, 2016, 20 (09) : 3455 - 3460
  • [26] An HMM-based method for Thai spelling speech recognition
    Pisarn, C.
    Theeramunkong, T.
    COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2007, 54 (01) : 76 - 95
  • [27] An embedded HMM-based approach for face detection and recognition
    Nefian, AV
    Hayes, MH
    ICASSP '99: 1999 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, PROCEEDINGS VOLS I-VI, 1999, : 3553 - 3556
  • [28] HMM-Based Speech Recognition Using Adaptive Framing
    Goh, Yeh-Huann
    Raveendran, Paramesran
    TENCON 2009 - 2009 IEEE REGION 10 CONFERENCE, VOLS 1-4, 2009, : 226 - 230
  • [29] Simplified scoring methods for HMM-based speech recognition
    Pavel Paramonov
    Nadezhda Sutula
    Soft Computing, 2016, 20 : 3455 - 3460
  • [30] Human Activity Recognition with an HMM-Based Generative Model
    Manouchehri, Narges
    Bouguila, Nizar
    SENSORS, 2023, 23 (03)