HMM-based gesture recognition for eye-swipe typing

被引:2
|
作者
Mifsud, Matthew [1 ]
Camilleri, Tracey A. [2 ]
Camilleri, Kenneth P. [1 ,2 ]
机构
[1] Univ Malta, Ctr Biomed Cybernet, MSD-2080 Msida, Malta
[2] Univ Malta, Dept Syst & Control Engn, MSD-2080 Msida, Malta
关键词
Eye typing; Virtual keyboard; Hidden Markov models; Electrooculography;
D O I
10.1016/j.bspc.2023.105161
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Eye-swipe typing requires users to simply look in the vicinity of the keys forming the desired word, similar to swiping their finger on a touch screen device. This work presents a novel HMM-based approach for swipe typing which can be used with any eye movement recording technique. In this study, three different HMMbased methods are developed, tested, and compared to the state-of-the-art performing LCSMapping algorithm with eye movement data acquired from the electrooculogram (EOG). When tested by ten subjects, the top performing Key-based HMM yielded an average top-five rate of 91.00 +/- 6.63% in comparison to an average top-five rate of 76.00 +/- 12.61% achieved by the LCSMapping algorithm. This study also presents the analysis of a real-time eye controlled swipe typing application which yielded an average typing speed of 12.85 +/- 2.14 WPM in contrast to an average typing speed of 3.83 +/- 1.24 WPM achieved using a dwell-based alternative.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] An HMM-based approach for gesture segmentation and recognition
    Deng, JW
    Tsui, HT
    [J]. 15TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 3, PROCEEDINGS: IMAGE, SPEECH AND SIGNAL PROCESSING, 2000, : 679 - 682
  • [2] HMM-based threshold model approach for gesture recognition
    Microsoft Korea, Seoul, Korea, Republic of
    [J]. IEEE Trans Pattern Anal Mach Intell, 10 (961-973):
  • [3] An HMM-based threshold model approach for gesture recognition
    Lee, HK
    Kim, JH
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1999, 21 (10) : 961 - 973
  • [4] An HMM-based Gesture Recognition Method Trained on Few Samples
    Godoy, Vinicius
    Britto, Alceu S., Jr.
    Koerich, Alessandro
    Facon, Jacques
    Oliveira, Luiz E. S.
    [J]. 2014 IEEE 26TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2014, : 640 - 646
  • [5] Eye-Swipe Typing Using Integration of Dwell-Time and Dwell-Free Method
    Cheat, Morokot
    Wongsaisuwan, Manop
    [J]. 2018 15TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY (ECTI-CON), 2018, : 209 - 212
  • [6] A HMM-Based System for Real-Time Gesture Recognition in Movie Sequences
    Wilkowski, Artur
    [J]. 2008 CONFERENCE ON HUMAN SYSTEM INTERACTIONS, VOLS 1 AND 2, 2008, : 743 - 748
  • [7] A HMM-based Fundamental Motion Synthesis Approach for Gesture Recognition on a Nintendo Triaxial Accelerometer
    Chen, Wei-Cheng
    Lyu, Ren-Yuan
    [J]. 5TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATION SYSTEMS, ICSPCS'2011, 2011,
  • [8] An HMM-based speech recognition IC
    Han, W
    Hon, KW
    Chan, CF
    Lee, T
    Choy, CS
    Pun, KP
    Ching, PC
    [J]. PROCEEDINGS OF THE 2003 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL II: COMMUNICATIONS-MULTIMEDIA SYSTEMS & APPLICATIONS, 2003, : 744 - 747
  • [9] HMM-Based System for Recognizing Gestures in Image Sequences and Its Application in Continuous Gesture Recognition
    Wilkowski, A.
    [J]. HUMAN-COMPUTER SYSTEMS INTERACTION: BACKGROUNDS AND APPLICATIONS, 2009, 60 : 135 - 146
  • [10] An HMM-Based Recognition Framework for Endovascular Manipulations
    Zhou, Xiao-Hu
    Bian, Gui-Bin
    Xie, Xiao-Liang
    Hou, Zeng-Guang
    [J]. 2017 39TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2017, : 3393 - 3396