HMM-based gesture recognition for eye-swipe typing

被引:2
|
作者
Mifsud, Matthew [1 ]
Camilleri, Tracey A. [2 ]
Camilleri, Kenneth P. [1 ,2 ]
机构
[1] Univ Malta, Ctr Biomed Cybernet, MSD-2080 Msida, Malta
[2] Univ Malta, Dept Syst & Control Engn, MSD-2080 Msida, Malta
关键词
Eye typing; Virtual keyboard; Hidden Markov models; Electrooculography;
D O I
10.1016/j.bspc.2023.105161
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Eye-swipe typing requires users to simply look in the vicinity of the keys forming the desired word, similar to swiping their finger on a touch screen device. This work presents a novel HMM-based approach for swipe typing which can be used with any eye movement recording technique. In this study, three different HMMbased methods are developed, tested, and compared to the state-of-the-art performing LCSMapping algorithm with eye movement data acquired from the electrooculogram (EOG). When tested by ten subjects, the top performing Key-based HMM yielded an average top-five rate of 91.00 +/- 6.63% in comparison to an average top-five rate of 76.00 +/- 12.61% achieved by the LCSMapping algorithm. This study also presents the analysis of a real-time eye controlled swipe typing application which yielded an average typing speed of 12.85 +/- 2.14 WPM in contrast to an average typing speed of 3.83 +/- 1.24 WPM achieved using a dwell-based alternative.
引用
下载
收藏
页数:8
相关论文
共 50 条
  • [1] An HMM-based approach for gesture segmentation and recognition
    Deng, JW
    Tsui, HT
    15TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 3, PROCEEDINGS: IMAGE, SPEECH AND SIGNAL PROCESSING, 2000, : 679 - 682
  • [2] HMM-based threshold model approach for gesture recognition
    Microsoft Korea, Seoul, Korea, Republic of
    IEEE Trans Pattern Anal Mach Intell, 10 (961-973):
  • [3] An HMM-based threshold model approach for gesture recognition
    Lee, HK
    Kim, JH
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1999, 21 (10) : 961 - 973
  • [4] An HMM-based Gesture Recognition Method Trained on Few Samples
    Godoy, Vinicius
    Britto, Alceu S., Jr.
    Koerich, Alessandro
    Facon, Jacques
    Oliveira, Luiz E. S.
    2014 IEEE 26TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2014, : 640 - 646
  • [5] Eye-Swipe Typing Using Integration of Dwell-Time and Dwell-Free Method
    Cheat, Morokot
    Wongsaisuwan, Manop
    2018 15TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY (ECTI-CON), 2018, : 209 - 212
  • [6] A HMM-Based System for Real-Time Gesture Recognition in Movie Sequences
    Wilkowski, Artur
    2008 CONFERENCE ON HUMAN SYSTEM INTERACTIONS, VOLS 1 AND 2, 2008, : 743 - 748
  • [7] A HMM-based Fundamental Motion Synthesis Approach for Gesture Recognition on a Nintendo Triaxial Accelerometer
    Chen, Wei-Cheng
    Lyu, Ren-Yuan
    5TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATION SYSTEMS, ICSPCS'2011, 2011,
  • [8] An HMM-based speech recognition IC
    Han, W
    Hon, KW
    Chan, CF
    Lee, T
    Choy, CS
    Pun, KP
    Ching, PC
    PROCEEDINGS OF THE 2003 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL II: COMMUNICATIONS-MULTIMEDIA SYSTEMS & APPLICATIONS, 2003, : 744 - 747
  • [9] HMM-Based System for Recognizing Gestures in Image Sequences and Its Application in Continuous Gesture Recognition
    Wilkowski, A.
    HUMAN-COMPUTER SYSTEMS INTERACTION: BACKGROUNDS AND APPLICATIONS, 2009, 60 : 135 - 146
  • [10] An HMM-Based Recognition Framework for Endovascular Manipulations
    Zhou, Xiao-Hu
    Bian, Gui-Bin
    Xie, Xiao-Liang
    Hou, Zeng-Guang
    2017 39TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2017, : 3393 - 3396