Depth vision guided hand gesture recognition using electromyographic signals

被引:53
|
作者
Su, Hang [1 ]
Ovur, Salih Ertug [1 ]
Zhou, Xuanyi [1 ,2 ]
Qi, Wen [1 ]
Ferrigno, Giancarlo [1 ]
De Momi, Elena [1 ]
机构
[1] Politecn Milan, DEIB, Piazza Leonardo da Vinci 32, I-20133 Milan, MI, Italy
[2] Cent South Univ, State Key Lab High Performance Complicated, Changsha, Peoples R China
基金
欧盟地平线“2020”;
关键词
Depth vision; hand gesture recognition; clustering; classification; electromyographic signals; K-MEANS; REDUNDANT ROBOT; LEAP MOTION; TIME;
D O I
10.1080/01691864.2020.1713886
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Hand gesture recognition has been applied to many research fields and has shown its prominent advantages in increasing the practicality of Human-Robot Interaction (HRI). The development of advanced techniques in data science, such as big data and machine learning, facilitate the accurate classification of the hand gestures using electromyography (EMG) signals. However, the processing of the collection and label of the large data set imposes a high work burden and results in time-consuming implementations. Therefore, a novel method is proposed to combine the benefits of depth vision learning and EMG based hand gesture recognition. It is capable of labeling the class of the collected EMG data under the guidance of depth vision automatically, without consideration of the hand motion sequence. Finally, we demonstrated the proposed method for recognizing the ten hand gestures using a Myo armband. The experiment is set in a supervised learning way to evaluate the performance of the designed Hk-means algorithm. It shows that the proposed method can succeed in hand gesture recognition without labeling the data in advance.
引用
收藏
页码:985 / 997
页数:13
相关论文
共 50 条
  • [1] A machine vision and electromyographic-based approach for hand gesture recognition
    Curro, Emilia
    Bombaci, Lorenzo
    Quattrocchi, Antonino
    De Marchis, Cristiano
    Milone, Dario
    Gugliandolo, Giovanni
    Donato, Nicola
    2024 IEEE INTERNATIONAL SYMPOSIUM ON MEDICAL MEASUREMENTS AND APPLICATIONS, MEMEA 2024, 2024,
  • [2] Hand gesture recognition using depth data
    Liu, X
    Fujimura, K
    SIXTH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, PROCEEDINGS, 2004, : 529 - 534
  • [3] A novel muscle-computer interface for hand gesture recognition using depth vision
    Xuanyi Zhou
    Wen Qi
    Salih Ertug Ovur
    Longbin Zhang
    Yingbai Hu
    Hang Su
    Giancarlo Ferrigno
    Elena De Momi
    Journal of Ambient Intelligence and Humanized Computing, 2020, 11 : 5569 - 5580
  • [4] A novel muscle-computer interface for hand gesture recognition using depth vision
    Zhou, Xuanyi
    Qi, Wen
    Ovur, Salih Ertug
    Zhang, Longbin
    Hu, Yingbai
    Su, Hang
    Ferrigno, Giancarlo
    De Momi, Elena
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2020, 11 (11) : 5569 - 5580
  • [5] FFCSLT: A Deep Learning Model for Traffic Police Hand Gesture Recognition Using Surface Electromyographic Signals
    Ma, Wenxuan
    Song, Ge
    Zeng, Qingtian
    Zhang, Hongxin
    Zou, Minghao
    Zhao, Ziqi
    IEEE SENSORS JOURNAL, 2024, 24 (08) : 13640 - 13655
  • [6] Classification of electromyographic hand gesture signals using machine learning techniques
    Jia, Guangyu
    Lam, Hak-Keung
    Liao, Junkai
    Wang, Rong
    NEUROCOMPUTING, 2020, 401 : 236 - 248
  • [7] Robust hand gesture recognition using depth image
    Jiang, Min
    Jiang, Ke
    Kong, Jun
    Li, Pingping
    Sun, Yining
    Journal of Computational Information Systems, 2015, 11 (03): : 1093 - 1100
  • [8] The Hand Gesture Recognition System Using Depth Camera
    Ahn, Yang-Keun
    Park, Young-Choong
    ACHI 2017: THE TENTH INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTER-HUMAN INTERACTIONS, 2017, : 234 - 238
  • [9] Multiclass classifiers for hand-gesture recognition of electromyographic signals from WyoFlex Band
    Villela, Ulises
    Gross, Alessandra
    Gasparin, Francesca
    Salgado, Ivan
    Ballestero, Mariana
    2024 IEEE 37TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS, CBMS 2024, 2024, : 134 - 139
  • [10] Vision based hand gesture recognition
    Punjab Engineering College, CSE Deptt., Sector 12, Chandigarh, 160012, India
    不详
    World Acad. Sci. Eng. Technol., 2009, (1024-1029):