Depth vision guided hand gesture recognition using electromyographic signals

被引:53
|
作者
Su, Hang [1 ]
Ovur, Salih Ertug [1 ]
Zhou, Xuanyi [1 ,2 ]
Qi, Wen [1 ]
Ferrigno, Giancarlo [1 ]
De Momi, Elena [1 ]
机构
[1] Politecn Milan, DEIB, Piazza Leonardo da Vinci 32, I-20133 Milan, MI, Italy
[2] Cent South Univ, State Key Lab High Performance Complicated, Changsha, Peoples R China
基金
欧盟地平线“2020”;
关键词
Depth vision; hand gesture recognition; clustering; classification; electromyographic signals; K-MEANS; REDUNDANT ROBOT; LEAP MOTION; TIME;
D O I
10.1080/01691864.2020.1713886
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Hand gesture recognition has been applied to many research fields and has shown its prominent advantages in increasing the practicality of Human-Robot Interaction (HRI). The development of advanced techniques in data science, such as big data and machine learning, facilitate the accurate classification of the hand gestures using electromyography (EMG) signals. However, the processing of the collection and label of the large data set imposes a high work burden and results in time-consuming implementations. Therefore, a novel method is proposed to combine the benefits of depth vision learning and EMG based hand gesture recognition. It is capable of labeling the class of the collected EMG data under the guidance of depth vision automatically, without consideration of the hand motion sequence. Finally, we demonstrated the proposed method for recognizing the ten hand gestures using a Myo armband. The experiment is set in a supervised learning way to evaluate the performance of the designed Hk-means algorithm. It shows that the proposed method can succeed in hand gesture recognition without labeling the data in advance.
引用
收藏
页码:985 / 997
页数:13
相关论文
共 50 条
  • [21] Hand gesture recognition based on depth map
    Sykora, P.
    Kamencay, P.
    Zachariasova, M.
    Hudec, R.
    2014 ELEKTRO, 2014, : 109 - 112
  • [22] Decoding Electromyographic Signal With Multiple Labels for Hand Gesture Recognition
    Zou, Yongxiang
    Cheng, Long
    Han, Lijun
    Li, Zhengwei
    Song, Luping
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 483 - 487
  • [23] Vision based hand gesture recognition: A review
    Simion, G.
    Gui, V.
    Otesteanu, M.
    International Journal of Circuits, Systems and Signal Processing, 2012, 6 (04): : 275 - 282
  • [24] Analysis of Gesture Recognition to Evaluate Hand Signals
    Uma, M.
    Prabhu, S.
    Florence, S. Metilda
    3RD INTERNATIONAL CONFERENCE ON ADVANCES IN MECHANICAL ENGINEERING (ICAME 2020), PTS 1-6, 2020, 912
  • [25] Hand Gesture Recognition Based on Depth Image Using Kinect Sensor
    Truong Quang Vinh
    Nguyen Trong Tri
    PROCEEDINGS OF 2015 2ND NATIONAL FOUNDATION FOR SCIENCE AND TECHNOLOGY DEVELOPMENT CONFERENCE ON INFORMATION AND COMPUTER SCIENCE NICS 2015, 2015, : 34 - 39
  • [26] Electromyographic hand gesture recognition using convolutional neural network with multi-attention
    Zhang, Zhen
    Shen, Quming
    Wang, Yanyu
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 91
  • [27] Dynamic Hand Gesture Recognition Using Computer Vision and Neural Networks
    Munasinghe, M. I. N. P.
    2018 3RD INTERNATIONAL CONFERENCE FOR CONVERGENCE IN TECHNOLOGY (I2CT), 2018,
  • [28] Hand-gesture recognition using computer-vision techniques
    Rios-Soria, David J.
    Schaeffer, Satu E.
    Garza-Villarreal, Sara E.
    WSCG 2013, COMMUNICATION PAPERS PROCEEDINGS, 2013, : 1 - 8
  • [29] The Vision-Based Hand Gesture Recognition Using Blob Analysis
    Ganokratanaa, Thittaporn
    Pumrin, Suree
    2017 INTERNATIONAL CONFERENCE ON DIGITAL ARTS, MEDIA AND TECHNOLOGY (ICDAMT): DIGITAL ECONOMY FOR SUSTAINABLE GROWTH, 2017, : 336 - 341
  • [30] A Review on Vision-based Hand Gesture Recognition Targeting RGB-Depth Sensors
    Rawat, Prashant
    Kane, Lalit
    Goswami, Mrinal
    Jindal, Avani
    Sehgal, Shriya
    INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY & DECISION MAKING, 2023, 22 (01) : 115 - 156