Depth vision guided hand gesture recognition using electromyographic signals

被引:53
|
作者
Su, Hang [1 ]
Ovur, Salih Ertug [1 ]
Zhou, Xuanyi [1 ,2 ]
Qi, Wen [1 ]
Ferrigno, Giancarlo [1 ]
De Momi, Elena [1 ]
机构
[1] Politecn Milan, DEIB, Piazza Leonardo da Vinci 32, I-20133 Milan, MI, Italy
[2] Cent South Univ, State Key Lab High Performance Complicated, Changsha, Peoples R China
基金
欧盟地平线“2020”;
关键词
Depth vision; hand gesture recognition; clustering; classification; electromyographic signals; K-MEANS; REDUNDANT ROBOT; LEAP MOTION; TIME;
D O I
10.1080/01691864.2020.1713886
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Hand gesture recognition has been applied to many research fields and has shown its prominent advantages in increasing the practicality of Human-Robot Interaction (HRI). The development of advanced techniques in data science, such as big data and machine learning, facilitate the accurate classification of the hand gestures using electromyography (EMG) signals. However, the processing of the collection and label of the large data set imposes a high work burden and results in time-consuming implementations. Therefore, a novel method is proposed to combine the benefits of depth vision learning and EMG based hand gesture recognition. It is capable of labeling the class of the collected EMG data under the guidance of depth vision automatically, without consideration of the hand motion sequence. Finally, we demonstrated the proposed method for recognizing the ten hand gestures using a Myo armband. The experiment is set in a supervised learning way to evaluate the performance of the designed Hk-means algorithm. It shows that the proposed method can succeed in hand gesture recognition without labeling the data in advance.
引用
收藏
页码:985 / 997
页数:13
相关论文
共 50 条
  • [31] Dynamic Hand Gesture Recognition Based On Depth Information
    Bai, Xinran
    Li, Chen
    Tian, Lihua
    Song, Hui
    2018 INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND INFORMATION SCIENCES (ICCAIS), 2018, : 216 - 221
  • [32] Dilated residual convolutional network for surface electromyographic hand gesture recognition
    Zhang, Zhen
    Zhao, Bin
    Zhang, Xiangyu
    Zhang, Yuhui
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 103
  • [33] Hand Gesture Recognition From Kinect Depth Images
    Yeloglu, Zeynep
    Akbulut, Yaman
    Budak, Umit
    Sengur, Abdulkadir
    2015 23RD SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2015, : 628 - 631
  • [34] On an algorithm for Vision-based hand gesture recognition
    Ghosh, Dipak Kumar
    Ari, Samit
    SIGNAL IMAGE AND VIDEO PROCESSING, 2016, 10 (04) : 655 - 662
  • [35] On an algorithm for Vision-based hand gesture recognition
    Dipak Kumar Ghosh
    Samit Ari
    Signal, Image and Video Processing, 2016, 10 : 655 - 662
  • [36] Depth-based Hand Gesture Recognition using Convolutional Neural Networks
    Pyo, Jeongwon
    Ji, Sanghoon
    You, Sujeong
    Kuc, Taeyoung
    2016 13TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS AND AMBIENT INTELLIGENCE (URAI), 2016, : 225 - 227
  • [37] Online cross session electromyographic hand gesture recognition using deep learning and transfer learning
    Zhang, Zhen
    Liu, Shilong
    Wang, Yanyu
    Song, Wei
    Zhang, Yuhui
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 127
  • [38] Vision-based hand gesture tracking and recognition
    Huang, T
    ISSCS 2005: International Symposium on Signals, Circuits and Systems, Vols 1 and 2, Proceedings, 2005, : 403 - 403
  • [39] Vision Based Static Hand Gesture Recognition Techniques
    Sharrma, Ananyaa
    Khandelwal, Ayush
    Kaur, Kavleen
    Joshi, Shivani
    Upadhyay, Richa
    Prabhu, Sameer
    2017 INTERNATIONAL CONFERENCE ON COMMUNICATION AND SIGNAL PROCESSING (ICCSP), 2017, : 705 - 709
  • [40] Hand Gesture Recognition Using Color-Depth Association for Smart Home
    Shih, Huang-Chia
    Ma, Chang-Hsian
    2018 FIRST INTERNATIONAL COGNITIVE CITIES CONFERENCE (IC3 2018), 2018, : 195 - 197