EMG-Based Dynamic Hand Gesture Recognition Using Edge AI for Human-Robot Interaction

被引:8
|
作者
Kim, EunSu [1 ]
Shin, JaeWook [1 ]
Kwon, YongSung [2 ]
Park, BumYong [2 ]
机构
[1] Kumoh Natl Inst Technol, Dept Elect Engn, Gumi Si 39177, South Korea
[2] Kumoh Natl Inst Technol, Dept IT Convergence Engn, Gumi Si 39177, South Korea
关键词
convolutional recurrent neural network; edge AI; electromyography; human-robot interaction; robot operating system; robot control; EXPLORATION;
D O I
10.3390/electronics12071541
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, human-robot interaction technology has been considered as a key solution for smart factories. Surface electromyography signals obtained from hand gestures are often used to enable users to control robots through hand gestures. In this paper, we propose a dynamic hand-gesture-based industrial robot control system using the edge AI platform. The proposed system can perform both robot operating-system-based control and edge AI control through an embedded board without requiring an external personal computer. Systems on a mobile edge AI platform must be lightweight, robust, and fast. In the context of a smart factory, classifying a given hand gesture is important for ensuring correct operation. In this study, we collected electromyography signal data from hand gestures and used them to train a convolutional recurrent neural network. The trained classifier model achieved 96% accuracy for 10 gestures in real time. We also verified the universality of the classifier by testing it on 11 different participants.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Efficient Hand Gesture Recognition for Human-Robot Interaction
    Peral, Marc
    Sanfeliu, Alberto
    Garrell, Anais
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) : 10272 - 10279
  • [2] Hand posture recognition in gesture-based human-robot interaction
    Yin, Xiaoming
    Zhu, Xing
    [J]. ICIEA 2006: 1ST IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS, VOLS 1-3, PROCEEDINGS, 2006, : 397 - 402
  • [3] Accelerometer-based Hand Gesture Recognition for Human-Robot Interaction
    Anderez, Dario Ortega
    Dos Santos, Luis Pedro
    Lotfi, Ahmad
    Yahaya, Salisu Wada
    [J]. 2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 1402 - 1406
  • [4] Hand posture recognition in gesture-based human-robot interaction
    Yin, Xiaoming
    Zhu, Xing
    [J]. 2006 1ST IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS, VOLS 1-3, 2006, : 835 - +
  • [5] Dynamic Hand Gesture Recognition Based on 3D Hand Pose Estimation for Human-Robot Interaction
    Gao, Qing
    Chen, Yongquan
    Ju, Zhaojie
    Liang, Yi
    [J]. IEEE SENSORS JOURNAL, 2022, 22 (18) : 17421 - 17430
  • [6] Face tracking and hand gesture recognition for human-robot interaction
    Brèthes, L
    Menezes, P
    Lerasle, F
    Hayet, J
    [J]. 2004 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1- 5, PROCEEDINGS, 2004, : 1901 - 1906
  • [7] Serial-Parallel Dynamic Hand Gesture Recognition Network for Human-Robot Interaction
    Zhao, Yinan
    Zhou, Jian
    Ju, Zhaojie
    Chen, Junkang
    Gao, Qing
    [J]. 2023 29TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE, M2VIP 2023, 2023,
  • [8] EMG-based Pattern Recognition with Kinematics Information for Hand Gesture Recognition
    Ruiz-Olaya, Andres F.
    Callejas-Cuervo, Mauro
    Milena Perez, Ana
    [J]. 2015 20TH SYMPOSIUM ON SIGNAL PROCESSING, IMAGES AND COMPUTER VISION (STSIVA), 2015,
  • [9] Dynamic Hand Gesture Recognition for Human-Robot and Inter-Robot Communication
    Abid, Muhammad R.
    Meszaros, Philippe E.
    Silva, Ricardo F. D.
    Petriu, Emil M.
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND VIRTUAL ENVIRONMENTS FOR MEASUREMENT SYSTEMS AND APPLICATIONS (CIVEMSA), 2014, : 12 - 17
  • [10] A PDA-based human-robot interaction using EMG-based modified Morse code
    Nilas, Phongchai
    [J]. International Conference on Computational Intelligence for Modelling, Control & Automation Jointly with International Conference on Intelligent Agents, Web Technologies & Internet Commerce, Vol 2, Proceedings, 2006, : 1011 - 1016