Gesture Recognition Using Hand Region Estimation in Robot Manipulation

被引：0
|
作者：
Togo, Shoichiro [1 ]
Ukida, Hiroyuki [1 ]
机构：
[1] Univ Tokushima, Grad Sch Adv Technol & Sci, Tokushima, Japan
来源：
2021 60TH ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS OF JAPAN (SICE) | 2021年
关键词：
Gesture recognition; Single camera; Robot operation; Neural network; Hand region estimation; 1D Fast Fourier Transform;
D O I：
暂无
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this study, we propose a gesture recognition method for operating an unmanned aerial vehicle (UAV) equipped with only a single camera. This method uses a neural network to estimate the 2D coordinates of a hand region in an image from color information. From the time series data of hand coordinates, we estimate the gesture motion by 1D Fast Fourier Transform. The proposed method identifies seven types of gestures and manipulates the UAV. The accuracy and usefulness of this method are confirmed by experiments of UAV movements in response to gestures.
引用
收藏
页码：1122 / 1127
页数：6
相关论文
共 50 条
  • [1] UAV manipulation by hand gesture recognition
    Togo, Shoichiro
    Ukida, Hiroyuki
    [J]. SICE Journal of Control, Measurement, and System Integration, 2022, 15 (02) : 145 - 161
  • [2] Entertainment Robot Hand Gesture Recognition
    Wang, Yuehai
    Li, Jianfei
    [J]. 2010 2ND INTERNATIONAL WORKSHOP ON DATABASE TECHNOLOGY AND APPLICATIONS PROCEEDINGS (DBTA), 2010,
  • [3] Direct manipulation interface using multiple cameras for hand gesture recognition
    Utsumi, A
    Ohya, J
    [J]. IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA COMPUTING AND SYSTEMS, PROCEEDINGS, 1998, : 264 - 267
  • [4] Region Based Hand Gesture Recognition
    Birdal, Ahmet
    Hassanpour, Reza
    [J]. WSCG 2008, COMMUNICATION PAPERS, 2008, : 1 - 7
  • [5] Hand Region Extraction and Gesture Recognition using entropy analysis
    Shin, Jae-Ho
    Lee, Jong-Shill
    Kil, Se-Kee
    Shen, Dong-Fan
    Ryu, Je-Goon
    Lee, Eung-Hyuk
    Min, Hong-Ki
    Hong, Seung-Hong
    [J]. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2006, 6 (2A): : 216 - 222
  • [6] Hand gesture recognition and voice controlled robot
    Meghana, M.
    Kumari, Ch Usha
    Priya, J. Sthuthi
    Mrinal, P.
    Sai, K. Abhinav Venkat
    Reddy, S. Prashanth
    Vikranth, K.
    Kumar, T. Santosh
    Panigrahy, Asisa Kumar
    [J]. MATERIALS TODAY-PROCEEDINGS, 2020, 33 : 4121 - 4123
  • [7] HAND GESTURE RECOGNITION AND MOTION ESTIMATION USING THE KINECT SENSOR
    Wang, Bin
    Li, Yunze
    Lang, Haoxiang
    Wang, Ying
    [J]. MECHATRONIC SYSTEMS AND CONTROL, 2020, 48 (01): : 17 - 24
  • [8] Human hand descriptions and gesture recognition for object manipulation
    Guzman Cobos, Salvador
    Ferre, Manuel
    Angel Sanchez-Uran, M.
    Ortego, Javier
    Aracil, Rafael
    [J]. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING, 2010, 13 (03) : 305 - 317
  • [9] Static Hand Gesture Recognition for Human Robot Interaction
    Uwineza, Josiane
    Ma, Hongbin
    Li, Baokui
    Jin, Ying
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT II, 2019, 11741 : 417 - 430
  • [10] Hand Gesture Recognition Using Convexity Hull Defects to Control an Industrial Robot
    Ganapathyraju, Srinivas
    [J]. 2013 3RD INTERNATIONAL CONFERENCE ON INSTRUMENTATION CONTROL AND AUTOMATION (ICA 2013), 2013, : 63 - 67
12345