Arm Gesture Recognition using a Convolutional Neural Network

被引:0
|
作者
Mathe, Eirini [1 ]
Mitsou, Alexandros [3 ]
Spyrou, Evaggelos [1 ,2 ,3 ]
Mylonas, Phivos [4 ]
机构
[1] Natl Ctr Sci Res Demokritos, Inst Informat & Telecommun, Athens, Greece
[2] Technol Educ Inst Sterea Ellada, Dept Comp Engn, Lamia, Greece
[3] Univ Thessaly, Dept Comp Sci, Lamia, Greece
[4] Dept Informat, Corfu, Greece
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we present an approach towards arm gesture recognition that uses a Convolutional Neural Network (CNN), which is trained on Discrete Fourier Transform (DFT) images that result from raw sensor readings. More specifically, we use the Kinect RGB and depth camera and we capture the 3D positions of a set of skeletal joints. From each joint we create a signal for each 3D coordinate and we concatenate those signals to create an image, the DFT of which is used to describe the gesture. We evaluate our approach using a dataset of hand gestures involving either one or both hands simultaneously and compare the proposed approach to another that uses hand-crafted features.
引用
收藏
页码:37 / 42
页数:6
相关论文
共 50 条
  • [21] Dynamic gesture recognition method based on convolutional neural network
    Xu, Xiaoyu
    Deng, Lizhen
    Meng, Qingmin
    2019 INTERNATIONAL CONFERENCE ON INTERNET OF THINGS (ITHINGS) AND IEEE GREEN COMPUTING AND COMMUNICATIONS (GREENCOM) AND IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING (CPSCOM) AND IEEE SMART DATA (SMARTDATA), 2019, : 389 - 394
  • [22] Gesture recognition based on improved VGGNET convolutional neural network
    Yang Zhiqi
    PROCEEDINGS OF 2020 IEEE 5TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2020), 2020, : 1736 - 1739
  • [23] A Recognition Method of Misjudgment Gesture Based on Convolutional Neural Network
    Sun, Kaiyun
    Feng, Zhiquan
    Ai, Changsheng
    Li, Yingjun
    Wei, Jun
    Yang, Xiaohui
    Guo, Xiaopei
    2017 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION (ICVRV 2017), 2017, : 272 - 273
  • [24] Hand Gesture Recognition using Convolutional Neural Networks
    Lan, Shengchang
    He, Zonglong
    Chen, Weichu
    Chen, Lijia
    2018 USNC-URSI RADIO SCIENCE MEETING (JOINT WITH AP-S SYMPOSIUM), 2018, : 147 - 148
  • [25] Dynamic Hand Gesture Recognition using 2D Convolutional Neural Network
    Liu, Yupeng
    Yang, Mingqiang
    Li, Jie
    Zheng, Qinghe
    Wang, Deqiang
    ENGINEERING LETTERS, 2020, 28 (01) : 243 - 254
  • [26] Electromyographic hand gesture recognition using convolutional neural network with multi-attention
    Zhang, Zhen
    Shen, Quming
    Wang, Yanyu
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 91
  • [27] FPGA-based Implementation of Hand Gesture Recognition Using Convolutional Neural Network
    Zhang, Tongtong
    Zhou, Weiguo
    Jiang, Xin
    Liu, Yunhui
    2018 IEEE INTERNATIONAL CONFERENCE ON CYBORG AND BIONIC SYSTEMS (CBS), 2018, : 133 - 138
  • [28] Convolutional Neural Network for Hand Gesture Recognition using 8 different EMG Signals
    Orlando Pinzon-Arenas, Javier
    Jimenez-Moreno, Robinson
    Esteban Herrera-Benavides, Julian
    2019 XXII SYMPOSIUM ON IMAGE, SIGNAL PROCESSING AND ARTIFICIAL VISION (STSIVA), 2019,
  • [29] Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural Network
    Kim, Youngwook
    Toomajian, Brian
    IEEE ACCESS, 2016, 4 : 7125 - 7130
  • [30] Convolutional neural network with spatial pyramid pooling for hand gesture recognition
    Tan, Yong Soon
    Lim, Kian Ming
    Tee, Connie
    Lee, Chin Poo
    Low, Cheng Yaw
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (10): : 5339 - 5351