Arm Gesture Recognition using a Convolutional Neural Network

被引:0
|
作者
Mathe, Eirini [1 ]
Mitsou, Alexandros [3 ]
Spyrou, Evaggelos [1 ,2 ,3 ]
Mylonas, Phivos [4 ]
机构
[1] Natl Ctr Sci Res Demokritos, Inst Informat & Telecommun, Athens, Greece
[2] Technol Educ Inst Sterea Ellada, Dept Comp Engn, Lamia, Greece
[3] Univ Thessaly, Dept Comp Sci, Lamia, Greece
[4] Dept Informat, Corfu, Greece
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we present an approach towards arm gesture recognition that uses a Convolutional Neural Network (CNN), which is trained on Discrete Fourier Transform (DFT) images that result from raw sensor readings. More specifically, we use the Kinect RGB and depth camera and we capture the 3D positions of a set of skeletal joints. From each joint we create a signal for each 3D coordinate and we concatenate those signals to create an image, the DFT of which is used to describe the gesture. We evaluate our approach using a dataset of hand gestures involving either one or both hands simultaneously and compare the proposed approach to another that uses hand-crafted features.
引用
收藏
页码:37 / 42
页数:6
相关论文
共 50 条
  • [1] Gesture Recognition and Localization Using Convolutional Neural Network
    Wang, Fei
    Kong, Li
    Zhang, Xing
    Chen, Hu
    [J]. PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 5984 - 5989
  • [2] Hand Gesture Recognition Using Convolutional Neural Network
    Ahlawat, Savita
    Batra, Vaibhav
    Banerjee, Snehashish
    Saha, Joydeep
    Garg, Aman K.
    [J]. INTERNATIONAL CONFERENCE ON INNOVATIVE COMPUTING AND COMMUNICATIONS, VOL 2, 2019, 56 : 179 - 186
  • [3] Social Touch Gesture Recognition Using Convolutional Neural Network
    Albawi, Saad
    Bayat, Oguz
    Al-Azawi, Saad
    Ucan, Osman N.
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2018, 2018
  • [4] Recognition of Hand Gesture Image Using Deep Convolutional Neural Network
    Sagayam, K. Martin
    Andrushia, A. Diana
    Ghosh, Ahona
    Deperlioglu, Omer
    Elngar, Ahmed A.
    [J]. INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2022, 22 (03)
  • [5] HAND GESTURE RECOGNITION USING MEDIA PIPE AND CONVOLUTIONAL NEURAL NETWORK
    Adepu, Anjaiah
    Gade, Lakshmi Manaswini
    Bavikadi, Sindhuja
    Madide, Hemanth
    [J]. INTERNATIONAL JOURNAL OF EARLY CHILDHOOD SPECIAL EDUCATION, 2022, 14 (05) : 1341 - 1351
  • [6] Visual Static Hand Gesture Recognition Using Convolutional Neural Network
    Eid, Ahmed
    Schwenker, Friedhelm
    [J]. ALGORITHMS, 2023, 16 (08)
  • [7] CONVOLUTIONAL NEURAL NETWORK ARCHITECTURE FOR HAND GESTURE RECOGNITION
    Pinzon Arenas, Javier Orlando
    Useche Murillo, Paula Catalina
    Jimenez Moreno, Robinson
    [J]. PROCEEDINGS OF THE 2017 IEEE XXIV INTERNATIONAL CONFERENCE ON ELECTRONICS, ELECTRICAL ENGINEERING AND COMPUTING (INTERCON), 2017,
  • [8] Gesture Recognition based on Deep Convolutional Neural Network
    Jayanthi, P.
    Bhama, Ponsy R. K. Sathia
    [J]. 2018 10TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (ICOAC), 2018, : 367 - 372
  • [9] Integration of Convolutional Neural Network and Vision Transformer for gesture recognition using sEMG
    Liu, Xiaoguang
    Hu, Lijian
    Tie, Liang
    Jun, Li
    Wang, Xiaodong
    Liu, Xiuling
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 98
  • [10] Hand Gesture Recognition Using an Adapted Convolutional Neural Network with Data Augmentation
    Alani, Ali A.
    Cosma, Georgina
    Taherkhani, Aboozar
    McGinnity, T. M.
    [J]. 2018 4TH INTERNATIONAL CONFERENCE ON INFORMATION MANAGEMENT (ICIM2018), 2018, : 5 - 12