Dynamic hand gesture recognition based on 3D pattern assembled trajectories

被引:0
|
作者
Boulahia, Said Yacine [1 ]
Anquetil, Eric [1 ]
Multon, Franck [1 ]
Kulpa, Richard [1 ]
机构
[1] IRISA INRIA, Rennes, France
关键词
3D dynamic hand gesture recognition; Leap Motion dataset; Skeleton joint data; Real-time recognition;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Over the past few years, advances in commercial 3D sensors have substantially promoted the research of dynamic hand gesture recognition. On a other side, whole body gestures recognition has also attracted increasing attention since the emergence of Kinect like sensors. One may notice that both research topics deal with human-made motions and are likely to face similar challenges. In this paper, our aim is thus to evaluate the applicability of an action recognition feature-set to model dynamic hand gestures using skeleton data. Furthermore, existing datasets are often composed of pre-segmented gestures that are performed with a single hand only. We collected therefore a more challenging dataset, which contains unsegmented streams of 13 hand gesture classes, performed with either a single hand or two hands. Our approach is first evaluated on an existing dataset, namely DHG dataset, and then using our collected dataset. Better results compared to previous approaches are reported.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Dynamic Hand Gesture Recognition Based on 3D Convolutional Neural Network Models
    Zhang, Wenjin
    Wang, Jiacun
    [J]. PROCEEDINGS OF THE 2019 IEEE 16TH INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL (ICNSC 2019), 2019, : 224 - 229
  • [2] Survey on 3D Hand Gesture Recognition
    Cheng, Hong
    Yang, Lu
    Liu, Zicheng
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2016, 26 (09) : 1659 - 1673
  • [3] Dynamic Hand Gesture Recognition Based on 3D Hand Pose Estimation for Human-Robot Interaction
    Gao, Qing
    Chen, Yongquan
    Ju, Zhaojie
    Liang, Yi
    [J]. IEEE SENSORS JOURNAL, 2022, 22 (18) : 17421 - 17430
  • [4] Heterogeneous hand gesture recognition using 3D dynamic skeletal data
    De Smedt, Quentin
    Wannous, Hazem
    Vandeborre, Jean-Philippe
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 181 : 60 - 72
  • [5] 3D separable convolutional neural network for dynamic hand gesture recognition
    Hu, Zhongxu
    Hu, Youmin
    Liu, Jie
    Wu, Bo
    Han, Dongmin
    Kurfess, Thomas
    [J]. NEUROCOMPUTING, 2018, 318 : 151 - 161
  • [6] A PointNet-Based Solution for 3D Hand Gesture Recognition
    Mirsu, Radu
    Simion, Georgiana
    Caleanu, Catalin Daniel
    Pop-Calimanu, Ioana Monica
    [J]. SENSORS, 2020, 20 (11) : 1 - 13
  • [7] A Real-time Dynamic Gesture Recognition Based on 3D Trajectories in Distinguishing Similar Gestures
    Ding, Zeyu
    Zhang, Zexiong
    Chen, Yanmei
    Chen, Yen-Lun
    Wu, Xinyu
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION, 2015, : 250 - 255
  • [8] A ToF 3D Database for Hand Gesture Recognition
    Simion, Georgiana
    Caleanu, Catalin-Daniel
    [J]. 2012 10TH INTERNATIONAL SYMPOSIUM ON ELECTRONICS AND TELECOMMUNICATIONS, 2012, : 363 - 366
  • [9] Hand Gesture Recognition Using 3D Sensors
    Goga, Jozef
    Kajan, Slavomir
    [J]. PROCEEDINGS OF 2017 INTERNATIONAL SYMPOSIUM ELMAR, 2017, : 181 - 184
  • [10] Appearance Based Dynamic Hand Gesture Recognition Using 3D Separable Convolutional Neural Network
    Rizwan, Muhammad
    Ul Haq, Sana
    Gul, Noor
    Asif, Muhammad
    Shah, Syed Muslim
    Jan, Tariqullah
    Ahmad, Naveed
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (01): : 1213 - 1247