Hand Gesture Recognition Based on Various Deep Learning YOLO Models

被引:1
|
作者
Mesbahi, Soukaina Chraa [1 ]
Mahraz, Mohamed Adnane [1 ]
Riffi, Jamal [1 ]
Tairi, Hamid [1 ]
机构
[1] Sidi Mohamed Ben Abdellah Univ, Fac Sci Dhar El Mahraz, Dept Comp Sci, Lab Comp Sci Signals Automat & Cognitivism LISAC, Fes, Morocco
关键词
Neural network; deep learning; YOLO; object detection; hand gesture; SIGN-LANGUAGE; LOCALIZATION; NETWORK;
D O I
10.14569/IJACSA.2023.0140435
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Some varieties of sign languages are used by deaf or hard-of-hearing people worldwide to interact with others more effectively, consequently sign language's automatic translation is expressive and important. Significant improvements in computer vision have been made recently, notably in tasks based on object detection using deep learning. By locating things in visual photos or videos, the genuine cutting-edge one-step object detection approach greatly provides exceptional detection accuracy. With the help of messaging or video calling, this study suggests a technique to get beyond these obstacles and enhance communication for such persons, regardless of their disability. To recognize motions and classes, we provide an enhanced model based on Yolo (You Look Only Once) V3, V4, V4-tiny, and V5. The dataset is clustered using the suggested algorithm, requiring only manual annotation of a reduced number of classes and analysis for patterns that aid in target prediction. The suggested method outperforms the current object detection approaches based on the YOLO model, according to experimental results.
引用
收藏
页码:307 / 319
页数:13
相关论文
共 50 条
  • [1] Small Deep Learning Models For Hand Gesture Recognition
    Mohammed, Adam Ahmed Qaid
    Lv, Jiancheng
    Islam, M. D. Sajjatul
    2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 1429 - 1435
  • [2] Research on the Hand Gesture Recognition Based on Deep Learning
    Sun, Jing-Hao
    Ji, Ting-Ting
    Zhang, Shu-Bin
    Yang, Jia-Kui
    Ji, Guang-Rong
    2018 12TH INTERNATIONAL SYMPOSIUM ON ANTENNAS, PROPAGATION AND ELECTROMAGNETIC THEORY (ISAPE), 2018,
  • [3] Hand gesture recognition based on CNN and YOLO techniques
    Helal, Maha
    Shishah, Wesam
    Zakariah, Mohammed
    Kashmeery, Tariq
    DECISION SCIENCE LETTERS, 2024, 13 (04) : 977 - 990
  • [4] Deep learning based hand gesture recognition in complex scenes
    Ni, Zihan
    Sang, Nong
    Tan, Cheng
    MIPPR 2017: PATTERN RECOGNITION AND COMPUTER VISION, 2017, 10609
  • [5] Deep Learning with Attention on Hand Gesture Recognition Based on sEMG
    Zhao, Huanjun
    Zheng, Bin
    Wang, Le
    2022 PROGNOSTICS AND HEALTH MANAGEMENT CONFERENCE, PHM-LONDON 2022, 2022, : 316 - 320
  • [6] EMG based Hand Gesture Recognition using Deep Learning
    Ozdemir, Mehmet Akif
    Kisa, Deniz Hande
    Guren, Onan
    Onan, Aytug
    Akan, Aydin
    2020 MEDICAL TECHNOLOGIES CONGRESS (TIPTEKNO), 2020,
  • [7] Hand Gesture Recognition Using Deep Learning
    Hussain, Soeb
    Saxena, Rupal
    Han, Xie
    Khan, Jameel Ahmed
    Shin, Hyunchul
    PROCEEDINGS INTERNATIONAL SOC DESIGN CONFERENCE 2017 (ISOCC 2017), 2017, : 48 - 49
  • [8] Deep learning in vision-based static hand gesture recognition
    Oyedotun, Oyebade K.
    Khashman, Adnan
    NEURAL COMPUTING & APPLICATIONS, 2017, 28 (12): : 3941 - 3951
  • [9] Deep Learning Based Hand Gesture Recognition and UAV Flight Controls
    Bin Hu
    Jiacun Wang
    International Journal of Automation and Computing, 2020, 17 (01) : 17 - 29
  • [10] Deep learning in vision-based static hand gesture recognition
    Oyebade K. Oyedotun
    Adnan Khashman
    Neural Computing and Applications, 2017, 28 : 3941 - 3951