Real Time Hand Gesture Recognition Using Different Algorithms Based on American Sign Language

被引:0
|
作者
Islam, Md. Mohiminul [1 ]
Siddiqua, Sarah [1 ]
Afnan, Jawata [1 ]
机构
[1] Shahjalal Univ Sci & Technol, Dept Elect & Elect Engn, Sylhet 3114, Bangladesh
关键词
American sign language; hand gesture recognition; fingertip finder algorithm; k curvature; convex hull; pixel segmentation; eccentricity; elongatedness; artificial neural network;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human Computer Interaction (HCI) is a broad research field based on human interaction with computers or machines. Basically, Hand Gesture Recognition (HGR) is a subfield of HCI. Today, many researchers are working on different HGR applications like game controlling, robot control, smart home system, medical services etc. The purpose of this paper is to represent a real time HGR system based on American Sign Language (ASL) recognition with greater accuracy. This system acquires gesture images of ASL with black background from mobile video camera for feature extraction. In the processing phase, the system extracts five features such as fingertip finder, eccentricity, elongatedness, pixel segmentation and rotation. For feature extraction, a new algorithm is proposed which basically combines K curvature and convex hull algorithms. It can be called "K convex hull" method which can detect fingertip with high accuracy. In our system, Artificial Neural Network (ANN) is used with feed forward, back propagation algorithm for training a network using 30 feature vectors to recognize 37 signs of American alphabets and numbers properly which is helpful for HCI system. The total gesture recognition rate of this system is 94.32% in real time environment.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Real Time Hand Gesture Recognition by Skin Color Detection for American Sign Language
    Khan, Shomi
    Ali, M. Elieas
    Das, Sree Sourav
    Rahman, Md Mohsinur
    [J]. 2019 4TH INTERNATIONAL CONFERENCE ON ELECTRICAL INFORMATION AND COMMUNICATION TECHNOLOGY (EICT), 2019,
  • [2] Hand Gesture Detection based Real-time American Sign Language Letters Recognition using Support Vector Machine
    Jiang, Xinyun
    Ahmad, Wasim
    [J]. IEEE 17TH INT CONF ON DEPENDABLE, AUTONOM AND SECURE COMP / IEEE 17TH INT CONF ON PERVAS INTELLIGENCE AND COMP / IEEE 5TH INT CONF ON CLOUD AND BIG DATA COMP / IEEE 4TH CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2019, : 380 - 385
  • [3] Contour-Based Real-Time Hand Gesture Recognition for Indian Sign Language
    Itkarkar, Rajeshri R.
    Nandi, Anilkumar
    Mane, Bhagyashri
    [J]. COMPUTATIONAL INTELLIGENCE IN DATA MINING, CIDM 2016, 2017, 556 : 683 - 691
  • [4] Sign Language Recognition Using Image Based Hand Gesture Recognition Techniques
    Nikam, Ashish S.
    Ambekar, Aarti G.
    [J]. PROCEEDINGS OF 2016 ONLINE INTERNATIONAL CONFERENCE ON GREEN ENGINEERING AND TECHNOLOGIES (IC-GET), 2016,
  • [5] Static hand gesture recognition for American sign language using neuromorphic hardware
    Mohammadi, Mohammadreza
    Chandarana, Peyton
    Seekings, James
    Hendrix, Sara
    Zand, Ramtin
    [J]. NEUROMORPHIC COMPUTING AND ENGINEERING, 2022, 2 (04):
  • [6] Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language
    Hartanto, Rudy
    Susanto, Adhi
    Santosa, Paulus Insap
    [J]. 2014 6TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND ELECTRICAL ENGINEERING (ICITEE), 2014, : 120 - 125
  • [7] Vision Based Hand Gesture Recognition Using Dynamic Time Warping for Indian Sign Language
    Ahmed, Washef
    Chanda, Kunal
    Mitra, Soma
    [J]. PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE (ICIS), 2016, : 120 - 125
  • [8] Convolutional Neural Network Based American Sign Language Static Hand Gesture Recognition
    Ahuja, Ravinder
    Jain, Daksh
    Sachdeva, Deepanshu
    Garg, Archit
    Rajput, Chirag
    [J]. INTERNATIONAL JOURNAL OF AMBIENT COMPUTING AND INTELLIGENCE, 2019, 10 (03) : 60 - 73
  • [9] Convolutional Neural Network Hand Gesture Recognition for American Sign Language
    Chavan, Shruti
    Yu, Xinrui
    Saniie, Jafar
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ELECTRO INFORMATION TECHNOLOGY (EIT), 2021, : 188 - 192
  • [10] STUDY OF VISION BASED HAND GESTURE RECOGNITION USING INDIAN SIGN LANGUAGE
    Ghotkar, Archana S.
    Kharate, Gajanan K.
    [J]. INTERNATIONAL JOURNAL ON SMART SENSING AND INTELLIGENT SYSTEMS, 2014, 7 (01) : 96 - 115