Hand Anatomy and Neural Network-Based Recognition for Sign Language

被引:0
|
作者
Tyagi, Akansha [1 ]
Bansal, Sandhya [1 ]
机构
[1] Maharishi Markandeshwar Deemed Univ, Dept Comp Sci & Engn, Ambala 133207, Haryana, India
关键词
FAST; Hand anatomy; Human-computer interaction; Neural network; SIFT; Sign language;
D O I
10.1080/03772063.2023.2171911
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper presents a model based on hand anatomy and neural network for the recognition of sign language. Feature extraction is done by using FAST and SIFT techniques. Out of these extracted features, only essential hand landmarks are selected using hand anatomy. NN is then used for the training and testing of the model. The proposed model is evaluated on sign language gestures used for medical purposes, general purposes, and family & relative purposes. The results prove that the proposed model has achieved fast and highly accurate results when compared with other available models. The model has achieved a recognizable accuracy of 99.85%, 97.55%, and 98.85%, on medical purposes, general purposes, and family & relative purposes, respectively.
引用
收藏
页码:1572 / 1584
页数:13
相关论文
共 50 条
  • [1] Sign to Speech Convolutional Neural Network-Based Filipino Sign Language Hand Gesture Recognition System
    Jarabese, Mark Benedict D.
    Marzan, Charlie S.
    Boado, Jenelyn Q.
    Lopez, Rushaine Rica Mae F.
    Ofiana, Lady Grace B.
    Pilarca, Kenneth John P.
    [J]. 2021 INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE AND INTELLIGENT CONTROLS (ISCSIC 2021), 2021, : 147 - 153
  • [2] Convolutional Neural Network Based American Sign Language Static Hand Gesture Recognition
    Ahuja, Ravinder
    Jain, Daksh
    Sachdeva, Deepanshu
    Garg, Archit
    Rajput, Chirag
    [J]. INTERNATIONAL JOURNAL OF AMBIENT COMPUTING AND INTELLIGENCE, 2019, 10 (03) : 60 - 73
  • [3] Convolutional Neural Network Hand Gesture Recognition for American Sign Language
    Chavan, Shruti
    Yu, Xinrui
    Saniie, Jafar
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ELECTRO INFORMATION TECHNOLOGY (EIT), 2021, : 188 - 192
  • [4] Spatial-temporal attention with graph and general neural network-based sign language recognition
    Miah, Abu Saleh Musa
    Hasan, Md. Al Mehedi
    Okuyama, Yuichi
    Tomioka, Yoichi
    Shin, Jungpil
    [J]. PATTERN ANALYSIS AND APPLICATIONS, 2024, 27 (02)
  • [5] Vision-based Hand Gesture Recognition for Indian Sign Language Using Convolution Neural Network
    Gangrade, Jayesh
    Bharti, Jyoti
    [J]. IETE JOURNAL OF RESEARCH, 2023, 69 (02) : 723 - 732
  • [6] Isolated sign language recognition using Convolutional Neural Network hand modelling and Hand Energy Image
    Lim, Kian Ming
    Tan, Alan Wee Chiat
    Lee, Chin Poo
    Tan, Shing Chiang
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (14) : 19917 - 19944
  • [7] Hand Gesture Recognition for Bangla Sign Language Using Deep Convolution Neural Network
    Tasmere, Dardina
    Ahmed, Boshir
    [J]. 2020 2ND INTERNATIONAL CONFERENCE ON SUSTAINABLE TECHNOLOGIES FOR INDUSTRY 4.0 (STI), 2020,
  • [8] Isolated sign language recognition using Convolutional Neural Network hand modelling and Hand Energy Image
    Kian Ming Lim
    Alan Wee Chiat Tan
    Chin Poo Lee
    Shing Chiang Tan
    [J]. Multimedia Tools and Applications, 2019, 78 : 19917 - 19944
  • [9] Artificial Neural Network Based Method for Indian Sign Language Recognition
    Adithya, V
    Vinod, P. R.
    Gopalakrishnan, Usha
    [J]. 2013 IEEE CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES (ICT 2013), 2013, : 1080 - 1085
  • [10] Korean Sign Language Recognition Based on Image and Convolution Neural Network
    Shin, Hyojoo
    Kim, Woo Je
    Jang, Kyoung-ae
    [J]. ICIGP 2019: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON IMAGE AND GRAPHICS PROCESSING / 2019 5TH INTERNATIONAL CONFERENCE ON VIRTUAL REALITY, 2019, : 52 - 55