Multi-level Taxonomy Review for Sign Language Recognition: Emphasis on Indian Sign Language

被引:5
|
作者
Bahia, Nimratveer Kaur [1 ]
Rani, Rajneesh [1 ]
机构
[1] Natl Inst Technol, Jalandhar, India
关键词
Indian sign language (ISL); sign language recognition (SLR); vision-based; feature extraction; support vector machine (SVM); region of interest (ROI); FACIAL EXPRESSION RECOGNITION; HAND GESTURE RECOGNITION; FEATURE-EXTRACTION; WORD RECOGNITION; SENSORY GLOVE; NETWORKS; SYSTEMS; SPEECH;
D O I
10.1145/3530259
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the phenomenal increase in image and video databases, there is an increase in the human-computer interaction that recognizes Sign Language. Exchanging information using different gestures between two people is sign language, known as non-verbal communication. Sign language recognition is already done in various languages; however, for Indian Sign Language, there is no adequate amount of work done. This article presents a review on sign language recognition for multiple languages. Data acquisition methods have been over-viewed in four ways (a) Glove-based, (b) Kinect-based, (c) Leap motion controller, and (d) Vision-based. Some of them have pros and cons that have also been discussed for every data acquisition method. Applications of sign language recognition are also discussed. Furthermore, this review also creates a coherent taxonomy to represent the modern research divided into three levels: Level 1 Elementary level (Recognition of sign characters), Level 2 Advanced level (Recognition of sign words), and Level 3 Professional level (Sentence interpretation). The available challenges and issues for each level are also explored in this research to provide valuable perceptions into technological environments. Various publicly available datasets for different sign languages are also discussed. An efficient review of this article shows that the significant exploration of communication via sign acknowledgment has been performed on static, dynamic, isolated, and continuous gestures using various acquisition methods. Comprehensively, the hope is that this study will enable readers to learn new pathways and gain knowledge to carry out further research work in the domain related to sign language recognition.
引用
收藏
页数:39
相关论文
共 50 条
  • [31] GPU Implementation for Arabic Sign Language Real Time Recognition Using Multi-Level Multiplicative Neural Networks
    Elons, A. S.
    2014 9TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING & SYSTEMS (ICCES), 2014, : 360 - 367
  • [32] Weighted Multi-modal Sign Language Recognition
    Liu, Edmond
    Lim, Jong Yoon
    MacDonald, Bruce
    Ahn, Ho Seok
    2024 33RD IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, ROMAN 2024, 2024, : 880 - 885
  • [33] MULTI-MODALITY AMERICAN SIGN LANGUAGE RECOGNITION
    Zhang, Chenyang
    Tian, Yingli
    Huenetfauth, Matt
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 2881 - 2885
  • [34] Static and Dynamic Hand Gesture Recognition for Indian Sign Language
    Susitha, A.
    Geetha, N.
    Suhirtha, R.
    Swetha, A.
    MACHINE LEARNING AND BIG DATA ANALYTICS (PROCEEDINGS OF INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND BIG DATA ANALYTICS (ICMLBDA) 2021), 2022, 256 : 48 - 66
  • [35] Arabic sign language recognition
    Mohandes, M
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON IMAGING SCIENCE, SYSTEMS AND TECHNOLOGY, VOLS I AND II, 2001, : 753 - 759
  • [36] Sign Language Recognition System
    Pankajakshan, Priyanka C.
    Thilagavathi, B.
    2015 INTERNATIONAL CONFERENCE ON INNOVATIONS IN INFORMATION, EMBEDDED AND COMMUNICATION SYSTEMS (ICIIECS), 2015,
  • [37] Combinational sign language recognition
    Gao, Liqing
    Feng, Wei
    Lyu, Fan
    Wan, Liang
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 241
  • [38] Indian Sign Language Recognition Using Machine Learning Techniques
    Sahoo, Ashok Kumar
    MACROMOLECULAR SYMPOSIA, 2021, 397 (01)
  • [39] Continuous Indian Sign Language Gesture Recognition and Sentence Formation
    Tripathi, Kumud
    Baranwal, Neha
    Nandi, G. C.
    ELEVENTH INTERNATIONAL CONFERENCE ON COMMUNICATION NETWORKS, ICCN 2015/INDIA ELEVENTH INTERNATIONAL CONFERENCE ON DATA MINING AND WAREHOUSING, ICDMW 2015/NDIA ELEVENTH INTERNATIONAL CONFERENCE ON IMAGE AND SIGNAL PROCESSING, ICISP 2015, 2015, 54 : 523 - 531
  • [40] Recognition of Isolated Indian Sign Language Gesture in Real Time
    Nandy, Anup
    Prasad, Jay Shankar
    Mondal, Soumik
    Chakraborty, Pavan
    Nandi, G. C.
    INFORMATION PROCESSING AND MANAGEMENT, 2010, 70 : 102 - 107