A computer vision-based system for recognition and classification of Urdu sign language dataset

被引:2
|
作者
Zahid, Hira [1 ,2 ]
Rashid, Munaf [2 ,3 ]
Syed, Sidra Abid [4 ]
Ullah, Rafi [5 ]
Asif, Muhammad [2 ]
Khan, Muzammil [4 ]
Mujeeb, Amenah Abdul [1 ]
Khan, Ali Haider [1 ]
机构
[1] Ziauddin Univ, Biomed Engn Dept, Karachi, Pakistan
[2] Ziauddin Univ, Elect Engn Dept, Karachi, Pakistan
[3] Ziauddin Univ, Software Engn Dept, Karachi, Pakistan
[4] Sir Syed Univ Engn & Technol, Biomed Engn Dept, Karachi, Pakistan
[5] Optimizia, Karachi, Pakistan
关键词
Urdu sign language; Sign language; Pattern recognition; SVM; KNN; Random Forest; Bag of words;
D O I
10.7717/peerj-cs.1174
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human beings rely heavily on social communication as one of the major aspects of communication. Language is the most effective means of verbal and nonverbal communication and association. To bridge the communication gap between deaf people communities, and non-deaf people, sign language is widely used. According to the World Federation of the Deaf, there are about 70 million deaf people present around the globe and about 300 sign languages being used. Hence, the structural form of the hand gestures involving visual motions and signs is used as a communication system to help the deaf and speech-impaired community for daily interaction. The aim is to collect a dataset of Urdu sign language (USL) and test it through a machine learning classifier. The overview of the proposed system is divided into four main stages i.e., data collection, data acquisition, training model ad testing model. The USL dataset which is comprised of 1,560 images was created by photographing various hand positions using a camera. This work provides a strategy for automated identification of USL numbers based on a bag-of-words (BoW) paradigm. For classification purposes, support vector machine (SVM), Random Forest, and K-nearest neighbor (K-NN) are used with the BoW histogram bin frequencies as characteristics. The proposed technique outperforms others in number classification, attaining the accuracies of 88%, 90%, and 84% for the random forest, SVM, and K-NN respectively.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] A computer vision-based system for recognition and classification of Urdu sign language dataset
    Zahid H.
    Rashid M.
    Syed S.A.
    Ullah R.
    Asif M.
    Khan M.
    Mujeeb A.A.
    Khan A.H.
    [J]. PeerJ Computer Science, 2022, 8
  • [2] A Computer Vision-Based System for Recognition and Classification of Urdu Sign Language Dataset for Differently Abled People Using Artificial Intelligence
    Zahid, Hira
    Syed, Sidra Abid
    Rashid, Munaf
    Hussain, Samreen
    Umer, Asif
    Waheed, Abdul
    Nasim, Shahzad
    Zareei, Mahdi
    Mansoor, Nafees
    [J]. Mobile Information Systems, 2023, 2023
  • [3] Vision-Based Portuguese Sign Language Recognition System
    Trigueiros, Paulo
    Ribeiro, Fernando
    Reis, Luis Paulo
    [J]. NEW PERSPECTIVES IN INFORMATION SYSTEMS AND TECHNOLOGIES, VOL 1, 2014, 275 : 605 - 617
  • [4] Vision-based sign language recognition system: A Comprehensive Review
    Sharma, Sakshi
    Singh, Sukhwinder
    [J]. PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON INVENTIVE COMPUTATION TECHNOLOGIES (ICICT-2020), 2020, : 140 - 144
  • [5] Real-Time Computer Vision-Based Bengali Sign Language Recognition
    Rahaman, Muhammad Aminur
    Jasim, Mahmood
    Ali, Md Haider
    Hasanuzzaman, Md
    [J]. 2014 17TH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY (ICCIT), 2014, : 192 - 197
  • [6] Understanding vision-based continuous sign language recognition
    Neena Aloysius
    M. Geetha
    [J]. Multimedia Tools and Applications, 2020, 79 : 22177 - 22209
  • [7] Understanding vision-based continuous sign language recognition
    Aloysius, Neena
    Geetha, M.
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (31-32) : 22177 - 22209
  • [8] Vision-Based Sign Language Classification: A Directional Review
    Joudaki, Saba
    bin Mohamad, Dzulkifli
    Saba, Tanzila
    Rehman, Amjad
    Al-Rodhaan, Mznah
    Al-Dhelaan, Abdullah
    [J]. IETE TECHNICAL REVIEW, 2014, 31 (05) : 383 - 391
  • [9] Computer vision-based hybrid efficient convolution for isolated dynamic sign language recognition
    Chowdhury, Prothoma Khan
    Oyshe, Kabiratun Ummi
    Rahaman, Muhammad Aminur
    Debnath, Tanoy
    Rahman, Anichur
    Kumar, Neeraj
    [J]. Neural Computing and Applications, 2024, 36 (32) : 19951 - 19966
  • [10] Dataset Transformation System for Sign Language Recognition Based on Image Classification Network
    Choi, Sang-Geun
    Park, Yeonji
    Sohn, Chae-Bong
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (19):