Romanian Sign Language and Mime-Gesture Recognition

被引:0
|
作者
Andrei, Enachi [1 ,2 ]
Cornel, Turcu [1 ]
Culea, George [2 ]
Constantin, Sghera Bogdan [1 ,2 ]
Gabriel, Ungureanu Andrei [1 ,2 ]
机构
[1] Stefan Cel Mare Univ Suceava, Fac Elect Engn & Comp Sci, Suceava, Romania
[2] Vasile Alecsandri Univ Bacau, Dept Energet & Comp Sci, Bacau, Romania
关键词
RSL; sign language; machine learning; model; mime gestures;
D O I
10.14569/IJACSA.2024.0150888
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
paper presents a comprehensive approach to Romanian Sign Language (RSL) recognition using machine learning techniques. The primary focus is on developing and evaluating a robust model capable of accurately classifying hand and mime gestures representative of RSL and converting it into speech through an application. Utilizing a dataset of hand landmarks captured and stored in CSV format, the study outlines the preprocessing steps, model training, and performance evaluation. Key components of the methodology include data preparation, model training, performance evaluation and model optimization. The results demonstrate the feasibility of using machine learning for RSL recognition, achieving promising accuracy rates. The study concludes with a discussion on potential applications and future enhancements, including real-time gesture recognition and expanding the dataset for improved generalization. This work contributes to the broader effort of making sign language more accessible through technology, particularly for the Romanian-speaking deaf and hard-of-hearing community.
引用
收藏
页码:895 / 902
页数:8
相关论文
共 50 条
  • [1] Sign Language Translator and Gesture Recognition
    Elmahgiubi, Mohammed
    Ennajar, Mohamed
    Drawil, Nabil
    Elbuni, Mohamed Samir
    2015 GLOBAL SUMMIT ON COMPUTER & INFORMATION TECHNOLOGY (GSCIT), 2015,
  • [2] Malay Sign Language Gesture Recognition System
    Swee, Tan Tian
    Salleh, Sh-Hussain
    Ariff, A. K.
    Ting, Chee-Ming
    Seng, Siew Kean
    Huat, Leong Seng
    ICIAS 2007: INTERNATIONAL CONFERENCE ON INTELLIGENT & ADVANCED SYSTEMS, VOLS 1-3, PROCEEDINGS, 2007, : 982 - 985
  • [3] Sign Language Gesture Recognition Using HMM
    Parcheta, Zuzanna
    Martinez-Hinarejos, Carlos-D.
    PATTERN RECOGNITION AND IMAGE ANALYSIS (IBPRIA 2017), 2017, 10255 : 419 - 426
  • [4] Gesture recognition for Indonesian Sign Language (BISINDO)
    Handhika, T.
    Zen, R. I. M.
    Murni
    Lestari, D. P.
    Sari, I.
    2ND INTERNATIONAL CONFERENCE ON STATISTICS, MATHEMATICS, TEACHING, AND RESEARCH 2017, 2018, 1028
  • [5] A Survey of Hand Gesture Recognition Methods in Sign Language Recognition
    Suharjito
    Ariesta, Meita Chandra
    Wiryana, Fanny
    Kusuma, Gede Putra
    PERTANIKA JOURNAL OF SCIENCE AND TECHNOLOGY, 2018, 26 (04): : 1659 - 1675
  • [6] Sign Language Gesture Recognition through Computer Vision
    Nyaga, Casam Njagi
    Wario, Ruth Diko
    2018 IST-AFRICA WEEK CONFERENCE (IST-AFRICA), 2018,
  • [7] A Framework for Hand Gesture Recognition with Applications to Sign Language
    Bhuyan, M. K.
    Ghoah, D.
    Bora, P. K.
    2006 ANNUAL IEEE INDIA CONFERENCE, 2006, : 383 - +
  • [8] A review of hand gesture and sign language recognition techniques
    Cheok, Ming Jin
    Omar, Zaid
    Jaward, Mohamed Hisham
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (01) : 131 - 153
  • [9] Gesture and Sign Language Recognition with Temporal Residual Networks
    Pigou, Lionel
    Van Herreweghe, Mieke
    Dambre, Joni
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 3086 - 3093
  • [10] Gesture Recognition Using Kinect for Sign Language Translation
    Verma, Harsh Vardhan
    Aggarwal, Eshan
    Chandra, Satish
    2013 IEEE SECOND INTERNATIONAL CONFERENCE ON IMAGE INFORMATION PROCESSING (ICIIP), 2013, : 96 - 100