A Survey: The Sensor-Based Method for Sign Language Recognition

被引:0
|
作者
Yang, Tian [1 ,2 ]
Shen, Cong [1 ,2 ]
Wang, Xinyue [1 ,2 ]
Ma, Xiaoyu [1 ,2 ]
Ling, Chen [3 ]
机构
[1] Tianjin Univ Technol, Sch Comp Sci & Engn, Tianjin, Peoples R China
[2] Minist Educ, Engn Res Ctr Learning Based Intelligent Syst, Tianjin, Peoples R China
[3] Intel Mobileye, R&D Ctr China, Shanghai, Peoples R China
关键词
Sign Language Recognition; Sensor; Computer Vision;
D O I
10.1007/978-981-99-8537-1_21
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sign language is a crucial communication carrier among deaf people to express and exchange their thoughts and emotions. However, ordinary individuals cannot acquire proficiency in sign language in the short term, which leads to deaf people facing huge barriers with the sound community. Regarding this conundrum, it is valuable to investigate Sign Language Recognition (SLR) equipped with sensors which collect data for the following computer vision processing. This study has reviewed the sensor-based SLR methods, which can transform heterogeneous signals from various underlying sensors into high-level motion representations. Specifically, we have summarized current developments in sensor-based SLR techniques from the perspective of modalities. Addtionally, we have also distilled the sensor-based SLR paradigm and compared the state-of-the-art works, including computer vision. Following that, we have concluded the research opportunities and future work expectations.
引用
收藏
页码:257 / 268
页数:12
相关论文
共 50 条
  • [1] Wearable Sensor-Based Sign Language Recognition: A Comprehensive Review
    Kudrinko K.
    Flavin E.
    Zhu X.
    Li Q.
    Kudrinko, Karly (karly.kudrinko@queensu.ca), 1600, Institute of Electrical and Electronics Engineers Inc. (14): : 82 - 97
  • [2] Recognition of sign language with an inertial sensor-based data glove
    Kim, Kyung-Won
    Lee, Mi-So
    Soon, Bo-Ram
    Ryu, Mun-Ho
    Kim, Je-Nam
    TECHNOLOGY AND HEALTH CARE, 2016, 24 : S223 - S230
  • [3] A Sensor-Based Hand Gesture Recognition System for Japanese Sign Language
    Chu, Xianzhi
    Liu, Jiang
    Shimamoto, Shigeru
    2021 IEEE 3RD GLOBAL CONFERENCE ON LIFE SCIENCES AND TECHNOLOGIES (IEEE LIFETECH 2021), 2021, : 311 - 312
  • [4] Image-Based and Sensor-Based Approaches to Arabic Sign Language Recognition
    Mohandes, M.
    Deriche, M.
    Liu, J.
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2014, 44 (04) : 551 - 557
  • [5] Efficient Kinect Sensor-based Kurdish Sign Language Recognition Using Echo System Network
    Mirza, Sami F.
    Al-Talabani, Abdulbasit K.
    ARO-THE SCIENTIFIC JOURNAL OF KOYA UNIVERSITY, 2021, 9 (02):
  • [6] Novel Feature Extraction and Classification Technique for Sensor-Based Continuous Arabic Sign Language Recognition
    Tuffaha, Mohammed
    Shanableh, Tamer
    Assaleh, Khaled
    NEURAL INFORMATION PROCESSING, ICONIP 2015, PT IV, 2015, 9492 : 290 - 299
  • [7] Deep learning for sensor-based activity recognition: A survey
    Wang, Jindong
    Chen, Yiqiang
    Hao, Shuji
    Peng, Xiaohui
    Hu, Lisha
    PATTERN RECOGNITION LETTERS, 2019, 119 : 3 - 11
  • [8] A multimodal framework for sensor based sign language recognition
    Kumar, Pradeep
    Gauba, Himaanshu
    Roy, Partha Pratim
    Dogra, Debi Prosad
    NEUROCOMPUTING, 2017, 259 : 21 - 38
  • [9] A survey on unsupervised learning for wearable sensor-based activity recognition
    Ige, Ayokunle Olalekan
    Noor, Mohd Halim Mohd
    APPLIED SOFT COMPUTING, 2022, 127
  • [10] A Survey of Sign Language Recognition Technology Based on Sign Language Expression Content and Expression Characteristics
    Tao T.
    Liu T.
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2023, 45 (10): : 3439 - 3457