Toward an End-to-End Voice to Sign Recognition for Dialect Moroccan Language

被引：1
|
作者：
Allak, Anass [1 ]
Benelallam, Imade [1 ,2 ]
Habbouza, Hamdi [1 ]
Amallah, Mohamed [1 ]
机构：
[1] Inst Natl Stat & Econ Appl, SI2M Lab, BP 6217, Rabat, Morocco
[2] AIOX LABS, 5 Rue Bouiblane, Rabat, Morocco
来源：
ADVANCED TECHNOLOGIES FOR HUMANITY | 2022年 / 110卷
关键词：
Moroccan sign language; Pose estimation; Mediapipe; Visual generation;
D O I：
10.1007/978-3-030-94188-8_24
中图分类号：
T [工业技术];
学科分类号：
08 ;
摘要：
Automatic Voice to sign recognition language is a challenging task. Building a system able to generate sign language from voice has the potential to help deaf people. However, most of the research on this topic neglects to include less used sign languages like Moroccan sign language (MSL). In this work, we present a holistic approach for building an automated voice to sign system that can be applied to Moroccan Dialect (Darija) based on pose estimation. The system was created using a consolidated dataset, namely Dvoice and newly created Moroccan sign language dataset.
引用
收藏
页码：253 / 262
页数：10
相关论文
共 50 条
  • [1] Toward an End-to-End Voice to Sign Recognition for Dialect Moroccan Language
    Allak, Anass
    Benelallam, Imade
    Habbouza, Hamdi
    Amallah, Mohamed
    [J]. Lecture Notes on Data Engineering and Communications Technologies, 2022, 110 : 253 - 262
  • [2] MyoSign: Enabling End-to-End Sign Language Recognition with Wearables
    Zhang, Qian
    Wang, Dong
    Zhao, Run
    Yu, Yinggang
    [J]. PROCEEDINGS OF IUI 2019, 2019, : 650 - 660
  • [3] Spatial–temporal transformer for end-to-end sign language recognition
    Zhenchao Cui
    Wenbo Zhang
    Zhaoxin Li
    Zhaoqi Wang
    [J]. Complex & Intelligent Systems, 2023, 9 : 4645 - 4656
  • [4] Hear Sign Language: A Real-Time End-to-End Sign Language Recognition System
    Wang, Zhibo
    Zhao, Tengda
    Ma, Jinxin
    Chen, Hongkai
    Liu, Kaixin
    Shao, Huajie
    Wang, Qian
    Ren, Ju
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (07) : 2398 - 2410
  • [5] SubUNets: End-to-end Hand Shape and Continuous Sign Language Recognition
    Camgoz, Necati Cihan
    Hadfield, Simon
    Koller, Oscar
    Bowden, Richard
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 3075 - 3084
  • [6] Spatial-temporal transformer for end-to-end sign language recognition
    Cui, Zhenchao
    Zhang, Wenbo
    Li, Zhaoxin
    Wang, Zhaoqi
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (04) : 4645 - 4656
  • [7] Demo: The Sound of Silence: End-to-End Sign Language Recognition Using SmartWatch
    Dai, Qian
    Hou, Jiahui
    Yang, Panlong
    Li, Xiangyang
    Wang, Fei
    Zhang, Xumiao
    [J]. PROCEEDINGS OF THE 23RD ANNUAL INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND NETWORKING (MOBICOM '17), 2017, : 462 - 464
  • [8] MULTITASK TRAINING WITH UNLABELED DATA FOR END-TO-END SIGN LANGUAGE FINGERSPELLING RECOGNITION
    Shi, Bowen
    Livescu, Karen
    [J]. 2017 IEEE AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING WORKSHOP (ASRU), 2017, : 389 - 396
  • [9] Dialect-Aware Modeling for End-to-End Japanese Dialect Speech Recognition
    Imaizumi, Ryo
    Masumura, Ryo
    Shiota, Sayaka
    Kiya, Hitoshi
    [J]. 2020 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2020, : 297 - 301
  • [10] SimulSLT: End-to-End Simultaneous Sign Language Translation
    Yin, Aoxiong
    Zhao, Zhou
    Liu, Jinglin
    Jin, Weike
    Zhang, Meng
    Zeng, Xingshan
    He, Xiaofei
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 4118 - 4127
12345