Factored Translation Models for improving a Speech into Sign Language Translation System

被引:0
|
作者
Lopez-Ludena, V. [1 ]
San-Segundo, R. [1 ]
Cordoba, R. [1 ]
Ferreiros, J. [1 ]
Montero, J. M. [1 ]
Pardo, J. M. [1 ]
机构
[1] Univ Politecn Madrid, Grp Tecnol Habla, E-28040 Madrid, Spain
关键词
Factored Translation Models; Speech into Sign Language translation; Phrase-based translation model;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes the use of Factored Translation Models (FTMs) for improving a Speech into Sign Language Translation System. These FTMs allow incorporating syntactic-semantic information during the translation process. This new information permits to reduce significantly the translation error rate. This paper also analyses different alternatives for dealing with the non-relevant words. The speech into sign language translation system has been developed and evaluated in a specific application domain: the renewal of Identity Documents and Driver's License. The translation system uses a phrase-based translation system (Moses). The evaluation results reveal that the BLEU (BiLingual Evaluation Understudy) has improved from 69.1% to 73.9% and the mSER (multiple references Sign Error Rate) has been reduced from 30.6% to 24.8%.
引用
收藏
页码:1616 / 1619
页数:4
相关论文
共 50 条
  • [1] Speech to sign language translation system for Spanish
    San-Segundo, R.
    Barra, R.
    Cordoba, R.
    D'Haro, L. F.
    Fernandez, F.
    Ferreiros, J.
    Lucas, J. M.
    Macias-Guarasa, J.
    Montero, J. M.
    Pardo, J. M.
    [J]. SPEECH COMMUNICATION, 2008, 50 (11-12) : 1009 - 1020
  • [2] Factored translation models for enriching spoken language translation with prosody
    Sridhar, Vivek Kumar Rangarajan
    Bangalore, Srinivas
    Narayanan, Shrikanth
    [J]. INTERSPEECH 2008: 9TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2008, VOLS 1-5, 2008, : 2723 - +
  • [3] Speech To Indian Sign Language (ISL) Translation System
    Sonawane, Pankaj
    Shah, Karan
    Patel, Parth
    Shah, Shikhar
    Shah, Jay
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION, AND INTELLIGENT SYSTEMS (ICCCIS), 2021, : 92 - 96
  • [4] Increasing adaptability of a speech into sign language translation system
    Lopez-Ludena, Veronica
    San-Segundo, Ruben
    Gonzalez Morcillo, Carlos
    Carlos Lopez, Juan
    Pardo Munoz, Jose M.
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (04) : 1312 - 1322
  • [5] Adapting a Speech into Sign Language Translation System to a new domain
    Lopez-Ludena, V.
    San-Segundo, R.
    Gonzalez-Morcillo, C.
    Lopez, J. C.
    Ferreiro, E.
    [J]. 14TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2013), VOLS 1-5, 2013, : 1163 - 1167
  • [6] Speech into Sign Language Statistical Translation System for Deaf People
    Gallo, B.
    San-Segundo, R.
    Lucas, J. M.
    Barra, R.
    D'Haro, L. F.
    Fernandez, F.
    [J]. IEEE LATIN AMERICA TRANSACTIONS, 2009, 7 (03) : 400 - 404
  • [7] Improving Sign Language Translation with Monolingual Data by Sign Back-Translation
    Zhou, Hao
    Zhou, Wengang
    Qi, Weizhen
    Pu, Junfu
    Li, Houqiang
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 1316 - 1325
  • [8] Evaluation of Alternatives on Speech to Sign Language Translation
    San-Segundo, R.
    Perez, A.
    Ortiz, D.
    D'Haro, L. F.
    Torres, M. I.
    Casacuberta, F.
    [J]. INTERSPEECH 2007: 8TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION, VOLS 1-4, 2007, : 53 - +
  • [9] A Kinect-based system for Arabic sign language to speech translation
    Fraiwan, Mohammad
    Khasawneh, Natheer
    Ershedat, Hosam
    Al-Alali, Ibrahim
    Al-Kofahi, Hamza
    [J]. INTERNATIONAL JOURNAL OF COMPUTER APPLICATIONS IN TECHNOLOGY, 2015, 52 (2-3) : 117 - 126
  • [10] Factored Statistical Machine Translation System for English to Tamil Language
    Anand, Kumar M.
    Dhanalakshmi
    Soman, K. P.
    Rajendran, S.
    [J]. PERTANIKA JOURNAL OF SOCIAL SCIENCE AND HUMANITIES, 2014, 22 (04): : 1045 - 1061