ON-TRAC' systems for the IWSLT 2021 low-resource speech translation and multilingual speech translation shared tasks

被引:0
|
作者
Lee, Hang [2 ]
Barbier, Florentin [4 ]
Ha Nguyen [1 ,2 ]
Tomanshenko, Natalia [1 ]
Mdhaffar, Salima [1 ]
Gahbiche, Souhir [4 ]
Bougares, Fethi [3 ]
Lecouteux, Benjamin [2 ]
Schwabe, Didier [2 ]
Esteve, Yannick [1 ]
机构
[1] ON TRAC Consortium, LIA, Avignon, France
[2] ON TRAC Consortium, LIG, Grenoble, France
[3] ON TRAC Consortium, LIUM, Le Mans, France
[4] ON TRAC Consortium, Airbus, Blagnac, France
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper describes the ON-TRAC Consortium translation systems developed for two challenge tracks featured in the Evaluation Campaign of IWSLT 2021, low-resource speech translation and multilingual speech translation. The ON-TRAC Consortium is composed of researchers from three French academic laboratories and an industrial partner: LIA (Avignon Universite), LIG (Universite Grenoble Alpes), LIUM (Le Mans Universite), and researchers from Airbus. A pipeline approach was explored for the low-resource speech translation task, using a hybrid HMM/TDNN automatic speech recognition system fed by wav2vec features, coupled to an NMT system. For the multilingual speech translation task, we investigated the use of a dual-decoder Transformer that jointly transcribes and translates an input speech signal. This model was trained in order to translate from multiple source languages to multiple target ones.
引用
收藏
页码:169 / 174
页数:6
相关论文
共 50 条
  • [1] ON-TRAC Consortium Systems for the IWSLT 2022 Dialect and Low-resource Speech Translation Tasks
    Boito, Marcely Zanon
    Ortega, John
    Riguidel, Hugo
    Laurent, Antoine
    Barrault, Loic
    Bougares, Fethi
    Chaabani, Firas
    Nguyen, Ha
    Barbier, Florentin
    Gahbiche, Souhir
    Esteve, Yannick
    [J]. PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE TRANSLATION (IWSLT 2022), 2022, : 308 - 318
  • [2] IMS' Systems for the IWSLT 2021 Low-Resource Speech Translation Task
    Denisov, Pavel
    Mager, Manuel
    Ngoc Thang Vu
    [J]. IWSLT 2021: THE 18TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE TRANSLATION, 2021, : 175 - 181
  • [3] ON-TRAC Consortium for End-to-End and Simultaneous Speech Translation Challenge Tasks at IWSLT 2020
    Elbayad, Maha
    Ha Nguyen
    Bougares, Fethi
    Tomashenko, Natalia
    Caubriere, Antoine
    Lecouteux, Benjamin
    Esteve, Yannick
    Besacier, Laurent
    [J]. 17TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE TRANSLATION (IWSLT 2020), 2020, : 35 - 43
  • [4] Multilingual Speech Translation KIT @ IWSLT2021
    Ngoc-Quan Pham
    He, Dan
    Tuan-Nam Nguyen
    Thanh-Le Ha
    Stuker, Sebastian
    Waibel, Alexander
    [J]. IWSLT 2021: THE 18TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE TRANSLATION, 2021, : 154 - 159
  • [5] The IWSLT 2021 BUT Speech Translation Systems
    Vydana, Hari Krishna
    Karafiat, Martin
    Burget, Lukas
    Cernocky, Honza
    [J]. IWSLT 2021: THE 18TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE TRANSLATION, 2021, : 75 - 83
  • [6] Speech-to-speech Low-resource Translation
    Liu, Hsiao-Chuan
    Day, Min-Yuh
    Wang, Chih-Chien
    [J]. 2023 IEEE 24TH INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION FOR DATA SCIENCE, IRI, 2023, : 91 - 95
  • [7] Maastricht University's Multilingual Speech Translation System for IWSLT 2021
    Liu, Danni
    Niehues, Jan
    [J]. IWSLT 2021: THE 18TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE TRANSLATION, 2021, : 138 - 143
  • [8] MLLP-VRAIN UPV systems for the IWSLT 2022 Simultaneous Speech Translation and Speech-to-Speech Translation tasks
    Iranzo-Sanchez, Javier
    Jorge, Javier
    Perez-Gonzalez-de-Marto, Alejandro
    Gimenez, Adria
    Garces Diaz-Munio, Goncal, V
    Baquero-Arnal, Pau
    Albert Silvestre-Cerda, Joan
    Civera, Jorge
    Sanchis, Albert
    Juan, Alfons
    [J]. PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE TRANSLATION (IWSLT 2022), 2022, : 255 - 264
  • [9] FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task
    Tang, Yun
    Gong, Hongyu
    Li, Xian
    Wang, Changhan
    Pino, Juan
    Schwenk, Holger
    Goyal, Naman
    [J]. IWSLT 2021: THE 18TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE TRANSLATION, 2021, : 131 - 137
  • [10] Low-Resource Speech-to-Text Translation
    Bansal, Sameer
    Kamper, Herman
    Livescu, Karen
    Lopez, Adam
    Goldwater, Sharon
    [J]. 19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 1298 - 1302