ON-TRAC' systems for the IWSLT 2021 low-resource speech translation and multilingual speech translation shared tasks

被引:0
|
作者
Lee, Hang [2 ]
Barbier, Florentin [4 ]
Ha Nguyen [1 ,2 ]
Tomanshenko, Natalia [1 ]
Mdhaffar, Salima [1 ]
Gahbiche, Souhir [4 ]
Bougares, Fethi [3 ]
Lecouteux, Benjamin [2 ]
Schwabe, Didier [2 ]
Esteve, Yannick [1 ]
机构
[1] ON TRAC Consortium, LIA, Avignon, France
[2] ON TRAC Consortium, LIG, Grenoble, France
[3] ON TRAC Consortium, LIUM, Le Mans, France
[4] ON TRAC Consortium, Airbus, Blagnac, France
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper describes the ON-TRAC Consortium translation systems developed for two challenge tracks featured in the Evaluation Campaign of IWSLT 2021, low-resource speech translation and multilingual speech translation. The ON-TRAC Consortium is composed of researchers from three French academic laboratories and an industrial partner: LIA (Avignon Universite), LIG (Universite Grenoble Alpes), LIUM (Le Mans Universite), and researchers from Airbus. A pipeline approach was explored for the low-resource speech translation task, using a hybrid HMM/TDNN automatic speech recognition system fed by wav2vec features, coupled to an NMT system. For the multilingual speech translation task, we investigated the use of a dual-decoder Transformer that jointly transcribes and translates an input speech signal. This model was trained in order to translate from multiple source languages to multiple target ones.
引用
收藏
页码:169 / 174
页数:6
相关论文
共 50 条
  • [21] The BIGAI Offline Speech Translation Systems for IWSLT 2023 Evaluation
    Xie, Zhihang
    [J]. 20th International Conference on Spoken Language Translation, IWSLT 2023 - Proceedings of the Conference, 2023, : 123 - 129
  • [22] NVIDIA NeMo Offline Speech Translation Systems for IWSLT 2022
    Hrinchuk, Oleksii
    Noroozi, Vahid
    Khattar, Abhinav
    Peganov, Anton
    Subramanian, Sandeep
    Majumdar, Somshubra
    Kuchaiev, Oleksii
    [J]. PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE TRANSLATION (IWSLT 2022), 2022, : 225 - 231
  • [23] NAIST's Machine Translation Systems for IWSLT 2020 Conversational Speech Translation Task
    Fukuda, Ryo
    Sudoh, Katsuhito
    Nakamura, Satoshi
    [J]. 17TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE TRANSLATION (IWSLT 2020), 2020, : 172 - 177
  • [24] ANALYZING ASR PRETRAINING FOR LOW-RESOURCE SPEECH-TO-TEXT TRANSLATION
    Stoian, Mihaela C.
    Bansal, Sameer
    Goldwater, Sharon
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 7909 - 7913
  • [25] Part-of-Speech Tags Guide Low-Resource Machine Translation
    Kadeer, Zaokere
    Yi, Nian
    Wumaier, Aishan
    [J]. ELECTRONICS, 2023, 12 (16)
  • [26] ADVERSARIAL MULTILINGUAL TRAINING FOR LOW-RESOURCE SPEECH RECOGNITION
    Yi, Jiangyan
    Tao, Jianhua
    Wen, Zhengqi
    Bai, Ye
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 4899 - 4903
  • [27] The USTC-NELSLIP Offline Speech Translation Systems for IWSLT 2022
    Zhang, Weitai
    Ye, Zhongyi
    Tang, Haitao
    Li, Xiaoxi
    Zhou, Xinyuan
    Yang, Jing
    Cui, Jianwei
    Deng, Pan
    Shi, Mohan
    Song, Yifan
    Liu, Dan
    Liu, Junhua
    Dai, Lirong
    [J]. PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE TRANSLATION (IWSLT 2022), 2022, : 198 - 207
  • [28] Systems for Low-Resource Speech Recognition Tasks in Open Automatic Speech Recognition and Formosa Speech Recognition Challenges
    Lin, Hung-Pang
    Zhang, Yu-Jia
    Chen, Chia-Ping
    [J]. INTERSPEECH 2021, 2021, : 4339 - 4343
  • [29] Deriving phonetic transcriptions and discovering word segmentations for speech-to-speech translation in low-resource settings
    Wilkinson, Andrew
    Zhao, Tiancheng
    Black, Alan W.
    [J]. 17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, : 3086 - 3090
  • [30] Transfer Learning from Multi-Lingual Speech Translation Benefits Low-Resource Speech Recognition
    Vanderreydt, Geoffroy
    Remy, Francois
    Demuynck, Kris
    [J]. INTERSPEECH 2022, 2022, : 3053 - 3057