Research on system combination of machine translation based on Transformer

被引:0
|
作者
刘文斌 [1 ]
HE Yanqing [1 ]
LAN Tian [1 ]
WU Zhenfeng [1 ]
机构
[1] Research Center for Information Science Theory and Methodology, Institute of Scientific andTechnical Information of China
关键词
D O I
暂无
中图分类号
TP391.2 [翻译机];
学科分类号
摘要
Influenced by its training corpus, the performance of different machine translation systems varies greatly. Aiming at achieving higher quality translations, system combination methods combine the translation results of multiple systems through statistical combination or neural network combination. This paper proposes a new multi-system translation combination method based on the Transformer architecture, which uses a multi-encoder to encode source sentences and the translation results of each system in order to realize encoder combination and decoder combination. The experimental verification on the Chinese-English translation task shows that this method has 1.2-2.35 more bilingual evaluation understudy(BLEU) points compared with the best single system results, 0.71-3.12more BLEU points compared with the statistical combination method, and 0.14-0.62 more BLEU points compared with the state-of-the-art neural network combination method. The experimental results demonstrate the effectiveness of the proposed system combination method based on Transformer.
引用
收藏
页码:310 / 317
页数:8
相关论文
共 50 条
  • [21] Multimodal Transformer for Multimodal Machine Translation
    Yao, Shaowei
    Wan, Xiaojun
    58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 4346 - 4350
  • [22] WORD BASED MACHINE TRANSLATION SYSTEM
    谢金宝
    孙岗
    杨振宇
    JournalofShanghaiJiaotongUniversity, 1999, (02) : 104 - 108
  • [23] Comparison and system combination of n-gram-based and syntax-based machine translation systems
    Khalilov, Maxim
    Fonollosa, Jose A. R.
    PROCESAMIENTO DEL LENGUAJE NATURAL, 2008, (41): : 259 - 266
  • [24] Improved monolingual hypothesis alignment for machine translation system combination
    He, Xiaodong
    Yang, Mei
    Gao, Jianfeng
    Nguyen, Patrick
    Moore, Robert
    ACM Transactions on Asian Language Information Processing, 2009, 8 (02):
  • [25] Consensus network decoding for statistical Machine Translation system combination
    Sim, K. C.
    Byrne, W. J.
    Gales, M. J. F.
    Sahbi, H.
    Woodland, P. C.
    2007 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL IV, PTS 1-3, 2007, : 105 - +
  • [26] Direct Use of syntactic information for machine translation system combination
    Watanabe, Taro
    Journal of the National Institute of Information and Communications Technology, 2012, 59 (3-4): : 69 - 76
  • [27] Research on Traditional Mongolian-Chinese Neural Machine Translation Based on Dependency Syntactic Information and Transformer Model
    Qing-dao-er-ji, Ren
    Cheng, Kun
    Pang, Rui
    APPLIED SCIENCES-BASEL, 2022, 12 (19):
  • [28] Incorporating Source Syntax into Transformer-Based Neural Machine Translation
    Currey, Anna
    Heafield, Kenneth
    FOURTH CONFERENCE ON MACHINE TRANSLATION (WMT 2019), VOL 1: RESEARCH PAPERS, 2019, : 24 - 33
  • [29] Character-Level Transformer-Based Neural Machine Translation
    Banar, Nikolay
    Daelemans, Walter
    Kestemont, Mike
    2020 4TH INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING AND INFORMATION RETRIEVAL, NLPIR 2020, 2020, : 149 - 156
  • [30] Regression Loss in Transformer-based Supervised Neural Machine Translation
    Li, Dongxing
    Luo, Zuying
    INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2021, 16 (04) : 1 - 17