Machine Translation Based on Domain Adaptive Language Model

被引:0
|
作者
Li, Lingling [1 ]
Chen, Xianlong [1 ]
Xu, Yiling [1 ]
机构
[1] Dongguan Univ Technol, City Coll, Dongguan, Peoples R China
关键词
machine translation; language model; domain adaptation; adjustable discount; domain interpolation;
D O I
10.1109/CIS52066.2020.00033
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study presents a domain adaptive language model based on adjustable parameters and domain interpolation. Meanwhile, a method of automatically determining test data domain by language model is proposed. Results show that the perplexity of the proposed language model is significantly lower than that of the baseline of KN smoothing language model on the cross-domain test set. In Chinese-English translation, the BLEU value of machine translation evaluation is also significantly higher than that of baseline model.
引用
收藏
页码:116 / 120
页数:5
相关论文
共 50 条
  • [1] Domain Adaptive Inference for Neural Machine Translation
    Saunders, Danielle
    Stahlberg, Felix
    de Gispert, Adria
    Byrne, Bill
    [J]. 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 222 - 228
  • [2] A multi-domain adaptive neural machine translation method based on domain data balancer
    Xu, Jinlei
    Wen, Yonghua
    Huang, Shuanghong
    Yu, Zhengtao
    [J]. INTELLIGENT DATA ANALYSIS, 2024, 28 (03) : 685 - 698
  • [3] Machine Translation System for the Industry Domain and Croatian Language
    Dunder, Ivan
    [J]. JOURNAL OF INFORMATION AND ORGANIZATIONAL SCIENCES, 2020, 44 (01) : 33 - 50
  • [4] A Novel Natural Language Processing (NLP)–Based Machine Translation Model for English to Pakistan Sign Language Translation
    Nabeel Sabir Khan
    Adnan Abid
    Kamran Abid
    [J]. Cognitive Computation, 2020, 12 : 748 - 765
  • [5] A Novel Natural Language Processing (NLP)-Based Machine Translation Model for English to Pakistan Sign Language Translation
    Khan, Nabeel Sabir
    Abid, Adnan
    Abid, Kamran
    [J]. COGNITIVE COMPUTATION, 2020, 12 (04) : 748 - 765
  • [6] Neural Machine Translation Transfer Model Based on Mutual Domain Guidance
    Liu, Yupeng
    Zhang, Lei
    Zhang, Yanan
    [J]. IEEE ACCESS, 2022, 10 : 101595 - 101608
  • [7] On integrating a language model into neural machine translation
    Gulcehre, Caglar
    Firat, Orhan
    Xu, Kelvin
    Cho, Kyunghyun
    Bengio, Yoshua
    [J]. COMPUTER SPEECH AND LANGUAGE, 2017, 45 : 137 - 148
  • [8] An Efficient Machine Translation Model for Dravidian Language
    Chandramma
    Pareek, Piyush Kumar
    Swathi, K.
    Shetteppanavar, Puneet
    [J]. 2017 2ND IEEE INTERNATIONAL CONFERENCE ON RECENT TRENDS IN ELECTRONICS, INFORMATION & COMMUNICATION TECHNOLOGY (RTEICT), 2017, : 2101 - 2105
  • [9] Use of Domain-Specific Language Resources in Machine Translation
    Stajner, Sanja
    Querido, Andreia
    Rendeiro, Nuno
    Rodrigues, Joao
    Branco, Antonio
    [J]. LREC 2016 - TENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2016, : 592 - 598
  • [10] Machine Translation Based on Translation Rules for Processing Natural Language
    Zhou, Li
    [J]. PROCEEDINGS OF THE 2016 6TH INTERNATIONAL CONFERENCE ON MACHINERY, MATERIALS, ENVIRONMENT, BIOTECHNOLOGY AND COMPUTER (MMEBC), 2016, 88 : 457 - 460