Distortion Models For Statistical Machine Translation

被引:0
|
作者
Al-Onaizan, Yaser [1 ]
Papineni, Kishore [1 ]
机构
[1] IBM Corp, TJ Watson Res Ctr, Yorktown Hts, NY 10598 USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we argue that n-gram language models are not sufficient to address word reordering required for Machine Translation. We propose a new distortion model that can be used with existing phrase-based SMT decoders to address those n-gram language model limitations. We present empirical results in Arabic to English Machine Translation that show statistically significant improvements when our proposed model is used. We also propose a novel metric to measure word order similarity (or difference) between any pair of languages based on word alignments.
引用
收藏
页码:529 / 536
页数:8
相关论文
共 50 条
  • [41] Statistical machine translation for Indic languages
    Das, Sudhansu Bala
    Panda, Divyajyoti
    Mishra, Tapas Kumar
    Patra, Bidyut Kr.
    NATURAL LANGUAGE PROCESSING, 2025, 31 (02): : 328 - 345
  • [42] Paraphrase Lattice for Statistical Machine Translation
    Onishi, Takashi
    Utiyama, Masao
    Sumita, Eiichiro
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2011, E94D (06) : 1299 - 1305
  • [43] Pushdown Automata in Statistical Machine Translation
    Allauzen, Cyril
    Byrne, Bill
    de Gispert, Adria
    Iglesias, Gonzalo
    Riley, Michael
    COMPUTATIONAL LINGUISTICS, 2014, 40 (03) : 687 - 723
  • [44] Phrasal cohesion and statistical machine translation
    Fox, HJ
    PROCEEDINGS OF THE 2002 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, 2002, : 304 - 311
  • [45] Query expansion with statistical machine translation
    Li Weijiang
    Zhao Tiejun
    Wang Xiangang
    CHINESE JOURNAL OF ELECTRONICS, 2008, 17 (01): : 48 - 52
  • [46] Optimization for Statistical Machine Translation: A Survey
    Neubig, Graham
    Watanabe, Taro
    COMPUTATIONAL LINGUISTICS, 2016, 42 (01) : 1 - 54
  • [47] Lattice Desegmentation for Statistical Machine Translation
    Salameh, Mohammad
    Cherry, Colin
    Kondrak, Grzegorz
    PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, 2014, : 100 - 110
  • [48] Bilingual Segmenter for Statistical Machine Translation
    Huang, Chung-Chi
    Chen, Wei-Teh
    Chang, Jason S.
    PROCEEDINGS OF THE SECOND INTERNATIONAL SYMPOSIUM ON UNIVERSAL COMMUNICATION, 2008, : 97 - +
  • [49] Decoding algorithm in statistical machine translation
    Wang, YY
    Waibel, A
    35TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 8TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE, 1997, : 366 - 372
  • [50] Statistical machine translation gains respect
    Geer, D
    COMPUTER, 2005, 38 (10) : 18 - 21