Discriminative training and maximum entropy models for statistical machine translation

被引:0
|
作者
Och, FJ [1 ]
Ney, H [1 ]
机构
[1] Rhein Westfal TH Aachen, Rhein Westfal TH Aachen, Dept Comp Sci, Lehrstuhl Informat 6, D-52056 Aachen, Germany
来源
40TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE | 2002年
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a framework for statistical machine translation of natural languages based on direct maximum entropy models, which contains the widely used source-channel approach as a special case. All knowledge sources are treated as feature functions, which depend on the source language sentence, the target language sentence and possible hidden variables. This approach allows a baseline machine translation system to be extended easily by adding new feature functions. We show that a baseline statistical machine translation system is significantly improved using this approach.
引用
收藏
页码:295 / 302
页数:8
相关论文
共 50 条
  • [21] Discriminative reranking for machine translation
    Shen, LB
    Sarkar, A
    Och, FJ
    HLT-NAACL 2004: HUMAN LANGUAGE TECHNOLOGY CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE MAIN CONFERENCE, 2004, : 177 - 184
  • [22] Using Statistical Machine Translation to Grade Training Data
    Finch, Andrew
    Sumita, Eiichiro
    PROCEEDINGS OF THE SECOND INTERNATIONAL SYMPOSIUM ON UNIVERSAL COMMUNICATION, 2008, : 113 - 119
  • [23] Minimum error rate training in statistical machine translation
    Och, FJ
    41ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE, 2003, : 160 - 167
  • [24] DISCRIMINATIVE TRAINING METHODS FOR LANGUAGE MODELS USING CONDITIONAL ENTROPY CRITERIA
    Huang, Jui-Ting
    Li, Xiao
    Acero, Alex
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 5182 - 5185
  • [25] Topic-based term translation models for statistical machine translation
    Xiong, Deyi
    Meng, Fandong
    Liu, Qun
    ARTIFICIAL INTELLIGENCE, 2016, 232 : 54 - 75
  • [26] Statistical models of complex brain networks: a maximum entropy approach
    Dichio, Vito
    Fallani, Fabrizio De Vico
    REPORTS ON PROGRESS IN PHYSICS, 2023, 86 (10)
  • [27] Bilingual cluster based models for statistical machine translation
    Yamamoto, Hirofumi
    Sumita, Eiichiro
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2008, E91D (03) : 588 - 597
  • [28] Linguistically motivated statistical machine translation: models and algorithms
    Vandeghinste, Vincent
    MACHINE TRANSLATION, 2015, 29 (3-4) : 291 - 294
  • [29] An Investigation on Statistical Machine Translation with Neural Language Models
    Zhao, Yinggong
    Huang, Shujian
    Chen, Huadong
    Chen, Jiajun
    CHINESE COMPUTATIONAL LINGUISTICS AND NATURAL LANGUAGE PROCESSING BASED ON NATURALLY ANNOTATED BIG DATA, CCL 2014, 2014, 8801 : 175 - 186
  • [30] Concept-based speech-to-speech translation using maximum entropy models for statistical natural concept generation
    Gu, L
    Gao, Y
    Liu, FH
    Picheny, M
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2006, 14 (02): : 377 - 392