Improving Egyptian-to-English SMT by Mapping Egyptian into MSA

被引:0
|
作者
Durrani, Nadir [1 ]
Al-Onaizan, Yaser [2 ]
Ittycheriah, Abraham [2 ]
机构
[1] Univ Edinburgh, Edinburgh EH8 9YL, Midlothian, Scotland
[2] IBM Corp, Thomas J Watson Res Ctr, Yorktown Hts, NY 10598 USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the aims of DARPA BOLT project is to translate the Egyptian blog data into English. While the parallel data for MSA(1)-English is abundantly available, sparsely exists for Egyptian-English and Egyptian-MSA. A notable drop in the translation quality is observed when translating Egyptian to English in comparison with translating from MSA to English. One of the reasons for this drop is the high OOV rate, where as another is the dialectal differences between training and test data. This work is focused on improving Egyptian-to-English translation by bridging the gap between Egyptian and MSA. First we try to reduce the OOV rate by proposing MSA candidates for the unknown Egyptian words through different methods such as spelling correction, suggesting synonyms based on context etc. Secondly we apply convolution model using English as a pivot to map Egyptian words into MSA. We then evaluate our edits by running decoder built on MSA-to-English data. Our spelling-based correction shows an improvement of 1.7 BLEU points over the baseline system, that translates unedited Egyptian into English.
引用
收藏
页码:271 / 282
页数:12
相关论文
共 50 条
  • [31] ArzEn: A Speech Corpus for Code-switched Egyptian Arabic-English
    Hamed, Injy
    Ngoc Thang Vu
    Abdennadher, Slim
    PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), 2020, : 4237 - 4246
  • [32] The Egyptian Law of Obligations: a Comparative Study with special reference to the French and English law
    不详
    LAW QUARTERLY REVIEW, 1924, 40 (157): : 114 - 115
  • [33] A DICTIONARY OF EGYPTIAN ARABIC - ARABIC-ENGLISH - HINDS,M, BADAWI,E
    IRWIN, R
    TLS-THE TIMES LITERARY SUPPLEMENT, 1988, (4424): : 67 - 67
  • [35] THE HISTORICAL DEVELOPMENTS OF CHALLENGING ARBITRAL AWARDS IN THE EGYPTIAN, JORDANIAN AND ENGLISH ARBITRATION LEGISLATIONS
    Odeibat, Mohammad Atef
    JOURNAL OF LAW AND POLITICAL SCIENCES, 2024, 43 (04):
  • [36] The Egyptian Law of Obligations: a comparative study, with special reference to the French and English Law
    不详
    LAW QUARTERLY REVIEW, 1921, 37 (147): : 379 - 380
  • [37] The role of digital transformation in improving customer satisfaction: An empirical study on Egyptian hotels
    Abdel-Hamid, Talaat A.
    Ahmed, Mohamed Abd el Aziz Sayed
    Zohry, Mohamed Abdel Fattah
    Elshabrawy, Ghada Atef
    Elgohary, Esam Mohamed
    ELECTRONIC JOURNAL OF INFORMATION SYSTEMS IN DEVELOPING COUNTRIES, 2022, 88 (06):
  • [38] Mapping gendered spaces and women’s rights in the modern egyptian public sphere
    Amany Abdelrazek-Alsiefy
    SN Social Sciences, 3 (1):
  • [39] Assessment and Mapping of Soil Salinization Risk in an Egyptian Field Using a Probabilistic Approach
    Shaddad, Sameh M.
    Buttafuoco, Gabriele
    Castrignano, Annamaria
    AGRONOMY-BASEL, 2020, 10 (01):
  • [40] Mapping the doctoral theses awarded by the Egyptian tourism colleges, 1975-2008
    Hamza, Galal M.
    CUHT '09: PROCEEDINGS OF THE 2ND WSEAS INTERNATIONAL CONFERENCE ON CULTURAL HERITAGE AND TOURISM: RECENT ADVANCES IN CULTURAL HERITAGE AND TOURISM, 2009, : 91 - 100