Processing Judeo-Arabic Texts

被引:1
|
作者
Bar, Kfir [1 ]
Dershowitz, Nachum [1 ]
Wolf, Lior [1 ]
Lubarsky, Yackov [1 ]
Choueka, Yaacov [2 ]
机构
[1] Tel Aviv Univ, Sch Comp Sci, Ramat Aviv, Israel
[2] Friedberg Genizah Project, Jerusalem, Israel
关键词
transliteration; code switching; Judeo-Arabic;
D O I
10.1109/ACLing.2015.27
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Judeo-Arabic is a set of dialects spoken and written by Jewish communities living in Arab countries. Judeo-Arabic is typically written in Hebrew letters, enriched with diacritic marks that relate to the underlying Arabic. However, some inconsistencies in rendering words in Hebrew letters increase the level of ambiguity of a given word. Furthermore, Judeo-Arabic texts usually contain non-Arabic words and phrases, such as quotations or borrowed words from Hebrew and Aramaic. We focus on two main tasks: (1) automatic transliteration of Judeo-Arabic Hebrew letters into Arabic letters; and (2) automatic identification of language switching points between Judeo-Arabic and Hebrew. For transliteration, we employ a statistical translation system trained on the character level, resulting in 96.9% precision, a significant improvement over the baseline. For the language switching task, we use a word-level supervised classifier, also showing some significant improvements over the baseline.
引用
收藏
页码:138 / 144
页数:7
相关论文
共 50 条