Chunking Arabic Texts Using Conditional Random Fields

被引:0
|
作者
Khoufi, Nabil [1 ]
Aloulou, Chafik [1 ]
Hadrich Belguith, Lamia [1 ]
机构
[1] Univ Sfax, FSEGS, MIRACL Lab, ANLP Res Grp, Sfax, Tunisia
关键词
Chunking; Arabic language; CRF; supervised learning;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Chunking or shallow syntactic parsing is proving to be a task of interest to many natural language processing applications. The problem gets worse for the Arabic language because of its specific features that make it quite different and even more ambiguous than other natural languages when processed. In this paper, we present a method for chunking Arabic texts based on supervised learning. We use the Conditional Random Fields algorithm and the Penn Arabic Treebank to train the model. For the experimentation, we use over than 10,100 sentences as training data and 2,524 sentences for the test. The evaluation of the method consists of the calculation of the generated model accuracy and the results are very encouraging.
引用
收藏
页码:428 / 432
页数:5
相关论文
共 50 条
  • [41] Recognizing Point Clouds using Conditional Random Fields
    Husain, Farzad
    Dellen, Babette
    Torras, Carme
    [J]. 2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 4257 - 4262
  • [42] Khmer POS Tagging Using Conditional Random Fields
    Sangvat, Sokunsatya
    Pluempitiwiriyawej, Charnyote
    [J]. COMPUTATIONAL LINGUISTICS, PACLING 2017, 2018, 781 : 169 - 178
  • [43] ABNORMAL BEHAVIOR DETECTION USING CONDITIONAL RANDOM FIELDS
    Huang, Ben-Syuan
    Hsu, Shih-Chung
    Huang, Chung-Lin
    [J]. PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), 2016, : 235 - 240
  • [44] An Introduction to Conditional Random Fields
    Sutton, Charles
    McCallum, Andrew
    [J]. FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2012, 4 (04): : 267 - 373
  • [45] Hidden conditional random fields
    Quattoni, Ariadna
    Wang, Sybor
    Morency, Louis-Philippe
    Collins, Michael
    Darrell, Trevor
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (10) : 1848 - 1853
  • [46] Investigating syllabic prominence with Conditional Random Fields and Latent-Dynamic Conditional Random Fields
    Cutugno, Francesco
    Leone, Enrico
    Ludusan, Bogdan
    Origlia, Antonio
    [J]. 13TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2012 (INTERSPEECH 2012), VOLS 1-3, 2012, : 2399 - 2402
  • [47] Parts-of-speech tagging of Nepali texts with Bidirectional LSTM, Conditional Random Fields and HMM
    Ashish Pradhan
    Archit Yajnik
    [J]. Multimedia Tools and Applications, 2024, 83 : 9893 - 9909
  • [48] Parts-of-speech tagging of Nepali texts with Bidirectional LSTM, Conditional Random Fields and HMM
    Pradhan, Ashish
    Yajnik, Archit
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (04) : 9893 - 9909
  • [49] Using Bidirectional Long Short-Term Memory and Conditional Random Fields for Labeling Arabic Named Entities: A Comparative Study
    AlzbouN, Sa'aD A.
    Tawalbeh, Saja Khaled
    AL-Smadi, Mohammad
    Jararweh, Yaser
    [J]. 2018 FIFTH INTERNATIONAL CONFERENCE ON SOCIAL NETWORKS ANALYSIS, MANAGEMENT AND SECURITY (SNAMS), 2018, : 135 - 140
  • [50] Chunking Natural Language Texts using Evolutionary Methods
    Atkinson, John
    Matamala, Juan
    [J]. RESEARCH AND DEVELOPMENT IN INTELLIGENT SYSTEMS XXVI: INCORPORATING APPLICATIONS AND INNOVATIONS IN INTELLIGENT SYSTEMS XVII, 2010, : 277 - 290