Chunking using conditional random fields in Korean texts

被引：0
|
作者：
Lee, YH
Kim, MY
Lee, JH
机构：
[1] POSTECH, Div Elect & Comp Engn, Pohang 790784, South Korea
[2] AITrc, Pohang 790784, South Korea
来源：
NATURAL LANGUAGE PROCESSING - IJCNLP 2005, PROCEEDINGS | 2005年 / 3651卷
关键词：
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
We present a method of chunking in Korean texts using conditional random fields (CRFs), a recently introduced probabilistic model for labeling and segmenting sequence of data. In agglutinative languages such as Korean and Japanese, a rule-based chunking method is predominantly used for its simplicity and efficiency. A hybrid of a rule-based and machine learning method was also proposed to handle exceptional cases of the rules. In this paper, we present how CRFs can be applied to the task of chunking in Korean texts. Experiments using the STEP 2000 dataset show that the proposed method significantly improves the performance as well as outperforms previous systems.
引用
收藏
页码：155 / 164
页数：10
相关论文
共 50 条
  • [21] XML structure extraction from plain texts based on conditional random fields
    Piao, Yong
    Zou, Shasha
    Wang, Xiukun
    Wang, Zheng
    [J]. Journal of Computational Information Systems, 2010, 6 (08): : 2683 - 2690
  • [22] Clause boundary identification using conditional random fields
    Ram, R. Vijay Sundar
    Devi, Sobha Lalitha
    [J]. COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, 2008, 4919 : 140 - 150
  • [23] Classifying Behavioral Attributes Using Conditional Random Fields
    Vrigkas, Michalis
    Nikou, Christophoros
    Kakadiadis, Ioannis A.
    [J]. ARTIFICIAL INTELLIGENCE: METHODS AND APPLICATIONS, 2014, 8445 : 95 - 104
  • [24] Handwritten word recognition using conditional random fields
    Shetty, Shravya
    Srinivasan, Harish
    Srihari, Sargur
    [J]. ICDAR 2007: NINTH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION, VOLS I AND II, PROCEEDINGS, 2007, : 1098 - 1102
  • [25] Conrad: Gene prediction using conditional random fields
    DeCaprio, David
    Vinson, Jade P.
    Pearson, Matthew D.
    Montgomery, Philip
    Doherty, Matthew
    Galagan, James E.
    [J]. GENOME RESEARCH, 2007, 17 (09) : 1389 - 1398
  • [26] Detecting DDoS Attacks Using Conditional Random Fields
    Liu, Yun
    Jiang, Siyu
    Yuan, Xiaojie
    [J]. APPLIED SCIENCE, MATERIALS SCIENCE AND INFORMATION TECHNOLOGIES IN INDUSTRY, 2014, 513-517 : 522 - 526
  • [27] Assessing map quality using conditional random fields
    Chandran-Ramesh, Manjari
    Newman, Paul
    [J]. FIELD AND SERVICE ROBOTICS: RESULTS OF THE 6TH INTERNATIONAL CONFERENCE, 2008, 42 : 35 - 48
  • [28] Named Entity Recognition using Conditional Random Fields
    Patil, Nita
    Patil, Ajay
    Pawar, B., V
    [J]. INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND DATA SCIENCE, 2020, 167 : 1181 - 1188
  • [29] Speech Recognition Using Augmented Conditional Random Fields
    Hifny, Yasser
    Renals, Steve
    [J]. IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2009, 17 (02): : 354 - 365
  • [30] Combining phonetic attributes using conditional random fields
    Morris, Jeremy
    Fosler-Lussier, Eric
    [J]. INTERSPEECH 2006 AND 9TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, VOLS 1-5, 2006, : 597 - 600
12345