An ambiguity discovery algorithm on Chinese word segmentation based dictionary

被引：1
|
作者：
Sun, Tieli [1 ]
Liu, Yanji [1 ]
Yang, Lehua [1 ]
Li, Zhiying [1 ]
Liu, Zhenghong [1 ]
机构：
[1] NE Normal Univ, Sch Comp, Dept Comp Sci, Changchun 130117, Peoples R China
来源：
PROCEEDINGS OF THE 2009 SECOND PACIFIC-ASIA CONFERENCE ON WEB MINING AND WEB-BASED APPLICATION | 2009年
关键词：
Chinese word segmentation; Chinese information processing; crossing ambiguity; covering ambiguity; ambiguity discovery algorithm;
D O I：
10.1109/WMWA.2009.18
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Chinese word segmentation is a basic research issue on Chinese information processing tasks such as information extraction; information retrieval; machine translation; text classification; automatic text summarization; speech recognition, natural language understanding and So on. And the ambiguity problem is one of the most difficult problems in Chinese word segmentation The paper introduced several normal ambiguity discovery algorithm, and proposed a new method of ambiguity discovery that can discover many crossing ambiguity fields and covering ambiguity fields at the same time.
引用
收藏
页码：39 / 42
页数：4
相关论文
共 50 条
  • [1] An Optimization Algorithm of Chinese Word Segmentation Based on Dictionary
    Tang, Jun
    Wu, Qing
    Li, Yinghong
    [J]. 2015 INTERNATIONAL CONFERENCE ON NETWORK AND INFORMATION SYSTEMS FOR COMPUTERS (ICNISC), 2015, : 259 - 262
  • [2] Algorithm of solving interlink overlapping ambiguity and combinatorial ambiguity and compound ambiguity in Chinese word segmentation
    Liang, Xiongyou
    Xue, Yongsheng
    [J]. Journal of Computational Information Systems, 2007, 3 (03): : 1189 - 1200
  • [3] An Improved Chinese Segmentation Algorithm Based on Segmentation Dictionary
    Niu, Yan
    Li, Lala
    [J]. PROCEEDINGS OF THE 2009 INTERNATIONAL CONFERENCE ON COMPUTER TECHNOLOGY AND DEVELOPMENT, VOL 1, 2009, : 184 - 187
  • [4] Neural Chinese word segmentation with dictionary
    Liu, Junxin
    Wu, Fangzhao
    Wu, Chuhan
    Huang, Yongfeng
    Xie, Xing
    [J]. NEUROCOMPUTING, 2019, 338 : 46 - 54
  • [5] Design of Chinese word segmentation system based on improved Chinese converse dictionary and reverse maximum matching algorithm
    Zhang, Liyi
    Li, Yazi
    Meng, Jian
    [J]. WEB INFORMATION SYSTEMS - WISE 2006 WORKSHOPS, PROCEEDINGS, 2006, 4256 : 171 - 181
  • [6] Resolution to Combinational Ambiguity of Chinese Word Segmentation
    Liu, JiangYang
    Liu, Ying
    [J]. IEEE: 2009 INTERNATIONAL CONFERENCE ON E-LEARNING, E-BUSINESS, ENTERPRISE INFORMATION SYSTEMS AND E-GOVERNMENT, 2009, : 141 - 145
  • [7] Research on Dictionary for Personalized Chinese Word Segmentation
    Jiang, Huanjun
    Ren, Xiang
    Liu, Ke
    [J]. MODERN TECHNOLOGIES IN MATERIALS, MECHANICS AND INTELLIGENT SYSTEMS, 2014, 1049 : 1868 - +
  • [8] Neural Chinese Word Segmentation with Dictionary Knowledge
    Liu, Junxin
    Wu, Fangzhao
    Wu, Chuhan
    Huang, Yongfeng
    Xie, Xing
    [J]. NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2018, PT II, 2018, 11109 : 80 - 91
  • [9] Research of an Improved Algorithm for Chinese Word Segmentation Dictionary Based on Double-Array Trie Tree
    Yang, Wenchuan
    Liu, Jian
    Yu, Miao
    [J]. NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2013, 2013, 400 : 355 - 362
  • [10] A kind of dictionary mechanism based on the two-word-bitmap for Chinese word segmentation
    College of Computer and Communication, Hunan Univ., Changsha 410082, China
    [J]. Hunan Daxue Xuebao, 2006, 1 (121-123):
12345