An Improved Chinese Segmentation Algorithm Based on Segmentation Dictionary

被引：0
|
作者：
Niu, Yan [1 ]
Li, Lala [1 ]
机构：
[1] Hubei Univ Technol, Comp Sch, Wuhan, Peoples R China
来源：
PROCEEDINGS OF THE 2009 INTERNATIONAL CONFERENCE ON COMPUTER TECHNOLOGY AND DEVELOPMENT, VOL 1 | 2009年
关键词：
Chinese information processing; Chinese word segmentation; FMM algorithm; two-word root;
D O I：
10.1109/ICCTD.2009.125
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
Based on the analysis of the traditional forward maximum matching word segmentation algorithm and the characteristics of the principle on the basis of the results of the use of word frequency statistics, we design a new structure of the dictionary, a dictionary based on the new structure to improve the matching algorithm are the largest After time complexity analysis and experiments, the improved forward maximum matching algorithm can further improve the efficiency of segmentation.
引用
收藏
页码：184 / 187
页数：4
相关论文
共 50 条
  • [1] An Optimization Algorithm of Chinese Word Segmentation Based on Dictionary
    Tang, Jun
    Wu, Qing
    Li, Yinghong
    [J]. 2015 INTERNATIONAL CONFERENCE ON NETWORK AND INFORMATION SYSTEMS FOR COMPUTERS (ICNISC), 2015, : 259 - 262
  • [2] An ambiguity discovery algorithm on Chinese word segmentation based dictionary
    Sun, Tieli
    Liu, Yanji
    Yang, Lehua
    Li, Zhiying
    Liu, Zhenghong
    [J]. PROCEEDINGS OF THE 2009 SECOND PACIFIC-ASIA CONFERENCE ON WEB MINING AND WEB-BASED APPLICATION, 2009, : 39 - 42
  • [3] Design of Chinese word segmentation system based on improved Chinese converse dictionary and reverse maximum matching algorithm
    Zhang, Liyi
    Li, Yazi
    Meng, Jian
    [J]. WEB INFORMATION SYSTEMS - WISE 2006 WORKSHOPS, PROCEEDINGS, 2006, 4256 : 171 - 181
  • [4] Research of an Improved Algorithm for Chinese Word Segmentation Dictionary Based on Double-Array Trie Tree
    Yang, Wenchuan
    Liu, Jian
    Yu, Miao
    [J]. NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2013, 2013, 400 : 355 - 362
  • [5] Improved fast algorithm for Chinese word segmentation
    Chen, Guilin
    Wang, Yongcheng
    Han, Kesong
    Wang, Gang
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2000, 37 (04): : 418 - 424
  • [6] Improved fast algorithm for Chinese word segmentation
    Chen, Guilin
    Wang, Yongcheng
    Han, Kesong
    Wang, Gang
    [J]. 2000, Sci Press (37):
  • [7] An improved Dijkstra algorithm in Chinese Word Segmentation
    Zhang Xueyan
    Xue Xiao
    Yang Shenggang
    Zhao Limei
    [J]. ITESS: 2008 PROCEEDINGS OF INFORMATION TECHNOLOGY AND ENVIRONMENTAL SYSTEM SCIENCES, PT 2, 2008, : 909 - 914
  • [8] Research on Improved Algorithm for Chinese Word Segmentation Based on Markov Chain
    Pang Baomao
    Shi Haoshan
    [J]. FIFTH INTERNATIONAL CONFERENCE ON INFORMATION ASSURANCE AND SECURITY, VOL 1, PROCEEDINGS, 2009, : 236 - 238
  • [9] Neural Chinese word segmentation with dictionary
    Liu, Junxin
    Wu, Fangzhao
    Wu, Chuhan
    Huang, Yongfeng
    Xie, Xing
    [J]. NEUROCOMPUTING, 2019, 338 : 46 - 54
  • [10] Image segmentation algorithm based on the improved watershed algorithm
    Sun, Huijie
    Deng, Tingquan
    Li, Yanchao
    [J]. Harbin Gongcheng Daxue Xuebao/Journal of Harbin Engineering University, 2014, 35 (07): : 857 - 864
12345