An Improved Chinese Segmentation Algorithm Based on Segmentation Dictionary

被引：0
|
作者：
Niu, Yan [1 ]
Li, Lala [1 ]
机构：
[1] Hubei Univ Technol, Comp Sch, Wuhan, Peoples R China
来源：
PROCEEDINGS OF THE 2009 INTERNATIONAL CONFERENCE ON COMPUTER TECHNOLOGY AND DEVELOPMENT, VOL 1 | 2009年
关键词：
Chinese information processing; Chinese word segmentation; FMM algorithm; two-word root;
D O I：
10.1109/ICCTD.2009.125
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
Based on the analysis of the traditional forward maximum matching word segmentation algorithm and the characteristics of the principle on the basis of the results of the use of word frequency statistics, we design a new structure of the dictionary, a dictionary based on the new structure to improve the matching algorithm are the largest After time complexity analysis and experiments, the improved forward maximum matching algorithm can further improve the efficiency of segmentation.
引用
收藏
页码：184 / 187
页数：4
相关论文
共 50 条
  • [1] An Optimization Algorithm of Chinese Word Segmentation Based on Dictionary
    Tang, Jun
    Wu, Qing
    Li, Yinghong
    2015 INTERNATIONAL CONFERENCE ON NETWORK AND INFORMATION SYSTEMS FOR COMPUTERS (ICNISC), 2015, : 259 - 262
  • [2] An ambiguity discovery algorithm on Chinese word segmentation based dictionary
    Sun, Tieli
    Liu, Yanji
    Yang, Lehua
    Li, Zhiying
    Liu, Zhenghong
    PROCEEDINGS OF THE 2009 SECOND PACIFIC-ASIA CONFERENCE ON WEB MINING AND WEB-BASED APPLICATION, 2009, : 39 - 42
  • [3] Design of Chinese word segmentation system based on improved Chinese converse dictionary and reverse maximum matching algorithm
    Zhang, Liyi
    Li, Yazi
    Meng, Jian
    WEB INFORMATION SYSTEMS - WISE 2006 WORKSHOPS, PROCEEDINGS, 2006, 4256 : 171 - 181
  • [4] Research of an Improved Algorithm for Chinese Word Segmentation Dictionary Based on Double-Array Trie Tree
    Yang, Wenchuan
    Liu, Jian
    Yu, Miao
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2013, 2013, 400 : 355 - 362
  • [5] Improved fast algorithm for Chinese word segmentation
    Chen, Guilin
    Wang, Yongcheng
    Han, Kesong
    Wang, Gang
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2000, 37 (04): : 418 - 424
  • [6] Improved fast algorithm for Chinese word segmentation
    Chen, Guilin
    Wang, Yongcheng
    Han, Kesong
    Wang, Gang
    2000, Sci Press (37):
  • [7] An improved Dijkstra algorithm in Chinese Word Segmentation
    Zhang Xueyan
    Xue Xiao
    Yang Shenggang
    Zhao Limei
    ITESS: 2008 PROCEEDINGS OF INFORMATION TECHNOLOGY AND ENVIRONMENTAL SYSTEM SCIENCES, PT 2, 2008, : 909 - 914
  • [8] Research on Improved Algorithm for Chinese Word Segmentation Based on Markov Chain
    Pang Baomao
    Shi Haoshan
    FIFTH INTERNATIONAL CONFERENCE ON INFORMATION ASSURANCE AND SECURITY, VOL 1, PROCEEDINGS, 2009, : 236 - 238
  • [9] Neural Chinese word segmentation with dictionary
    Liu, Junxin
    Wu, Fangzhao
    Wu, Chuhan
    Huang, Yongfeng
    Xie, Xing
    NEUROCOMPUTING, 2019, 338 : 46 - 54
  • [10] Image segmentation algorithm based on the improved watershed algorithm
    Sun, Huijie
    Deng, Tingquan
    Li, Yanchao
    Harbin Gongcheng Daxue Xuebao/Journal of Harbin Engineering University, 2014, 35 (07): : 857 - 864
12345