Using directed graph based BDMM algorithm for Chinese word segmentation

被引：0
|
作者：
Chen, YD [1 ]
Wang, T [1 ]
Chen, HW [1 ]
机构：
[1] Natl Lab Parallel & Distributed Proc, Changsha 410073, Hunan, Peoples R China
来源：
COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING | 2005年 / 3406卷
关键词：
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Word segmentation is a key problem for Chinese text analysis. In this paper, with the consideration of both word-coverage rate and sentence-coverage rate, based on the classic Bi-Directed Maximum Match (BDMM) segmentation method, a character Directed Graph with ambiguity mark is designed for searching multiple possible segmentation sequences. This method is compared with the classic Maximum Match algorithm and Omni-segmentation algorithm. The experiment result shows that Directed Graph based BDMM algorithm can achieve higher coverage rate and lower complexity.
引用
收藏
页码：214 / 217
页数：4
相关论文
共 50 条
  • [21] New Cyber Word Discovery Using Chinese Word Segmentation
    Wang, Hao
    Wang, Bing
    Zou, MengYu
    Duan, JianYong
    PROCEEDINGS OF 2019 IEEE 3RD INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2019), 2019, : 970 - 975
  • [22] A Word Segmentation Method of Ancient Chinese Based on Word Alignment
    Che, Chao
    Zhao, Hanyu
    Wu, Xiaoting
    Zhou, Dongsheng
    Zhang, Qiang
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING (NLPCC 2019), PT I, 2019, 11838 : 761 - 772
  • [23] A Chinese Word Segmentation Based on Machine Learning
    Wang Hongsheng
    Cui Mingming
    PROCEEDINGS OF THE FIRST INTERNATIONAL WORKSHOP ON EDUCATION TECHNOLOGY AND COMPUTER SCIENCE, VOL II, 2009, : 610 - 613
  • [24] Weighted directed word graph
    Zhang, M
    Hu, L
    Li, Q
    Ju, JB
    COMBINATORIAL PATTERN MATCHING, PROCEEDINGS, 2005, 3537 : 156 - 167
  • [25] Chinese Word Segmentation Based on Deep Learning
    Wang, Mengge
    Li, Xiaoge
    Wei, Zheng
    Zhi, Shuting
    Wang, Haoyue
    PROCEEDINGS OF 2018 10TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING (ICMLC 2018), 2018, : 16 - 20
  • [26] Research and Application of News-text Similarity Algorithm based on Chinese word segmentation
    Guan, Wei
    Zhang, Pengzhou
    2013 3RD INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, COMMUNICATIONS AND NETWORKS (CECNET), 2013, : 484 - 487
  • [27] Chinese word segmentation based on contextual entropy
    Huang, JH
    Powers, D
    PACLIC 17: Language, Information and Computation, Proceedings, 2003, : 152 - 158
  • [28] Video co-segmentation based on directed graph
    Yufeng Xie
    Zhi Liu
    Xiaofei Zhou
    Wei Liu
    Xuemei Zou
    Multimedia Tools and Applications, 2019, 78 : 10353 - 10372
  • [29] Video co-segmentation based on directed graph
    Xie, Yufeng
    Liu, Zhi
    Zhou, Xiaofei
    Liu, Wei
    Zou, Xuemei
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (08) : 10353 - 10372
  • [30] A trigram statistical language model algorithm for chinese word segmentation
    Mao, Jun
    Cheng, Gang
    He, Yanxiang
    Xing, Zehuan
    FRONTIERS IN ALGORITHMICS, PROCEEDINGS, 2007, 4613 : 271 - +
12345