Shallow Parsing of Chinese Based on HMM Model

被引:0
|
作者
Zheng Weifa [1 ]
Xie Wenliang [1 ]
机构
[1] Guangdong Univ Business Studies, Informat Off, Guangzhou 510320, Peoples R China
关键词
HMM; Shallow Parsing; Natural Language Processing;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Complete parsing is difficult to meet the need of. precision and recall rate in Chinese. To address this problem, a new model for shallow parsing of Chinese is presented in this paper. We adopt Church theory and carry on Chinese phrases recognition based on HMM; improve the precision rate of sentences separation by improving the observance probabilities of HMM model and making use of the context information of the Chinese sentences. At the same time, by studying the rules of Chinese sentence, we extract some rules useful for ambiguity elimination. The experimental result indicates that the model based on HMM has high precision and recall rate.
引用
收藏
页码:79 / 86
页数:8
相关论文
共 50 条
  • [1] Shallow semantic parsing of Chinese
    Sun, H
    Jurafsky, D
    [J]. HLT-NAACL 2004: HUMAN LANGUAGE TECHNOLOGY CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE MAIN CONFERENCE, 2004, : 249 - 256
  • [2] Chinese shallow semantic parsing based on multilevel linguistic clues
    Wan, Fucheng
    Yang, Fangtao
    Wu, Tiantian
    Zhang, Dongjiao
    Zhang, Lei
    Wang, Yicheng
    [J]. JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2020, 20 (04) : 1063 - 1072
  • [3] Creation of topic map with shallow parsing in Chinese
    Yeh, CL
    Chen, YC
    [J]. Proceedings of the 2005 IEEE International Conference on Information Reuse and Integration, 2005, : 61 - 65
  • [4] A Sparse Protocol Parsing Method for IIoT Protocols Based on HMM hybrid model
    He, Yunhua
    Shen, Jialong
    Xiao, Ke
    Sood, Keshav
    Wang, Chao
    Sun, Limin
    [J]. ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [5] Chinese Shallow Semantic Parsing Based on Multi-method of Machine Learning
    Wan, Fucheng
    He, Xiangzhen
    Zhang, Dongjiao
    Qi, Guo
    Zhu, Ao
    Lei, Zhang
    Zenan, Ning
    Yicheng, Wang
    [J]. JOURNAL OF WEB ENGINEERING, 2020, 19 (5-6): : 685 - 706
  • [6] Chinese Dependency Parsing Based on An Improved Model of MST
    Qi, Sun
    Yang, Xiang
    Xiao, Tu
    [J]. PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON ELECTRONICS, NETWORK AND COMPUTER ENGINEERING (ICENCE 2016), 2016, 67 : 9 - 14
  • [7] Chinese shallow parsing using different phase systems
    Tan, YM
    Zhong, YX
    [J]. Proceedings of the 2005 IEEE International Conference on Natural Language Processing and Knowledge Engineering (IEEE NLP-KE'05), 2005, : 272 - 276
  • [8] Shallow semantic parsing for lexical units in Chinese FrameNet
    Hao Xiaoyan
    Chang Xiaoming
    Liu Kaiying
    [J]. 2008 FOURTH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION HIDING AND MULTIMEDIA SIGNAL PROCESSING, PROCEEDINGS, 2008, : 867 - +
  • [9] Applying conditional random fields to chinese shallow parsing
    Tan, YM
    Yao, TS
    Chen, Q
    Zhu, JB
    [J]. COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, 2005, 3406 : 167 - 176
  • [10] Applying support vector machines to Chinese shallow parsing
    Guo, Yongsheng
    Tan, Yongmei
    [J]. PROCEEDINGS OF THE 2007 IEEE INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING AND KNOWLEDGE ENGINEERING (NLP-KE'07), 2007, : 468 - +