Research on Modern Chinese Multi-category Words Part of Speech Tagging Based on Hidden Markov Model

被引:0
|
作者
Song, Zhendong [1 ]
机构
[1] Heilongjiang Univ, Informat Sci & Technol Inst, Harbin, Peoples R China
来源
PROCEEDINGS OF THE 2014 INTERNATIONAL CONFERENCE ON MECHATRONICS, ELECTRONIC, INDUSTRIAL AND CONTROL ENGINEERING | 2014年 / 5卷
关键词
Computer systems; Chinese information processing; Multi-category words; Part of speech tagging; Hidden Markov Model;
D O I
暂无
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In recent years, computer systems are widely used in the modern Chinese part of speech tagging. Modern Chinese part of speech tagging is a basic subject in the natural language processing. It is widely used in machine translation, natural language understanding, establishing of the Chinese corpus, information retrieval, text classification, text proofreading and speech recognition, among others. In the part of speech tagging, multi-category words part of speech (POS) tagging is always a difficulty. Although the total number of multi-category words in the modern Chinese is not high, the usage is fairly widespread. This paper, proposes an algorithm of multi-category words part of speech tagging. First, it is word segmentation according to the traditional method. And then, on this basis, we introduce a method based on the rules of multi-category words part of speech tagging. Finally, a detailed description of the Hidden Markov Model (HMM) used in the words part of speech tagging, and a statistical algorithm based on Hidden Markov Model.
引用
收藏
页码:393 / 397
页数:5
相关论文
共 50 条
  • [21] Improved hidden Markov model for speech recognition and POS tagging
    Yuan Li-chi
    JOURNAL OF CENTRAL SOUTH UNIVERSITY, 2012, 19 (02) : 511 - 516
  • [22] Multi-category micro-milling tool wear monitoring with continuous hidden Markov models
    Zhu, Kunpeng
    Wong, Yoke San
    Hong, Geok Soon
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2009, 23 (02) : 547 - 560
  • [23] Research on the model of integrating Chinese word segmentation with part-of-speech tagging
    Tong, Xiaojun
    Cui, Minggen
    Song, Guolong
    DCABES 2007 Proceedings, Vols I and II, 2007, : 1062 - 1065
  • [24] A Comparative Study of Hidden Markov Model and Conditional Random Fields on a Yoruba Part-of-Speech Tagging Task
    Ayogu, Ikechukwu I.
    Adetunmbi, Adebayo O.
    Ojokoh, Bolanle A.
    Oluwadare, Samuel A.
    PROCEEDINGS OF THE IEEE INTERNATIONAL CONFERENCE ON COMPUTING NETWORKING AND INFORMATICS (ICCNI 2017), 2017,
  • [25] Part-of-speech Tagging and Named Entity Recognition Using Improved Hidden Markov Model and Bloom Filter
    Ankita
    Nazeer, K. A. Abdul
    2018 INTERNATIONAL CONFERENCE ON COMPUTING, POWER AND COMMUNICATION TECHNOLOGIES (GUCON), 2018, : 1072 - 1077
  • [26] An Effective Resolution Method of Chinese Multi-category Words with Conditional Random Field in Electronic Commerce
    Fei, Fan
    Yang, Yanqin
    Xu, Wenchao
    Yang, Yanfeng
    NEURAL INFORMATION PROCESSING, PT II, 2015, 9490 : 562 - 570
  • [27] A Hybrid Method of Chinese Prosodic Word Tagging Based on Keyword Anchor and Hidden Markov Model
    Zhou Quan
    Deng Pan
    Liu Hongjian
    Guo Defeng
    Kenji, Nagamatsu
    2009 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING, 2009, : 71 - 75
  • [28] The Application of Hidden Markov Model based on Semantic Case Amelioration in Chinese Word Sense Tagging
    Fang, Hao
    Ding, Yimin
    Yang, Min
    SECOND INTERNATIONAL CONFERENCE ON GENETIC AND EVOLUTIONARY COMPUTING: WGEC 2008, PROCEEDINGS, 2008, : 340 - +
  • [29] Study on Chinese Question Classification Based on SVM Multi-category Classification
    Zhang Wei
    Duan Liguo
    Chen Junjie
    FOURTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2011): MACHINE VISION, IMAGE PROCESSING, AND PATTERN ANALYSIS, 2012, 8349
  • [30] A Hidden Markov Model for Morphology of Compound Roles in Persian Text Part of Tagging
    Rezaei, H.
    Motameni, H.
    Barzegar, B.
    INTERNATIONAL JOURNAL OF ENGINEERING, 2021, 34 (11): : 2494 - 2506