Method of Chinese Named Entity Recognition Based on Maximum Entropy Model

被引:3
|
作者
Ning Hui [1 ]
Yang Hua [1 ]
Tan Ya-zhou [1 ]
Wu Hao [1 ]
机构
[1] Harbin Engn Univ Harbin, Comp Sci & Technol Coll, Harbin, Peoples R China
关键词
Chinese Named Entity; Maximum Entropy Model; Semantic Expansion;
D O I
10.1109/ICMA.2009.5246408
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There are many connotative semantic features in Chinese which can help Chinese named entity recognition. Moreover, one of the important strongpoint of maximum entropy model is that it can syncretize features in different granularity and level. With that in mind, many Chinese named entity semantic knowledge bases were established by extracting information from corpus in this paper. However, because of the limitation of corpus's size and data sparse which occurs universally in statistic-based method, much significant information can't be extracted. In order to resolve this problem, in this thesis the idea of semantic expansion is applied in named entity recognition field. It is validated by experiment that relative to using unexpanded knowledge base average recall is increased by 1.17%, and F value is increased by 0.41%. Especially, the precision, recall and F value of complicated organization name recognition is increased by 0.24%, 1.39% and 0.86% respectively.
引用
收藏
页码:2472 / 2477
页数:6
相关论文
共 50 条
  • [1] A probabilistic feature based Maximum Entropy model for Chinese named entity recognition
    Zhang, Suxiang
    Wang, Xiaojie
    Wen, Juan
    Qin, Ying
    Zhong, Yixin
    [J]. COMPUTER PROCESSING OF ORIENTAL LANGUAGES, PROCEEDINGS: BEYOND THE ORIENT: THE RESEARCH CHALLENGES AHEAD, 2006, 4285 : 189 - +
  • [2] Improving feature extraction in named entity recognition based on maximum entropy model
    Jiang, Wei
    Guan, Yi
    Wang, Xiao-Long
    [J]. PROCEEDINGS OF 2006 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2006, : 2630 - +
  • [3] A Method of Chinese Tourism Named Entity Recognition Based on BBLC Model
    Xue, Leyi
    Cao, Han
    Ye, Fan
    Qin, Yuehua
    [J]. 2019 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI 2019), 2019, : 1722 - 1727
  • [4] ANERsys: An Arabic Named Entity Recognition system based on maximum entropy
    Benajiba, Yassine
    Rosso, Paolo
    Ruiz, Jose Miguel Benedi
    [J]. COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, 2007, 4394 : 143 - +
  • [5] Maximum Entropy Named Entity Recognition for Czech Language
    Konkol, Michal
    Konopik, Miloslav
    [J]. TEXT, SPEECH AND DIALOGUE, TSD 2011, 2011, 6836 : 203 - 210
  • [6] Hungarian named entity recognition with a maximum entropy approach
    Varga, Daniel
    Simon, Eszter
    [J]. ACTA CYBERNETICA, 2007, 18 (02): : 293 - 301
  • [7] Maximum Entropy-Based Named Entity Recognition Method for Multiple Social Networking Services
    Jung, Jason J.
    [J]. JOURNAL OF INTERNET TECHNOLOGY, 2012, 13 (06): : 931 - 937
  • [8] Chinese named entity recognition model based on BERT
    Liu, Hongshuai
    Jun, Ge
    Zheng, Yuanyuan
    [J]. 2020 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE COMMUNICATION AND NETWORK SECURITY (CSCNS2020), 2021, 336
  • [9] Early results for chinese named entity recognition using conditional random fields model, HMM and maximum entropy
    Feng, YY
    Sun, L
    Zhang, JL
    [J]. PROCEEDINGS OF THE 2005 IEEE INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING AND KNOWLEDGE ENGINEERING (IEEE NLP-KE'05), 2005, : 549 - 552
  • [10] Multiobjective Approach for Feature Selection in Maximum Entropy based Named Entity Recognition
    Ekbal, Asif
    Saha, Sriparna
    Hasanuzzaman, Md
    [J]. 22ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2010), PROCEEDINGS, VOL 1, 2010,