Word sense disambiguation based on maximum entropy classifier

被引:0
|
作者
Zhang C. [1 ]
Zhou X. [2 ]
Gao X. [2 ]
Yu B. [1 ]
机构
[1] School of Software and Microelectronics, Harbin University of Science and Technology, Harbin
[2] School of Computer Science and Technology, Harbin University of Science and Technology, Harbin
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Discriminative features; Maximum entropy classifier; Natural language processing; Semantic category; Word sense disambiguation;
D O I
10.23940/ijpe.19.05.p26.14911498
中图分类号
学科分类号
摘要
Word sense disambiguation (WSD) is one of the most important research issues in the field of natural language processing. In this paper, a new method of word sense disambiguation is proposed, in which words and parts of speech (POS) are extracted as discriminative features. At the same time, a maximum entropy classifier is adopted to determine ambiguous words' semantic categories. Training data of SemEval-2007: Task#5 is used to optimize the maximum entropy model. A test corpus is applied to test the performance of the WSD classifier. Experimental results show that the performance of word sense disambiguation is improved after the proposed approach is used. © 2019 Totem Publisher, Inc. All rights reserved.
引用
收藏
页码:1491 / 1498
页数:7
相关论文
共 50 条
  • [21] Similarity-based word sense disambiguation
    Karov, Y
    Edelman, S
    COMPUTATIONAL LINGUISTICS, 1998, 24 (01) : 41 - 59
  • [22] Memory-Based Word Sense Disambiguation
    Jorn Veenstra
    Antal van den Bosch
    Sabine Buchholz
    Walter Daelemans
    akub Zavrel
    Computers and the Humanities, 2000, 34 : 171 - 177
  • [23] Word Sense Disambiguation Based on Vicarious Words
    Lu, Zhimao
    Fan, DongMei
    Zhang, Rubo
    ICNC 2008: FOURTH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, VOL 6, PROCEEDINGS, 2008, : 101 - 105
  • [24] Sense Space for Word Sense Disambiguation
    Kang, Myung Yun
    Min, Tae Hong
    Lee, Jae Sung
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2018, : 669 - 672
  • [25] The Research of Chinese Name Entity Disambiguation Based On Word Sense Disambiguation
    Wang, Gang
    PROCEEDINGS OF THE 2014 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ELECTRONIC TECHNOLOGY, 2015, 6 : 412 - 416
  • [26] Unsupervised Word Sense Disambiguation based on Word Embedding and Collocation
    Han, Shangzhuang
    Shirai, Kiyoaki
    ICAART: PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE - VOL 2, 2021, : 1218 - 1225
  • [27] Word clustering for collocation-based word sense disambiguation
    Jin, Peng
    Sun, Xu
    Wu, Yunfang
    Yu, Shiwen
    COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, 2007, 4394 : 267 - +
  • [28] Semi-supervised learning integrated with classifier combination for word sense disambiguation
    Le, Anh-Cuong
    Shimazu, Akira
    Huynh, Van-Nam
    Nguyen, Le-Minh
    COMPUTER SPEECH AND LANGUAGE, 2008, 22 (04): : 330 - 345
  • [29] Word sense disambiguation methods
    Turdakov, D. Yu.
    PROGRAMMING AND COMPUTER SOFTWARE, 2010, 36 (06) : 309 - 326
  • [30] Practice of Word Sense Disambiguation
    Sieminski, Andrzej
    INTELLIGENT INFORMATION AND DATABASE SYSTEMS, ACIIDS 2018, PT I, 2018, 10751 : 159 - 169