A Simple and Effective Neural Model for Joint Word Segmentation and POS Tagging

被引:32
|
作者
Zhang, Meishan [1 ]
Yu, Nan [1 ]
Fu, Guohong [1 ]
机构
[1] Heilongjiang Univ, Sch Comp Sci & Technol, Harbin 150080, Heilongjiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Chinese word segmentation; POS tagging; joint model; neural networks; transition system;
D O I
10.1109/TASLP.2018.2830117
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Joint models have shown stronger capabilities for Chinese word segmentation and POS tagging, and have received great interests in the community of Chinese natural language processing. In this paper, we follow this line of work, presenting a simple yet effective sequence-to-sequence neural model for the joint task, based on a well-defined transition system, by using long short term memory neural network structures. We conduct experiments on five different datasets. The results demonstrate that our proposed model is highly competitive. By using well-trained character-level embeddings, the proposed neural joint model is able to obtain the best-reported performances in the literature.
引用
收藏
页码:1528 / 1538
页数:11
相关论文
共 50 条
  • [1] An Effective Joint Model for Chinese Word Segmentation and POS Tagging
    Wang, Heng-Jun
    Si, Nian-Wen
    Chen, Cheng
    [J]. PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION PROCESSING (ICIIP'16), 2016,
  • [2] A Neural Joint Model with BERT for Burmese Syllable Segmentation, Word Segmentation, and POS Tagging
    Mao, Cunli
    Man, Zhibo
    Yu, Zhengtao
    Gao, Shengxiang
    Wang, Zhenhan
    Wang, Hongbin
    [J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2021, 20 (04)
  • [3] Joint Word Segmentation, POS-Tagging and Syntactic Chunking
    Lyu, Chen
    Zhang, Yue
    Ji, Donghong
    [J]. THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 3007 - 3014
  • [4] A Fine-Grained Domain Adaption Model for Joint Word Segmentation and POS Tagging
    Jiang, Peijie
    Long, Dingkun
    Sun, Yueheng
    Zhang, Meishan
    Xu, Guangwei
    Xie, Pengjun
    [J]. 2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 3587 - 3598
  • [5] A Unified Model for Joint Chinese Word Segmentation and POS Tagging with Heterogeneous Annotation Corpora
    Zhao, Jiayi
    Qiu, Xipeng
    Huang, Xuanjing
    [J]. 2013 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP 2013), 2013, : 227 - 230
  • [6] Bidirectional Deep Learning of Context Representation for Joint Word Segmentation and POS Tagging
    Boonkwan, Prachya
    Supnithi, Thepchai
    [J]. ADVANCED COMPUTATIONAL METHODS FOR KNOWLEDGE ENGINEERING, ICCSAMA 2017, 2018, 629 : 184 - 196
  • [7] Joint Chinese word segmentation and POS tagging system with undirected graphical models
    Zhu C.-H.
    Zhao T.-J.
    Zheng D.-Q.
    [J]. Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2010, 32 (03): : 700 - 704
  • [8] A hybrid approach to word segmentation and POS tagging
    Oki Electric Industry Co., Ltd., 2−5−7 Honmachi, Chuo-ku, Osaka
    541−0053, Japan
    不详
    619−0289, Japan
    [J]. Proc. Annu. Meet. Assoc. Comput Linguist., 1600, (217-220):
  • [9] Simple semi-supervised learning for chinese word segmentation and pos tagging
    Li, Xinxin
    Wang, Xuan
    Waqas, Muhammad
    Harbin, Anwar
    [J]. Information Technology Journal, 2013, 12 (20) : 5955 - 5961
  • [10] Joint Chinese Word Segmentation and POS Tagging Using an Error-Driven Word-Character Hybrid Model
    Kruengkrai, Canasai
    Uchimoto, Kiyotaka
    Kazama, Jun'ichi
    Wang, Yiou
    Torisawa, Kentaro
    Isahara, Hitoshi
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2009, E92D (12) : 2298 - 2305