Named entity recognition for Chinese marine text with knowledge-based self-attention

被引:0
|
作者
Shufeng He
Dianqi Sun
Zhao Wang
机构
[1] China Geological Survey,Qingdao Institute of Marine Geology
来源
关键词
Chinese named entity recognition; Self-attention mechanism; Knowledge graph;
D O I
暂无
中图分类号
学科分类号
摘要
Chinese named entity recognition has been widely used in many fields, such as species recognition in marine information, and so on. Compared with the standard named entity recognition (NER), the performance of the Chinese marine named entity recognition is low, which is mainly limited by the normative nature of the text and the scale of the tagged corpus. In recent years, the research of named entity recognition primarily focuses on the small scale of the tagged corpus. It tends to use external knowledge or use joint training to improve final recognition performance. However, there is little research on the problem that the accuracy of NER will be suboptimal if the model is trained inadequately. To this end, in order to improve the accuracy of naming entity recognition and recognize more entities in corpus, this paper proposes a named entity recognition method that combines knowledge graph embedding with a self-attention mechanism. The entity embeddings of the marine knowledge graph (KG) are empolyed for the hidden units of NER model with attention mechanism in an end-to-end way. Therefore, the model can get additional auxiliary information to improve performance. Lastly, we conduct extensive experiments on marine corpus and other public datasets. The experimental results verify the effectiveness of our proposed method.
引用
收藏
页码:19135 / 19149
页数:14
相关论文
共 50 条
  • [1] Named entity recognition for Chinese marine text with knowledge-based self-attention
    He, Shufeng
    Sun, Dianqi
    Wang, Zhao
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (14) : 19135 - 19149
  • [2] A self-attention based neural architecture for Chinese medical named entity recognition
    Wan, Qian
    Liu, Jie
    Wei, Luona
    Ji, Bin
    [J]. MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2020, 17 (04) : 3498 - 3511
  • [3] Combined Self-Attention Mechanism for Chinese Named Entity Recognition in Military
    Liao, Fei
    Ma, Liangli
    Pei, Jingjing
    Tan, Linshan
    [J]. FUTURE INTERNET, 2019, 11 (08):
  • [4] Named Entity Recognition of Chinese Text Based on Attention Mechanism
    Shen, Tong-Ping
    Dumlao, Menchita
    Meng, Qing-Quan
    Zhan, Zhong-Hua
    [J]. Journal of Network Intelligence, 2023, 8 (02): : 505 - 518
  • [5] Joint Self-Attention and Multi-Embeddings for Chinese Named Entity Recognition
    Song, Cijian
    Xiong, Yan
    Huang, Wenchao
    Ma, Lu
    [J]. 2020 6TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS (BIGCOM 2020), 2020, : 76 - 80
  • [6] Adversarial Transfer Learning for Chinese Named Entity Recognition with Self-Attention Mechanism
    Cao, Pengfei
    Chen, Yubo
    Liu, Kang
    Zhao, Jun
    Liu, Shengping
    [J]. 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 182 - 192
  • [7] SELF-ATTENTION BASED DARKNET NAMED ENTITY RECOGNITION WITH BERT METHODS
    Chen, Yuxuan
    Guo, Yubin
    Jiang, Hong
    Ding, Jianwei
    Chen, Zhouguo
    [J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2021, 17 (06): : 1973 - 1988
  • [8] Named Entity Recognition of Chinese Agricultural Text Based on Attention Mechanism
    Zhao, Pengfei
    Zhao, Chunjiang
    Wu, Huarui
    Wang, Wei
    [J]. Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2021, 52 (01): : 185 - 192
  • [9] MLSAN: Mixed-Lattice Self-Attention Network for Chinese Named Entity Recognition
    He, Zongfeng
    Wang, Lisong
    Sheng, Tianye
    Sun, Mingjie
    Liu, Liang
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 1436 - 1442
  • [10] Fast Neural Chinese Named Entity Recognition with Multi-head Self-attention
    Qi, Tao
    Wu, Chuhan
    Wu, Fangzhao
    Ge, Suyu
    Liu, Junxin
    Huang, Yongfeng
    Xie, Xing
    [J]. KNOWLEDGE GRAPH AND SEMANTIC COMPUTING: KNOWLEDGE COMPUTING AND LANGUAGE UNDERSTANDING, 2019, 1134 : 98 - 110