Combined Self-Attention Mechanism for Chinese Named Entity Recognition in Military

被引:10
|
作者
Liao, Fei [1 ]
Ma, Liangli [1 ]
Pei, Jingjing [2 ]
Tan, Linshan [2 ]
机构
[1] Naval Univ Engn, Coll Elect Engn, Wuhan 430033, Hubei, Peoples R China
[2] Force 91001, Beijing 100841, Peoples R China
来源
FUTURE INTERNET | 2019年 / 11卷 / 08期
基金
中国国家自然科学基金;
关键词
military named entity recognition; self-attention mechanism; BiLSTM;
D O I
10.3390/fi11080180
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Military named entity recognition (MNER) is one of the key technologies in military information extraction. Traditional methods for the MNER task rely on cumbersome feature engineering and specialized domain knowledge. In order to solve this problem, we propose a method employing a bidirectional long short-term memory (BiLSTM) neural network with a self-attention mechanism to identify the military entities automatically. We obtain distributed vector representations of the military corpus by unsupervised learning and the BiLSTM model combined with the self-attention mechanism is adopted to capture contextual information fully carried by the character vector sequence. The experimental results show that the self-attention mechanism can improve effectively the performance of MNER task. The F-score of the military documents and network military texts identification was 90.15% and 89.34%, respectively, which was better than other models.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Chinese Named Entity Recognition Methods Combined with Entity Boundary Cues
    Huang, Rong
    Chen, Yanping
    Hu, Ying
    Huang, Ruizhang
    Qin, Yongbin
    Computer Engineering and Applications, 2024, 60 (06) : 199 - 206
  • [32] A Korean named entity recognition method using Bi-LSTM-CRF and masked self-attention
    Jin, Guozhe
    Yu, Zhezhou
    Yu, Zhezhou (yuzz@jlu.edu.cn), 1600, Academic Press (65):
  • [33] A Korean named entity recognition method using Bi-LSTM-CRF and masked self-attention
    Jin, Guozhe
    Yu, Zhezhou
    COMPUTER SPEECH AND LANGUAGE, 2021, 65
  • [34] Named Entity Recognition Using EHealth-BiLSTM-CRF Combine with Multi-head Self-attention for Chinese Medical Information
    Wang, Bin
    Jiang, Fangjiao
    WEB INFORMATION SYSTEMS AND APPLICATIONS, WISA 2024, 2024, 14883 : 451 - 462
  • [35] Named entity recognition of Chinese electronic medical records based on multifeature embedding and attention mechanism
    Gong D.-W.
    Zhang Y.-K.
    Guo Y.-N.
    Wang B.
    Fan K.-L.
    Huo Y.
    Gongcheng Kexue Xuebao/Chinese Journal of Engineering, 2021, 43 (09): : 1190 - 1196
  • [36] Incorporating multi-level CNN and attention mechanism for Chinese clinical named entity recognition
    Kong, Jun
    Zhang, Leixin
    Jiang, Min
    Liu, Tianshan
    JOURNAL OF BIOMEDICAL INFORMATICS, 2021, 116 (116)
  • [37] Research on Named Entity Recognition Method of Metro On-Board Equipment Based on Multiheaded Self-Attention Mechanism and CNN-BiLSTM-CRF
    Lin, Junting
    Liu, Endong
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [38] Incorporating word⁃set attention into Chinese named entity recognition Method
    Zhong S.-S.
    Chen X.
    Zhao M.-H.
    Zhang Y.-J.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2022, 52 (05): : 1098 - 1105
  • [39] Based on Stacked Attention Network for Chinese Medical Named Entity Recognition
    Gu, Tao (GUTAObjut@outlook.com), 1600, Institute of Electrical and Electronics Engineers Inc.
  • [40] Based on stacked attention network for Chinese medical named entity recognition
    Gu, Tao
    Zhu, ZhiChao
    Zhao, Qing
    2024 IEEE 48TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE, COMPSAC 2024, 2024, : 2032 - 2037