Combined Self-Attention Mechanism for Chinese Named Entity Recognition in Military

被引:10
|
作者
Liao, Fei [1 ]
Ma, Liangli [1 ]
Pei, Jingjing [2 ]
Tan, Linshan [2 ]
机构
[1] Naval Univ Engn, Coll Elect Engn, Wuhan 430033, Hubei, Peoples R China
[2] Force 91001, Beijing 100841, Peoples R China
来源
FUTURE INTERNET | 2019年 / 11卷 / 08期
基金
中国国家自然科学基金;
关键词
military named entity recognition; self-attention mechanism; BiLSTM;
D O I
10.3390/fi11080180
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Military named entity recognition (MNER) is one of the key technologies in military information extraction. Traditional methods for the MNER task rely on cumbersome feature engineering and specialized domain knowledge. In order to solve this problem, we propose a method employing a bidirectional long short-term memory (BiLSTM) neural network with a self-attention mechanism to identify the military entities automatically. We obtain distributed vector representations of the military corpus by unsupervised learning and the BiLSTM model combined with the self-attention mechanism is adopted to capture contextual information fully carried by the character vector sequence. The experimental results show that the self-attention mechanism can improve effectively the performance of MNER task. The F-score of the military documents and network military texts identification was 90.15% and 89.34%, respectively, which was better than other models.
引用
收藏
页数:11
相关论文
共 50 条
  • [11] MLSAN: Mixed-Lattice Self-Attention Network for Chinese Named Entity Recognition
    He, Zongfeng
    Wang, Lisong
    Sheng, Tianye
    Sun, Mingjie
    Liu, Liang
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 1436 - 1442
  • [12] Recognition of Chinese Agricultural Diseases and Pests Named Entity with Joint Radical-embedding and Self-attention Mechanism
    Guo X.
    Tang Z.
    Diao L.
    Zhou H.
    Li L.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2020, 51 : 335 - 343
  • [13] Combined Attention Mechanism for Named Entity Recognition in Chinese Electronic Medical Records
    Li, Luqi
    Hou, Li
    2019 IEEE INTERNATIONAL CONFERENCE ON HEALTHCARE INFORMATICS (ICHI), 2019, : 476 - 477
  • [14] Chinese named-entity recognition via self-attention mechanism and position-aware influence propagation embedding
    Zhang, Bo
    Liu, Kehao
    Wang, Haowen
    Li, Maozhen
    Pan, Jianguo
    DATA & KNOWLEDGE ENGINEERING, 2022, 139
  • [15] SELF-ATTENTION BASED DARKNET NAMED ENTITY RECOGNITION WITH BERT METHODS
    Chen, Yuxuan
    Guo, Yubin
    Jiang, Hong
    Ding, Jianwei
    Chen, Zhouguo
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2021, 17 (06): : 1973 - 1988
  • [16] Named Entity Recognition of Chinese Text Based on Attention Mechanism
    Shen, Tong-Ping
    Dumlao, Menchita
    Meng, Qing-Quan
    Zhan, Zhong-Hua
    Journal of Network Intelligence, 2023, 8 (02): : 505 - 518
  • [17] Chinese agricultural diseases and pests named entity recognition with multi-scale local context features and self-attention mechanism
    Guo, Xuchao
    Zhou, Han
    Su, Jie
    Hao, Xia
    Tang, Zhan
    Diao, Lei
    Li, Lin
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 179
  • [18] Named Entity Recognition of Hazardous Chemical Risk Information Based on Multihead Self-Attention Mechanism and BERT
    Chen, Guanlin
    Cheng, Zhao
    Lu, Qi
    Weng, Wenyong
    Yang, Wujian
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [19] Named Entity Recognition in Persian Language based on Self-attention Mechanism with Weighted Relational Position Encoding
    Ganjalipour, Ebrahim
    Sheikhani, Amir Hossein Refahi
    Kordrostami, Sohrab
    Hosseinzadeh, Ali Asghar
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (12)
  • [20] Uniting Multi-Scale Local Feature Awareness and the Self-Attention Mechanism for Named Entity Recognition
    Shi, Lin
    Zou, Xianming
    Dai, Chenxu
    Ji, Zhanlin
    MATHEMATICS, 2023, 11 (11)