Combined Self-Attention Mechanism for Chinese Named Entity Recognition in Military

被引:10
|
作者
Liao, Fei [1 ]
Ma, Liangli [1 ]
Pei, Jingjing [2 ]
Tan, Linshan [2 ]
机构
[1] Naval Univ Engn, Coll Elect Engn, Wuhan 430033, Hubei, Peoples R China
[2] Force 91001, Beijing 100841, Peoples R China
来源
FUTURE INTERNET | 2019年 / 11卷 / 08期
基金
中国国家自然科学基金;
关键词
military named entity recognition; self-attention mechanism; BiLSTM;
D O I
10.3390/fi11080180
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Military named entity recognition (MNER) is one of the key technologies in military information extraction. Traditional methods for the MNER task rely on cumbersome feature engineering and specialized domain knowledge. In order to solve this problem, we propose a method employing a bidirectional long short-term memory (BiLSTM) neural network with a self-attention mechanism to identify the military entities automatically. We obtain distributed vector representations of the military corpus by unsupervised learning and the BiLSTM model combined with the self-attention mechanism is adopted to capture contextual information fully carried by the character vector sequence. The experimental results show that the self-attention mechanism can improve effectively the performance of MNER task. The F-score of the military documents and network military texts identification was 90.15% and 89.34%, respectively, which was better than other models.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Chinese Clinical Named Entity Recognition with ALBERT and MHA Mechanism
    Li, Dongmei
    Long, Jiao
    Qu, Jintao
    Zhang, Xiaoping
    EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE, 2022, 2022
  • [42] Chinese Named Entity Recognition Method Combining ALBERT and a Local Adversarial Training and Adding Attention Mechanism
    Zhang Runmei
    Li Lulu
    Yin Lei
    Liu Jingjing
    Xu Weiyi
    Cao Weiwei
    Chen Zhong
    INTERNATIONAL JOURNAL ON SEMANTIC WEB AND INFORMATION SYSTEMS, 2022, 18 (01)
  • [43] Named entity recognition (NER) for Chinese agricultural diseases and pests based on discourse topic and attention mechanism
    Wang, Chao
    Gao, Jiale
    Rao, Haidi
    Chen, Aiwen
    He, Jin
    Jiao, Jun
    Zou, Nengfeng
    Gu, Lichuan
    EVOLUTIONARY INTELLIGENCE, 2024, 17 (01) : 457 - 466
  • [44] Named entity recognition (NER) for Chinese agricultural diseases and pests based on discourse topic and attention mechanism
    Chao Wang
    Jiale Gao
    Haidi Rao
    Aiwen Chen
    Jin He
    Jun Jiao
    Nengfeng Zou
    Lichuan Gu
    Evolutionary Intelligence, 2024, 17 : 457 - 466
  • [45] A Self-Attention-Based Approach for Named Entity Recognition in Cybersecurity
    Li, Tao
    Guo, Yuanbo
    Ju, Ankang
    2019 15TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS 2019), 2019, : 147 - 150
  • [46] Multi-neural network collaboration for Chinese military named entity recognition
    Yin X.
    Zhao H.
    Zhao J.
    Yao W.
    Huang Z.
    Qinghua Daxue Xuebao/Journal of Tsinghua University, 2020, 60 (08): : 648 - 655
  • [47] A Chinese named entity recognition method combined with relative position information
    Gan, Ling
    Huang, Chengming
    2021 ASIA-PACIFIC CONFERENCE ON COMMUNICATIONS TECHNOLOGY AND COMPUTER SCIENCE (ACCTCS 2021), 2021, : 250 - 254
  • [48] Chinese Governmental Named Entity Recognition
    Liu, Qi
    Wang, Dong
    Zhou, Meilin
    Li, Peng
    Qi, Baoyuan
    Bin Wang
    INFORMATION RETRIEVAL TECHNOLOGY (AIRS 2018), 2018, 11292 : 16 - 28
  • [49] A review of Chinese named entity recognition
    Cheng, Jieren
    Liu, Jingxin
    Xu, Xinbin
    Xia, Dongwan
    Liu, Le
    Sheng, Victor S.
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2021, 15 (06): : 2012 - 2030
  • [50] Chinese named entity recognition based on Heterogeneous Graph and Dynamic Attention Network
    Wang, Yuke
    Lu, Ling
    Yang, Wu
    Chen, Yinong
    2023 IEEE 15TH INTERNATIONAL SYMPOSIUM ON AUTONOMOUS DECENTRALIZED SYSTEM, ISADS, 2023, : 91 - 98