Combined Self-Attention Mechanism for Chinese Named Entity Recognition in Military

被引:10
|
作者
Liao, Fei [1 ]
Ma, Liangli [1 ]
Pei, Jingjing [2 ]
Tan, Linshan [2 ]
机构
[1] Naval Univ Engn, Coll Elect Engn, Wuhan 430033, Hubei, Peoples R China
[2] Force 91001, Beijing 100841, Peoples R China
来源
FUTURE INTERNET | 2019年 / 11卷 / 08期
基金
中国国家自然科学基金;
关键词
military named entity recognition; self-attention mechanism; BiLSTM;
D O I
10.3390/fi11080180
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Military named entity recognition (MNER) is one of the key technologies in military information extraction. Traditional methods for the MNER task rely on cumbersome feature engineering and specialized domain knowledge. In order to solve this problem, we propose a method employing a bidirectional long short-term memory (BiLSTM) neural network with a self-attention mechanism to identify the military entities automatically. We obtain distributed vector representations of the military corpus by unsupervised learning and the BiLSTM model combined with the self-attention mechanism is adopted to capture contextual information fully carried by the character vector sequence. The experimental results show that the self-attention mechanism can improve effectively the performance of MNER task. The F-score of the military documents and network military texts identification was 90.15% and 89.34%, respectively, which was better than other models.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Combined self-attention mechanism for named entity recognition in social media
    Li M.
    Kong F.
    Qinghua Daxue Xuebao/Journal of Tsinghua University, 2019, 59 (06): : 461 - 467
  • [2] Adversarial Transfer Learning for Chinese Named Entity Recognition with Self-Attention Mechanism
    Cao, Pengfei
    Chen, Yubo
    Liu, Kang
    Zhao, Jun
    Liu, Shengping
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 182 - 192
  • [3] Neural Named Entity Recognition Using a Self-Attention Mechanism
    Zukov-Gregoric, Andrej
    Bachrach, Yoram
    Minkovsky, Pasha
    Coope, Sam
    Maksak, Bogdan
    2017 IEEE 29TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2017), 2017, : 652 - 656
  • [4] Chinese clinical named entity recognition with radical-level feature and self-attention mechanism
    Yin, Mingwang
    Mou, Chengjie
    Xiong, Kaineng
    Ren, Jiangtao
    JOURNAL OF BIOMEDICAL INFORMATICS, 2019, 98
  • [5] A self-attention based neural architecture for Chinese medical named entity recognition
    Wan, Qian
    Liu, Jie
    Wei, Luona
    Ji, Bin
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2020, 17 (04) : 3498 - 3511
  • [6] Named Entity Recognition of BERT-BiLSTM-CRF Combined with Self-attention
    Xu, Lei
    Li, Shuang
    Wang, Yuchen
    Xu, Lizhen
    WEB INFORMATION SYSTEMS AND APPLICATIONS (WISA 2021), 2021, 12999 : 556 - 564
  • [7] Joint Self-Attention and Multi-Embeddings for Chinese Named Entity Recognition
    Song, Cijian
    Xiong, Yan
    Huang, Wenchao
    Ma, Lu
    2020 6TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS (BIGCOM 2020), 2020, : 76 - 80
  • [8] Fast Neural Chinese Named Entity Recognition with Multi-head Self-attention
    Qi, Tao
    Wu, Chuhan
    Wu, Fangzhao
    Ge, Suyu
    Liu, Junxin
    Huang, Yongfeng
    Xie, Xing
    KNOWLEDGE GRAPH AND SEMANTIC COMPUTING: KNOWLEDGE COMPUTING AND LANGUAGE UNDERSTANDING, 2019, 1134 : 98 - 110
  • [9] Named entity recognition for Chinese marine text with knowledge-based self-attention
    He, Shufeng
    Sun, Dianqi
    Wang, Zhao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (14) : 19135 - 19149
  • [10] Named entity recognition for Chinese marine text with knowledge-based self-attention
    Shufeng He
    Dianqi Sun
    Zhao Wang
    Multimedia Tools and Applications, 2022, 81 : 19135 - 19149