Medical Entity Recognition Based on BiLSTM with Knowledge Graph and Attention Mechanism

被引:3
|
作者
Wang, Qiaoling [1 ]
Liu, Yu [1 ]
Gu, Jinguang [1 ]
Fu, Haidong [1 ]
机构
[1] Wuhan Univ Sci & Technol, Dept Comp Sci & Technol, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
Internet medical consultation text; named entity recognition; deep neural network; attention mechanism; knowledge graph;
D O I
10.1109/ICoIAS53694.2021.00035
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Considering the characteristics of non-standard expression in Internet text, some information extraction models have employed knowledge graphs of different areas to improve entity recognition performance. However, these existing models merely use background knowledge in a single step, which leads to insufficient use of additional clues in the knowledge graph. Aiming at the above problems, this paper proposes a new entity recognition model based on BiLSTM with knowledge graph and attention mechanism and applies the model to extract medical entities from Internet medical consultation text. The model extracts the conceptual features and candidate knowledge sets from the medical knowledge graph. The encoded concept features are embedded into the input of BiLSTM to enhance the semantic expression of words. Furthermore, the candidate knowledge sets are integrated into the attention mechanism to capture the important information in the knowledge graph and context. To verify the effectiveness of the model, we extracted medical named entities from the consultation text of Haodafu. Experimental results show that the proposed model can effectively improve the performance of entity recognition tasks.
引用
收藏
页码:149 / 157
页数:9
相关论文
共 50 条
  • [41] Ontology Attention Layer for Medical Named Entity Recognition
    Zha, Yue
    Ke, Yuanzhi
    Hu, Xiao
    Xiong, Caiquan
    APPLIED SCIENCES-BASEL, 2024, 14 (01):
  • [42] An attention-based BiLSTM-CRF approach to document-level chemical named entity recognition
    Luo, Ling
    Yang, Zhihao
    Yang, Pei
    Zhang, Yin
    Wang, Lei
    Lin, Hongfei
    Wang, Jian
    BIOINFORMATICS, 2018, 34 (08) : 1381 - 1388
  • [43] Incorporating Graph Attention Mechanism into Knowledge Graph Reasoning Based on Deep Reinforcement Learning
    Wang, Heng
    Li, Shuangyin
    Pan, Rong
    Mao, Mingzhi
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 2623 - 2631
  • [44] Named Entity Recognition in Electric Power Metering Domain Based on Attention Mechanism
    Zheng, Kaihong
    Sun, Lingyun
    Wang, Xin
    Zhou, Shangli
    Li, Hanbin
    Li, Sheng
    Zeng, Lukun
    Gong, Qihang
    IEEE ACCESS, 2021, 9 : 152564 - 152573
  • [45] Research on Named Entity Recognition Method of Metro On-Board Equipment Based on Multiheaded Self-Attention Mechanism and CNN-BiLSTM-CRF
    Lin, Junting
    Liu, Endong
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [46] Neural Collaborative Recommendation Algorithm Based on Attention Mechanism and Knowledge Graph
    Zhang, Chuang
    Wang, Wei
    Du, Yuxuan
    Zheng, Xiaoli
    He, Tingting
    Computer Engineering and Applications, 2023, 59 (22) : 111 - 120
  • [47] A deep embedding model for knowledge graph completion based on attention mechanism
    Jin Huang
    TingHua Zhang
    Jia Zhu
    Weihao Yu
    Yong Tang
    Yang He
    Neural Computing and Applications, 2021, 33 : 9751 - 9760
  • [48] A deep embedding model for knowledge graph completion based on attention mechanism
    Huang, Jin
    Zhang, TingHua
    Zhu, Jia
    Yu, Weihao
    Tang, Yong
    He, Yang
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (15): : 9751 - 9760
  • [49] Graph Attention Mechanism with Cardinality Preservation for Knowledge Graph Completion
    Ding, Cong
    Wei, Xiao
    Chen, Yongqi
    Zhao, Rui
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I, 2021, 12815 : 479 - 490
  • [50] Disease Prediction Model Based on BiLSTM and Attention Mechanism
    Yang, Yang
    Zheng, Xiangwei
    Ji, Cun
    2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 1141 - 1148