Application of Entity-BERT model based on neuroscience and brain-like cognition in electronic medical record entity recognition

被引:3
|
作者
Lu, Weijia [1 ,2 ]
Jiang, Jiehui [3 ]
Shi, Yaxiang [4 ]
Zhong, Xiaowei [5 ]
Gu, Jun [6 ]
Huangfu, Lixia [7 ]
Gong, Ming [7 ]
机构
[1] Nantong Univ, Affiliated Hosp, Sci & Technol Dept, Nantong, Peoples R China
[2] Jianghai Hosp Nantong Sutong Sci & Technol Pk, Dept Internal Med, Nantong, Peoples R China
[3] Shanghai Univ, Dept Biomed Engn, Shanghai, Peoples R China
[4] Southeast Univ, Zhongda Hosp, Network Informat Ctr, Nanjing, Peoples R China
[5] China Univ Min & Technol, Sch Informat & Control Engn, Xuzhou, Peoples R China
[6] Nantong Univ, Affiliated Hosp, Dept Resp, Nantong, Peoples R China
[7] Nantong Univ, Informat Ctr Dept, Affiliated Hosp, Nantong, Peoples R China
关键词
BERT; LSTM; cross attention; entity recognition; electronic medical records;
D O I
10.3389/fnins.2023.1259652
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
IntroductionIn the medical field, electronic medical records contain a large amount of textual information, and the unstructured nature of this information makes data extraction and analysis challenging. Therefore, automatic extraction of entity information from electronic medical records has become a significant issue in the healthcare domain.MethodsTo address this problem, this paper proposes a deep learning-based entity information extraction model called Entity-BERT. The model aims to leverage the powerful feature extraction capabilities of deep learning and the pre-training language representation learning of BERT(Bidirectional Encoder Representations from Transformers), enabling it to automatically learn and recognize various entity types in medical electronic records, including medical terminologies, disease names, drug information, and more, providing more effective support for medical research and clinical practices. The Entity-BERT model utilizes a multi-layer neural network and cross-attention mechanism to process and fuse information at different levels and types, resembling the hierarchical and distributed processing of the human brain. Additionally, the model employs pre-trained language and sequence models to process and learn textual data, sharing similarities with the language processing and semantic understanding of the human brain. Furthermore, the Entity-BERT model can capture contextual information and long-term dependencies, combining the cross-attention mechanism to handle the complex and diverse language expressions in electronic medical records, resembling the information processing method of the human brain in many aspects. Additionally, exploring how to utilize competitive learning, adaptive regulation, and synaptic plasticity to optimize the model's prediction results, automatically adjust its parameters, and achieve adaptive learning and dynamic adjustments from the perspective of neuroscience and brain-like cognition is of interest.Results and discussionExperimental results demonstrate that the Entity-BERT model achieves outstanding performance in entity recognition tasks within electronic medical records, surpassing other existing entity recognition models. This research not only provides more efficient and accurate natural language processing technology for the medical and health field but also introduces new ideas and directions for the design and optimization of deep learning models.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Advances in Named Entity Recognition in Electronic Medical Record
    Liu, Andong
    Peng, Lin
    Ye, Qing
    Du, Jianqiang
    Cheng, Chunlei
    Zha, Qinglin
    Computer Engineering and Applications, 2023, 59 (21) : 39 - 51
  • [2] A BERT-BiGRU-CRF Model for Entity Recognition of Chinese Electronic Medical Records
    Qin, Qiuli
    Zhao, Shuang
    Liu, Chunmei
    COMPLEXITY, 2021, 2021
  • [3] Chinese named entity recognition model based on BERT
    Liu, Hongshuai
    Jun, Ge
    Zheng, Yuanyuan
    2020 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE COMMUNICATION AND NETWORK SECURITY (CSCNS2020), 2021, 336
  • [4] Chinese Electronic Medical Record Named Entity Recognition based on FastBERT method
    Tuo, Jianyong
    Liu, Zhanzhan
    Chen, Qing
    Ma, Xin
    Wang, Youqing
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 2405 - 2410
  • [6] Chinese mineral named entity recognition based on BERT model
    Yu, Yuqing
    Wang, Yuzhu
    Mua, Jingqin
    Li, Wei
    Jiao, Shoutao
    Wang, Zhenhua
    Lv, Pengfei
    Zhu, Yueqin
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 206
  • [7] Entity Recognition Method for Judicial Documents Based on BERT Model
    Chen J.
    He T.
    Wen Y.-Y.
    Ma L.-T.
    Dongbei Daxue Xuebao/Journal of Northeastern University, 2020, 41 (10): : 1382 - 1387
  • [8] Research on Named Entity Recognition Method Based on BERT Model
    Xie, Shaopeng
    2024 IEEE 10TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING SERVICE AND MACHINE LEARNING APPLICATIONS, BIGDATASERVICE 2024, 2024, : 92 - 96
  • [9] Research and Development of Named Entity Recognition in Chinese Electronic Medical Record
    Du J.-H.
    Yin H.
    Feng S.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (12): : 3030 - 3053
  • [10] Chinese electronic medical record named entity recognition algorithm based on transfer learning
    Li, Yi
    Liu, Jianyi
    Zhang, Ru
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2019, 125 : 19 - 20