Chinese Clinical Named Entity Recognition Using Multi-Feature Fusion and Multi-Scale Local Context Enhancement

被引:0
|
作者
Li, Meijing [1 ]
Huang, Runqing [1 ]
Qi, Xianxian [1 ]
机构
[1] Shanghai Maritime Univ, Coll Informat Engn, Shanghai 200306, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 80卷 / 02期
基金
中国国家自然科学基金;
关键词
CNER; multi-feature fusion; BiLSTM; CNN; MHA; MODEL;
D O I
10.32604/cmc.2024.053630
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Chinese Clinical Named Entity Recognition (CNER) is a crucial step in extracting medical information and is of great significance in promoting medical informatization. However, CNER poses challenges due to the specificity of clinical terminology, the complexity of Chinese text semantics, and the uncertainty of Chinese entity boundaries. To address these issues, we propose an improved CNER model, which is based on multi-feature fusion and multi-scale local context enhancement. The model simultaneously fuses multi-feature representations of pinyin, radical, Part of Speech (POS), word boundary with BERT deep contextual representations to enhance the semantic representation of text for more effective entity recognition. Furthermore, to address the model's limitation of focusing just on global features, we incorporate Convolutional Neural Networks (CNNs) with various kernel sizes to capture multiscale local features of the text and enhance the model's comprehension of the text. Finally, we integrate the obtained global and local features, and employ multi-head attention mechanism (MHA) extraction to enhance the model's focus on characters associated with medical entities, hence boosting the model's performance. We obtained 92.74%, and 87.80% F1 scores on the two CNER benchmark datasets, CCKS2017 and CCKS2019, respectively. The results demonstrate that our model outperforms the latest models in CNER, showcasing its outstanding overall performance. It can be seen that the CNER model proposed in this study has an important application value in constructing clinical medical knowledge graph and intelligent Q&A system.
引用
收藏
页码:2283 / 2299
页数:17
相关论文
共 50 条
  • [1] Multi-Feature Fusion Transformer for Chinese Named Entity Recognition
    Han, Xiaokai
    Yue, Qi
    Chu, Jing
    Han, Zhan
    Shi, Yifan
    Wang, Chengfeng
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 4227 - 4232
  • [2] Multi-Feature Fusion Method for Chinese Pesticide Named Entity Recognition
    Ji, Wenqing
    Fu, Yinghua
    Zhu, Hongmei
    APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [3] Chinese Named Entity Recognition method based on multi-feature fusion and biaffine
    Ke, Xiaohua
    Wu, Xiaobo
    Ou, Zexian
    Li, Binglong
    COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (05) : 6305 - 6318
  • [4] Multi-Feature Fusion Method for Chinese Shipping Companies Credit Named Entity Recognition
    He, Lin
    Wang, Shengnan
    Cao, Xinran
    APPLIED SCIENCES-BASEL, 2023, 13 (09):
  • [5] Named Entity Recognition of Chinese Electronic Medical Records Based on Multi-Feature Fusion
    Sun, Zhen
    Li, Xinfu
    Computer Engineering and Applications, 2023, 59 (23) : 136 - 144
  • [6] Chinese Medical Named Entity Recognition Combined with Multi-Feature Embedding and Multi-Network Fusion
    Lei, Songze
    Liu, Bo
    Wang, Yufei
    Shan, Aokui
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (08) : 3032 - 3039
  • [7] Named entity recognition in aerospace based on multi-feature fusion transformer
    Jing Chu
    Yumeng Liu
    Qi Yue
    Zixuan Zheng
    Xiaokai Han
    Scientific Reports, 14
  • [8] Chinese named entity recognition with multi-network fusion of multi-scale lexical information
    Yan Guo
    HongChen Liu
    FuJiang Liu
    WeiHua Lin
    QuanSen Shao
    JunShun Su
    Journal of Electronic Science and Technology, 2024, 22 (04) : 55 - 82
  • [9] Chinese named entity recognition with multi-network fusion of multi-scale lexical information
    Guo, Yan
    Liu, Hong-Chen
    Liu, Fu-Jiang
    Lin, Wei-Hua
    Shao, Quan-Sen
    Su, Jun-Shun
    Journal of Electronic Science and Technology, 22 (04):
  • [10] Named entity recognition in aerospace based on multi-feature fusion transformer
    Chu, Jing
    Liu, Yumeng
    Yue, Qi
    Zheng, Zixuan
    Han, Xiaokai
    SCIENTIFIC REPORTS, 2024, 14 (01)