Chinese Clinical Named Entity Recognition Using Multi-Feature Fusion and Multi-Scale Local Context Enhancement

被引:0
|
作者
Li, Meijing [1 ]
Huang, Runqing [1 ]
Qi, Xianxian [1 ]
机构
[1] Shanghai Maritime Univ, Coll Informat Engn, Shanghai 200306, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 80卷 / 02期
基金
中国国家自然科学基金;
关键词
CNER; multi-feature fusion; BiLSTM; CNN; MHA; MODEL;
D O I
10.32604/cmc.2024.053630
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Chinese Clinical Named Entity Recognition (CNER) is a crucial step in extracting medical information and is of great significance in promoting medical informatization. However, CNER poses challenges due to the specificity of clinical terminology, the complexity of Chinese text semantics, and the uncertainty of Chinese entity boundaries. To address these issues, we propose an improved CNER model, which is based on multi-feature fusion and multi-scale local context enhancement. The model simultaneously fuses multi-feature representations of pinyin, radical, Part of Speech (POS), word boundary with BERT deep contextual representations to enhance the semantic representation of text for more effective entity recognition. Furthermore, to address the model's limitation of focusing just on global features, we incorporate Convolutional Neural Networks (CNNs) with various kernel sizes to capture multiscale local features of the text and enhance the model's comprehension of the text. Finally, we integrate the obtained global and local features, and employ multi-head attention mechanism (MHA) extraction to enhance the model's focus on characters associated with medical entities, hence boosting the model's performance. We obtained 92.74%, and 87.80% F1 scores on the two CNER benchmark datasets, CCKS2017 and CCKS2019, respectively. The results demonstrate that our model outperforms the latest models in CNER, showcasing its outstanding overall performance. It can be seen that the CNER model proposed in this study has an important application value in constructing clinical medical knowledge graph and intelligent Q&A system.
引用
收藏
页码:2283 / 2299
页数:17
相关论文
共 50 条
  • [41] Attention-based Multi-level Feature Fusion for Named Entity Recognition
    Yang, Zhiwei
    Chen, Hechang
    Zhang, Jiawei
    Ma, Jing
    Chang, Yi
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 3594 - 3600
  • [42] Chinese power dispatching text entity recognition based on a double-layer BiLSTM and multi-feature fusion
    Wang, Min
    Zhou, Tao
    Wang, Haohao
    Zhai, Youchun
    Dong, Xiaobin
    ENERGY REPORTS, 2022, 8 : 980 - 987
  • [43] Biomedical named entity recognition based on multi-cross attention feature fusion
    Zheng, Dequan
    Han, Rong
    Yu, Feng
    Li, Yannan
    PLOS ONE, 2024, 19 (05):
  • [44] EEG emotion recognition approach using multi-scale convolution and feature fusion
    Zhang, Yong
    Shan, Qingguo
    Chen, Wenyun
    Liu, Wenzhe
    VISUAL COMPUTER, 2024,
  • [45] Multi-Scale Attention Network Based on Multi-Feature Fusion for Person Re-Identification
    Li, Minghao
    Yuan, Liming
    Wen, Xianbin
    Wang, Jianchen
    Xie, Gengsheng
    Jia, Yansong
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [46] Multi-scale Feature Fusion Based Dongba Character Recognition
    Luo, Haini
    Xu, Dan
    Yang, Bing
    Zhang, Haoyuan
    2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 1571 - 1575
  • [47] Multi-feature fusion for thermal face recognition
    Bi, Yin
    Lv, Mingsong
    Wei, Yangjie
    Guan, Nan
    Yi, Wang
    INFRARED PHYSICS & TECHNOLOGY, 2016, 77 : 366 - 374
  • [48] Object-oriented Change Detection Method Based on Multi-scale and Multi-Feature Fusion
    Wang, Wen-jie
    Zhao, Zhong-ming
    Zhu, Hai-qing
    2009 JOINT URBAN REMOTE SENSING EVENT, VOLS 1-3, 2009, : 431 - 435
  • [49] A Multi-Feature Fusion and Attention Network for Multi-Scale Object Detection in Remote Sensing Images
    Cheng, Yong
    Wang, Wei
    Zhang, Wenjie
    Yang, Ling
    Wang, Jun
    Ni, Huan
    Guan, Tingzhao
    He, Jiaxin
    Gu, Yakang
    Tran, Ngoc Nguyen
    REMOTE SENSING, 2023, 15 (08)
  • [50] Lightweight silkworm recognition based on Multi-scale feature fusion
    Wen, Chunming
    Wen, Jie
    Li, Jianheng
    Luo, Yunyun
    Chen, Minbo
    Xiao, Zhanpeng
    Xu, Qing
    Liang, Xiang
    An, Hui
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2022, 200