An attention-based multi-task model for named entity recognition and intent analysis of Chinese online medical questions

被引:25
|
作者
Wu, Chaochen [1 ]
Luo, Guan [1 ]
Guo, Chao [2 ]
Ren, Yin [3 ]
Zheng, Anni [1 ]
Yang, Cheng [1 ]
机构
[1] Chinese Acad Sci, Natl Lab Pattern Recognit, Inst Automat, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
[2] CAMS & PUMC, Dept Cardiol, Fuwai Hosp, Beijing 100037, Peoples R China
[3] Univ Chinese Acad Sci, 19A Yuquan Rd, Beijing 100049, Peoples R China
关键词
Natural language processing; Deep learning; Multi-task learning; Named entity recognition; Intent analysis; Interpretability;
D O I
10.1016/j.jbi.2020.103511
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this paper, we propose an attention-based multi-task neural network model for text classification and sequence tagging and then apply it to the named entity recognition and the intent analysis of Chinese online medical questions. We found that the use of both attention and multi-task learning improved the performance of these tasks. Our method achieved superior performance in named entity recognition and intent analysis compared with other baseline methods; the method is a light-weight solution that is suitable for deployment on small servers. Furthermore, we took advantage of the model's capabilities for these two tasks and built a simple question-answering system for cardiovascular issues. Users and service providers can monitor the logic of the answers generated by this system.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Chinese Named Entity Recognition Model Based on Multi-Task Learning
    Fang, Qin
    Li, Yane
    Feng, Hailin
    Ruan, Yaoping
    APPLIED SCIENCES-BASEL, 2023, 13 (08):
  • [2] Medical QA Oriented Multi-Task Learning Model for Question Intent Classification and Named Entity Recognition
    Tohti, Turdi
    Abdurxit, Mamatjan
    Hamdulla, Askar
    INFORMATION, 2022, 13 (12)
  • [3] An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records
    Luqi Li
    Jie Zhao
    Li Hou
    Yunkai Zhai
    Jinming Shi
    Fangfang Cui
    BMC Medical Informatics and Decision Making, 19
  • [4] An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records
    Li, Luqi
    Zhao, Jie
    Hou, Li
    Zhai, Yunkai
    Shi, Jinming
    Cui, Fangfang
    BMC MEDICAL INFORMATICS AND DECISION MAKING, 2019, 19 (01)
  • [5] Multi-Task Multi-Attention Transformer for Generative Named Entity Recognition
    Mo, Ying
    Liu, Jiahao
    Tang, Hongyin
    Wang, Qifan
    Xu, Zenglin
    Wang, Jingang
    Quan, Xiaojun
    Wu, Wei
    Li, Zhoujun
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 4171 - 4183
  • [6] Adversarial Multi-task Learning for Efficient Chinese Named Entity Recognition
    Yan, Yibo
    Zhu, Peng
    Cheng, Dawei
    Yang, Fangzhou
    Luo, Yifeng
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (07)
  • [7] Chinese Clinical Named Entity Recognition Based on Stroke ELMo and Multi-Task Learning
    Luo L.
    Yang Z.-H.
    Song Y.-W.
    Li N.
    Lin H.-F.
    Yang, Zhi-Hao (yangzh@dlut.edu.cn), 1943, Science Press (43): : 1943 - 1957
  • [8] Biomedical Named Entity Recognition Based on Multi-task Learning
    Zhao, Hui
    Zhao, Di
    Meng, Jiana
    Su, Wen
    Mu, Wenxuan
    HEALTH INFORMATION PROCESSING, CHIP 2023, 2023, 1993 : 51 - 65
  • [9] An Attention-Based BiLSTM-CRF Model for Chinese Clinic Named Entity Recognition
    Wu, Guohua
    Tang, Guangen
    Wang, Zhongru
    Zhang, Zhen
    Wang, Zhen
    IEEE ACCESS, 2019, 7 (113942-113949) : 113942 - 113949
  • [10] Attention-Based Bi-LSTM for Chinese Named Entity Recognition
    Zhang, Kai
    Ren, Weiping
    Zhang, Yangsen
    CHINESE LEXICAL SEMANTICS, CLSW 2018, 2018, 11173 : 643 - 652