Deep Convolutional Neural Network Based Medical Concept Normalization

被引:2
|
作者
Song, Guojie [1 ]
Long, Qingqing [2 ]
Luo, Yi [3 ]
Wang, Yiming [2 ]
Jin, Yilun [4 ]
机构
[1] Peking Univ, Minist Educ, Key Lab Machine Percept, Beijing 100871, Peoples R China
[2] Peking Univ, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
[3] Univ Calif San Diego, Dept Comp Sci & Engn, San Diego, CA 92093 USA
[4] Hong Kong Univ Sci & Technol, Dept Comp Sci & Engn, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Semantics; Medical diagnostic imaging; Tensile stress; Correlation; Pattern matching; Big Data; Medical data mining; medical concept normalization; convolutional neural network; multi-task learning; text representation;
D O I
10.1109/TBDATA.2020.3021389
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Medical concept normalization is a critical problem in biomedical research and clinical applications. In this article, we focus on normalizing diagnostic and operation names in Chinese discharge summaries to standard concepts, which is formulated as a semantic matching problem. However, non-standard Chinese expressions, short-text normalization, heterogeneity of tasks and flexible input of disambiguation mentions pose critical challenges in our problem. We propose two models, the basic model and flexible model, to tackle these problems. The basic model solves the core problem (the first three challenges) in ambiguous mentions normalization, while the flexible model deals with flexible input of ambiguous mentions and further explores the correlation among them. Specifically, in the basic model, we present a general framework to disambiguate a diagnosis and its corresponding operation simultaneously, which introduces a tensor generator and a novel multi-view convolutional neural network (CNN) with a multi-task shared structure. We propose that the key to address non-standard expressions and the short-text problem is to incorporate a matching tensor with multiple granularities. Then a multi-view CNN is adopted to extract semantic matching patterns. Finally, the multi-task shared structure allows the model to exploit medical correlations between diagnosis and operation mentions to better perform disambiguation tasks. Subsequently, we design a flexible model based on the basic model. Specifically, we add a flexible attention layer to all procedure representation vectors, and then apply a flexible multi-task scheme to share the correlated information. Comprehensive experimental analysis indicates that our model outperforms existing baselines, demonstrating the effectiveness and robustness of our model.
引用
收藏
页码:1195 / 1208
页数:14
相关论文
共 50 条
  • [1] A Deep Normalization and Convolutional Neural Network for Image Smoke Detection
    Yin, Zhijian
    Wan, Boyang
    Yuan, Feiniu
    Xia, Xue
    Shi, Jinting
    [J]. IEEE ACCESS, 2017, 5 : 18429 - 18438
  • [2] Multi-Task Medical Concept Normalization Using Multi-View Convolutional Neural Network
    Luo, Yi
    Song, Guojie
    Li, Pengyu
    Qi, Zhongang
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 5868 - 5875
  • [3] A Batch Normalization Free Binarized Convolutional Deep Neural Network on an FPGA
    Nakahara, Hiroki
    Yonekawa, Haruyoshi
    Iwamoto, Hisashi
    Motomura, Masato
    [J]. FPGA'17: PROCEEDINGS OF THE 2017 ACM/SIGDA INTERNATIONAL SYMPOSIUM ON FIELD-PROGRAMMABLE GATE ARRAYS, 2017, : 290 - 290
  • [4] A Rolling Bearing Fault Diagnosis Method Based on Switchable Normalization and a Deep Convolutional Neural Network
    Han, Xiaoyu
    Cao, Yunpeng
    Luan, Junqi
    Ao, Ran
    Feng, Weixing
    Li, Shuying
    [J]. MACHINES, 2023, 11 (02)
  • [5] Deep convolutional neural network based medical image classification for disease diagnosis
    Yadav, Samir S.
    Jadhav, Shivajirao M.
    [J]. JOURNAL OF BIG DATA, 2019, 6 (01)
  • [6] Deep convolutional neural network based medical image classification for disease diagnosis
    Samir S. Yadav
    Shivajirao M. Jadhav
    [J]. Journal of Big Data, 6
  • [7] A Deep Convolutional Neural Network with Batch Normalization Approach for Plant Disease Detection
    Albogamy, R. Fahad
    [J]. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2021, 21 (09): : 51 - 62
  • [8] Deep Neural Models for Medical Concept Normalization in User-Generated Texts
    Miftahutdinov, Zulfat
    Tutubalina, Elena
    [J]. 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019:): STUDENT RESEARCH WORKSHOP, 2019, : 393 - 399
  • [9] Medical image retrieval using deep convolutional neural network
    Qayyum, Adnan
    Anwar, Syed Muhammad
    Awais, Muhammad
    Majid, Muhammad
    [J]. NEUROCOMPUTING, 2017, 266 : 8 - 20
  • [10] Convolutional Normalization: Improving Deep Convolutional Network Robustness and Training
    Liu, Sheng
    Li, Xiao
    Zhai, Yuexiang
    You, Chong
    Zhu, Zhihui
    Fernandez-Granda, Carlos
    Qu, Qing
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34