Deep Convolutional Neural Network Based Medical Concept Normalization

被引:2
|
作者
Song, Guojie [1 ]
Long, Qingqing [2 ]
Luo, Yi [3 ]
Wang, Yiming [2 ]
Jin, Yilun [4 ]
机构
[1] Peking Univ, Minist Educ, Key Lab Machine Percept, Beijing 100871, Peoples R China
[2] Peking Univ, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
[3] Univ Calif San Diego, Dept Comp Sci & Engn, San Diego, CA 92093 USA
[4] Hong Kong Univ Sci & Technol, Dept Comp Sci & Engn, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Semantics; Medical diagnostic imaging; Tensile stress; Correlation; Pattern matching; Big Data; Medical data mining; medical concept normalization; convolutional neural network; multi-task learning; text representation;
D O I
10.1109/TBDATA.2020.3021389
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Medical concept normalization is a critical problem in biomedical research and clinical applications. In this article, we focus on normalizing diagnostic and operation names in Chinese discharge summaries to standard concepts, which is formulated as a semantic matching problem. However, non-standard Chinese expressions, short-text normalization, heterogeneity of tasks and flexible input of disambiguation mentions pose critical challenges in our problem. We propose two models, the basic model and flexible model, to tackle these problems. The basic model solves the core problem (the first three challenges) in ambiguous mentions normalization, while the flexible model deals with flexible input of ambiguous mentions and further explores the correlation among them. Specifically, in the basic model, we present a general framework to disambiguate a diagnosis and its corresponding operation simultaneously, which introduces a tensor generator and a novel multi-view convolutional neural network (CNN) with a multi-task shared structure. We propose that the key to address non-standard expressions and the short-text problem is to incorporate a matching tensor with multiple granularities. Then a multi-view CNN is adopted to extract semantic matching patterns. Finally, the multi-task shared structure allows the model to exploit medical correlations between diagnosis and operation mentions to better perform disambiguation tasks. Subsequently, we design a flexible model based on the basic model. Specifically, we add a flexible attention layer to all procedure representation vectors, and then apply a flexible multi-task scheme to share the correlated information. Comprehensive experimental analysis indicates that our model outperforms existing baselines, demonstrating the effectiveness and robustness of our model.
引用
收藏
页码:1195 / 1208
页数:14
相关论文
共 50 条
  • [31] A Medical Image Fusion Method Based on SIFT and Deep Convolutional Neural Network in the SIST Domain
    Wang, Lei
    Chang, Chunhong
    Liu, Zhouqi
    Huang, Jin
    Liu, Cong
    Liu, Chunxiang
    [J]. JOURNAL OF HEALTHCARE ENGINEERING, 2021, 2021
  • [32] An Optimized Deep Convolutional Neural Network Architecture for Concept Drifted Image Classification
    Jameel, Syed Muslim
    Hashmani, Manzoor Ahmed
    Alhussain, Hitham
    Rehman, Mobashar
    Budiman, Arif
    [J]. INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 1, 2020, 1037 : 932 - 942
  • [33] Memristor Crossbar Deep Network Implementation Based on a Convolutional Neural Network
    Yakopcic, Chris
    Alom, Md Zahangir
    Taha, Tarek M.
    [J]. 2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 963 - 970
  • [34] Embedding-Based Deep Neural Network and Convolutional Neural Network Graph Classifiers
    Elnaggar, Sarah G.
    Elsemman, Ibrahim E.
    Soliman, Taysir Hassan A.
    [J]. ELECTRONICS, 2023, 12 (12)
  • [35] On-chip Memory Based Binarized Convolutional Deep Neural Network Applying Batch Normalization Free Technique on an FPGA
    Yonekawa, Haruyoshi
    Nakahara, Hiroki
    [J]. 2017 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2017, : 98 - 105
  • [36] Development of Deep Convolutional Neural Network with Adaptive Batch Normalization Algorithm for Bearing Fault Diagnosis
    Fu, Chao
    Lv, Qing
    Lin, Hsiung-Cheng
    [J]. SHOCK AND VIBRATION, 2020, 2020
  • [37] Diesel Engine Misfire Diagnosis with Deep Convolutional Neural Network Using Dropout and Batch Normalization
    Zhang, Kang
    Tao, Jianfeng
    Qin, Chengjin
    Li, Weixing
    Liu, Chengliang
    [J]. Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2019, 53 (08): : 159 - 166
  • [38] Deep Convolutional Neural Network Based on Two-Stream Convolutional Unit
    Hou Congcong
    He Yuqing
    Jiang Xiaoheng
    Pan Jing
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (02)
  • [39] Automated glaucoma detection based on deep convolutional neural network
    Ko, Yu-Chieh
    Wey, Shin-Yu
    Lee, Chen-Yi
    Liu, Catherine Jui-Ling
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2018, 59 (09)
  • [40] Radar Emitter Identification Based on Deep Convolutional Neural Network
    Kong, Mingxin
    Zhang, Jing
    Liu, Weifeng
    Zhang, Guilin
    [J]. 2018 INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND INFORMATION SCIENCES (ICCAIS), 2018, : 309 - 314