Clinical text classification with rule-based features and knowledge-guided convolutional neural networks

被引:85
|
作者
Yao, Liang [1 ]
Mao, Chengsheng [1 ]
Luo, Yuan [2 ]
机构
[1] Northwestern Univ, Chicago, IL 60611 USA
[2] Northwestern Univ, Feinberg Sch Med, Dept Prevent Med, Chicago, IL 60611 USA
关键词
Clinical text classification; Obesity challenge; Convolutional neural networks; Word embeddings; Entity embeddings;
D O I
10.1186/s12911-019-0781-4
中图分类号
R-058 [];
学科分类号
摘要
BackgroundClinical text classification is an fundamental problem in medical natural language processing. Existing studies have cocnventionally focused on rules or knowledge sources-based feature engineering, but only a limited number of studies have exploited effective representation learning capability of deep learning methods.MethodsIn this study, we propose a new approach which combines rule-based features and knowledge-guided deep learning models for effective disease classification. Critical Steps of our method include recognizing trigger phrases, predicting classes with very few examples using trigger phrases and training a convolutional neural network (CNN) with word embeddings and Unified Medical Language System (UMLS) entity embeddings.ResultsWe evaluated our method on the 2008 Integrating Informatics with Biology and the Bedside (i2b2) obesity challenge. The results demonstrate that our method outperforms the state-of-the-art methods.ConclusionWe showed that CNN model is powerful for learning effective hidden features, and CUIs embeddings are helpful for building clinical text representations. This shows integrating domain knowledge into CNN models is promising.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Clinical text classification with rule-based features and knowledge-guided convolutional neural networks
    Liang Yao
    Chengsheng Mao
    Yuan Luo
    [J]. BMC Medical Informatics and Decision Making, 19
  • [2] Clinical Text Classification with Rule-based Features and Knowledge-guided Convolutional Neural Networks
    Yao, Liang
    Mao, Chengsheng
    Luo, Yuan
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON HEALTHCARE INFORMATICS WORKSHOPS (ICHI-W), 2018, : 70 - 71
  • [3] RULE-BASED NEURAL NETWORKS FOR CLASSIFICATION AND PROBABILITY ESTIMATION
    GOODMAN, RM
    HIGGINS, CM
    MILLER, JW
    SMYTH, P
    [J]. NEURAL COMPUTATION, 1992, 4 (06) : 781 - 804
  • [4] KGZNet:Knowledge-Guided Deep Zoom Neural Networks for Thoracic Disease Classification
    Wang, Kun
    Zhang, Xiaohong
    Huang, Sheng
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 1396 - 1401
  • [5] Heuristic and rule-based knowledge acquisition: Classification of numeral strings in text
    Min, Kyongho
    MacDonell, Stephen
    Moon, Yoojin
    [J]. ADVANCES IN KNOWLEDGE ACQUISITION AND MANAGEMENT, 2006, 4303 : 40 - +
  • [6] Knowledge-enhanced graph convolutional neural networks for text classification
    Wang T.
    Zhu X.-F.
    Tang G.
    [J]. Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2022, 56 (02): : 322 - 328
  • [7] Combining Knowledge with Deep Convolutional Neural Networks for Short Text Classification
    Wang, Jin
    Wang, Zhongyuan
    Zhang, Dawei
    Yan, Jun
    [J]. PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 2915 - 2921
  • [8] ConKgPrompt: Contrastive Sample Method Based on Knowledge-Guided Prompt Learning for Text Classification
    Wang, Qian
    Zeng, Cheng
    Li, Bing
    He, Peng
    [J]. ELECTRONICS, 2023, 12 (17)
  • [9] Knowledge-guided convolutional networks for chemical-disease relation extraction
    Zhou, Huiwei
    Lang, Chengkun
    Liu, Zhuang
    Ning, Shixian
    Lin, Yingyu
    Du, Lei
    [J]. BMC BIOINFORMATICS, 2019, 20 (1)
  • [10] Short Text Classification With A Convolutional Neural Networks Based Method
    Hu, Yibo
    Li, Yang
    Yang, Tao
    Pan, Quan
    [J]. 2018 15TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV), 2018, : 1432 - 1435