Clinical text classification with rule-based features and knowledge-guided convolutional neural networks

被引:85
|
作者
Yao, Liang [1 ]
Mao, Chengsheng [1 ]
Luo, Yuan [2 ]
机构
[1] Northwestern Univ, Chicago, IL 60611 USA
[2] Northwestern Univ, Feinberg Sch Med, Dept Prevent Med, Chicago, IL 60611 USA
关键词
Clinical text classification; Obesity challenge; Convolutional neural networks; Word embeddings; Entity embeddings;
D O I
10.1186/s12911-019-0781-4
中图分类号
R-058 [];
学科分类号
摘要
BackgroundClinical text classification is an fundamental problem in medical natural language processing. Existing studies have cocnventionally focused on rules or knowledge sources-based feature engineering, but only a limited number of studies have exploited effective representation learning capability of deep learning methods.MethodsIn this study, we propose a new approach which combines rule-based features and knowledge-guided deep learning models for effective disease classification. Critical Steps of our method include recognizing trigger phrases, predicting classes with very few examples using trigger phrases and training a convolutional neural network (CNN) with word embeddings and Unified Medical Language System (UMLS) entity embeddings.ResultsWe evaluated our method on the 2008 Integrating Informatics with Biology and the Bedside (i2b2) obesity challenge. The results demonstrate that our method outperforms the state-of-the-art methods.ConclusionWe showed that CNN model is powerful for learning effective hidden features, and CUIs embeddings are helpful for building clinical text representations. This shows integrating domain knowledge into CNN models is promising.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Incorporating Context-Relevant Knowledge into Convolutional Neural Networks for Short Text Classification
    Xu, Jingyun
    Cai, Yi
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 10067 - 10068
  • [32] Knowledge-Guided Deep Fractal Neural Networks for Human Pose Estimation
    Ning, Guanghan
    Zhang, Zhi
    He, Zhiquan
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (05) : 1246 - 1259
  • [33] Integrating associative rule-based classification with Naive Bayes for text classification
    Hadi, Wa'el
    Al-Radaideh, Qasem A.
    Alhawari, Samer
    [J]. APPLIED SOFT COMPUTING, 2018, 69 : 344 - 356
  • [34] Are Rule-based Neural Networks Biologically Plausible?
    De, Callatay, A.
    [J]. Connection Science, 8 (01):
  • [35] Semantic Text Encoding for Text Classification using Convolutional Neural Networks
    Gallo, Ignazio
    Nawaz, Shah
    Calefati, Alessandro
    [J]. 2017 14TH IAPR INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR 2017), VOL 5, 2017, : 16 - 21
  • [36] Thyroid Nodule Segmentation and Classification Using Deep Convolutional Neural Network and Rule-based Classifiers
    Shahroudnejad, Atefeh
    Vega, Roberto
    Forouzandeh, Amir
    Balachandran, Sharanya
    Jaremko, Jacob
    Noga, Michelle
    Hareendranathan, Abhilash Rakkunedeth
    Kapur, Jeevesh
    Punithakumar, Kumaradeven
    [J]. 2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 3118 - 3121
  • [37] Text classification based on word2vec and convolutional neural networks
    Fan, Xiaojing
    Jiang, Mingyang
    Pei, Zhili
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2019, 125 : 77 - 78
  • [38] Text Classification with Topic-based Word Embedding and Convolutional Neural Networks
    Xu, Haotian
    Dong, Ming
    Zhu, Dongxiao
    Kotov, Alexander
    Carcone, April Idalski
    Naar-King, Sylvie
    [J]. PROCEEDINGS OF THE 7TH ACM INTERNATIONAL CONFERENCE ON BIOINFORMATICS, COMPUTATIONAL BIOLOGY, AND HEALTH INFORMATICS, 2016, : 88 - 97
  • [39] Automated detection and classification of thyroid nodules in ultrasound images using clinical-knowledge-guided convolutional neural networks
    Liu, Tianjiao
    Guo, Qianqian
    Lian, Chunfeng
    Ren, Xuhua
    Liang, Shujun
    Yu, Jing
    Niu, Lijuan
    Sun, Weidong
    Shen, Dinggang
    [J]. MEDICAL IMAGE ANALYSIS, 2019, 58
  • [40] A Rule-Based Approach to Embedding Techniques for Text Document Classification
    Aubaid, Asmaa M.
    Mishra, Alok
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (11):