An Improved Double Channel Long Short-Term Memory Model for Medical Text Classification

被引:4
|
作者
Liang, Shengbin [1 ,2 ]
Chen, Xinan [2 ]
Ma, Jixin [3 ]
Du, Wencai [2 ]
Ma, Huawei [2 ,4 ]
机构
[1] Henun Univ, Sch Software, Kaifeng, Peoples R China
[2] City Univ Macau, Inst Data Sci, Taipa, Macao, Peoples R China
[3] Univ Greenwich, Sch Comp & Math Sci, London, England
[4] Beijing Inst Technol, Sch Informat Technol, Zhuhai, Peoples R China
关键词
D O I
10.1155/2021/6664893
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
There are a large number of symptom consultation texts in medical and healthcare Internet communities, and Chinese health segmentation is more complex, which leads to the low accuracy of the existing algorithms for medical text classification. The deep learning model has advantages in extracting abstract features of text effectively. However, for a large number of samples of complex text data, especially for words with ambiguous meanings in the field of Chinese medical diagnosis, the word-level neural network model is insufficient. Therefore, in order to solve the triage and precise treatment of patients, we present an improved Double Channel (DC) mechanism as a significant enhancement to Long Short-Term Memory (LSTM). In this DC mechanism, two channels are used to receive word-level and char-level embedding, respectively, at the same time. Hybrid attention is proposed to combine the current time output with the current time unit state and then using attention to calculate the weight. By calculating the probability distribution of each timestep input data weight, the weight score is obtained, and then weighted summation is performed. At last, the data input by each timestep is subjected to trade-off learning to improve the generalization ability of the model learning. Moreover, we conduct an extensive performance evaluation on two different datasets: cMedQA and Sendment140.1he experimental results show that the DC-LSTM model proposed in this paper has significantly superior accuracy and ROC compared with the basic CNN-LSTM model.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] Emotion Detection in Text using Nested Long Short-Term Memory
    Haryadi, Daniel
    Kusuma, Gede Putra
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (06) : 351 - 357
  • [42] Long short-term memory
    Hochreiter, S
    Schmidhuber, J
    [J]. NEURAL COMPUTATION, 1997, 9 (08) : 1735 - 1780
  • [43] Optimal Quad Channel Long Short-Term Memory Based Fake News Classification on English Corpus
    Hamza M.A.
    Alshahrani H.J.
    Tarmissi K.
    Yafoz A.
    Mehanna A.S.
    Yaseen I.
    Abdelmageed A.A.
    Eldesouki M.I.
    [J]. Computer Systems Science and Engineering, 2023, 46 (03): : 3303 - 3319
  • [44] A phenomenological memristor model for short-term/long-term memory
    Chen, Ling
    Li, Chuandong
    Huang, Tingwen
    Ahmad, Hafiz Gulfam
    Chen, Yiran
    [J]. PHYSICS LETTERS A, 2014, 378 (40) : 2924 - 2930
  • [45] Human activity classification using long short-term memory network
    Welhenge, Anuradhi Malshika
    Taparugssanagorn, Attaphongse
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2019, 13 (04) : 651 - 656
  • [46] Novel architecture for long short-term memory used in question classification
    Xia, Wei
    Zhu, Wen
    Liao, Bo
    Chen, Min
    Cai, Lijun
    Huang, Lei
    [J]. NEUROCOMPUTING, 2018, 299 : 20 - 31
  • [47] Research on Attention Classification Based on Long Short-term Memory Network
    Wang Pai
    Wu Fan
    Wang Mei
    Qin Xue-Bin
    [J]. 2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 1148 - 1151
  • [48] Accuracy electroencephalography classification by a regularized long short-term memory network
    Gong, Zhenying
    Wang, Tao
    Zhao, Zhen
    Liu, Xin
    Guo, Yina
    [J]. JOURNAL OF VIBRATION AND CONTROL, 2022, 28 (17-18) : 2187 - 2196
  • [49] Human activity classification using long short-term memory network
    Anuradhi Malshika Welhenge
    Attaphongse Taparugssanagorn
    [J]. Signal, Image and Video Processing, 2019, 13 : 651 - 656
  • [50] PARALLEL LONG SHORT-TERM MEMORY FOR MULTI-STREAM CLASSIFICATION
    Bouaziz, Mohamed
    Morchid, Mohamed
    Dufour, Richard
    Linares, Georges
    De Mori, Renato
    [J]. 2016 IEEE WORKSHOP ON SPOKEN LANGUAGE TECHNOLOGY (SLT 2016), 2016, : 218 - 223