An Improved Double Channel Long Short-Term Memory Model for Medical Text Classification

被引:4
|
作者
Liang, Shengbin [1 ,2 ]
Chen, Xinan [2 ]
Ma, Jixin [3 ]
Du, Wencai [2 ]
Ma, Huawei [2 ,4 ]
机构
[1] Henun Univ, Sch Software, Kaifeng, Peoples R China
[2] City Univ Macau, Inst Data Sci, Taipa, Macao, Peoples R China
[3] Univ Greenwich, Sch Comp & Math Sci, London, England
[4] Beijing Inst Technol, Sch Informat Technol, Zhuhai, Peoples R China
关键词
D O I
10.1155/2021/6664893
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
There are a large number of symptom consultation texts in medical and healthcare Internet communities, and Chinese health segmentation is more complex, which leads to the low accuracy of the existing algorithms for medical text classification. The deep learning model has advantages in extracting abstract features of text effectively. However, for a large number of samples of complex text data, especially for words with ambiguous meanings in the field of Chinese medical diagnosis, the word-level neural network model is insufficient. Therefore, in order to solve the triage and precise treatment of patients, we present an improved Double Channel (DC) mechanism as a significant enhancement to Long Short-Term Memory (LSTM). In this DC mechanism, two channels are used to receive word-level and char-level embedding, respectively, at the same time. Hybrid attention is proposed to combine the current time output with the current time unit state and then using attention to calculate the weight. By calculating the probability distribution of each timestep input data weight, the weight score is obtained, and then weighted summation is performed. At last, the data input by each timestep is subjected to trade-off learning to improve the generalization ability of the model learning. Moreover, we conduct an extensive performance evaluation on two different datasets: cMedQA and Sendment140.1he experimental results show that the DC-LSTM model proposed in this paper has significantly superior accuracy and ROC compared with the basic CNN-LSTM model.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] PICO Element Detection in Medical Text via Long Short-Term Memory Neural Networks
    Jin, Di
    Szolovits, Peter
    [J]. SIGBIOMED WORKSHOP ON BIOMEDICAL NATURAL LANGUAGE PROCESSING (BIONLP 2018), 2018, : 67 - 75
  • [22] A short-term prediction model of global ionospheric VTEC based on the combination of long short-term memory and convolutional long short-term memory
    Peng Chen
    Rong Wang
    Yibin Yao
    Hao Chen
    Zhihao Wang
    Zhiyuan An
    [J]. Journal of Geodesy, 2023, 97
  • [23] A short-term prediction model of global ionospheric VTEC based on the combination of long short-term memory and convolutional long short-term memory
    Chen, Peng
    Wang, Rong
    Yao, Yibin
    Chen, Hao
    Wang, Zhihao
    An, Zhiyuan
    [J]. JOURNAL OF GEODESY, 2023, 97 (05)
  • [24] Improved short-term memory with long-term LVAD support
    Madsen, C. N.
    McKinney, A. M.
    Childs, J. R.
    Khodaverdian, R. A.
    Long, J. W.
    [J]. JOURNAL OF HEART AND LUNG TRANSPLANTATION, 2008, 27 (02): : S169 - S169
  • [25] Feature selection based on long short term memory for text classification
    Hong, Ming
    Wang, Heyong
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (15) : 44333 - 44378
  • [26] Feature selection based on long short term memory for text classification
    Ming Hong
    Heyong Wang
    [J]. Multimedia Tools and Applications, 2024, 83 : 44333 - 44378
  • [27] Long Short-Term Memory Network for Wireless Channel Prediction
    Tong, Xiaoyun
    Sun, Songlin
    [J]. SIGNAL AND INFORMATION PROCESSING, NETWORKING AND COMPUTERS, 2018, 473 : 19 - 26
  • [28] RETRACTED: Evolving Long Short-Term Memory Network-Based Text Classification (Retracted Article)
    Singh, Arjun
    Dargar, Shashi Kant
    Gupta, Amit
    Kumar, Ashish
    Srivastava, Atul Kumar
    Srivastava, Mitali
    Kumar Tiwari, Pradeep
    Ullah, Mohammad Aman
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [29] Deep Graph-Long Short-Term Memory: A Deep Learning Based Approach for Text Classification
    Varsha Mittal
    Duraprasad Gangodkar
    Bhaskar Pant
    [J]. Wireless Personal Communications, 2021, 119 : 2287 - 2301
  • [30] Deep Graph-Long Short-Term Memory: A Deep Learning Based Approach for Text Classification
    Mittal, Varsha
    Gangodkar, Duraprasad
    Pant, Bhaskar
    [J]. WIRELESS PERSONAL COMMUNICATIONS, 2021, 119 (03) : 2287 - 2301