A text classification method based on a convolutional and bidirectional long short-term memory model

被引:25
|
作者
Huan, Hai [1 ]
Guo, Zelin [1 ]
Cai, Tingting [2 ]
He, Zichen [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Elect Informat Engn, Nanjing, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Artificial Intelligence, Nanjing 210044, Peoples R China
关键词
Text classification; feature extraction; multi-head attention mechanism; bidirectional long short-term memory network; ATTENTION MECHANISM; LSTM; LAYER;
D O I
10.1080/09540091.2022.2098926
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Text classification refers to labelling text with specified labels, and it is widely used in public opinion supervision, spam detection, and other fields. However, due to the complex semantics of natural language and the difficulty of extracting semantic features, users of traditional methods encounter difficulties when trying to achieve better classification results. In response to this problem, a text classification method based on the CBM (Convolutional and Bi-LSTM Model) model, which can extract shallow local semantic features and deep global semantic features, is proposed. First, the text is vectorised using the Glove model in the embedding layer. Then, the vector text is sent to the Multiscale Convolutional Neural Network (MCNN) and the Bidirectional Long Short-Term Memory network (Bi-LSTM) respectively. The Bi-LSTM layer is also designed in the present work with use of mixed attention to extract deeper semantic features. Finally, the MCNN features and Bi-LSTM features are fused and sent to the softmax layer for classification. Experimental results show that the model can significantly improve the accuracy of text classification.
引用
收藏
页码:2108 / 2124
页数:17
相关论文
共 50 条
  • [1] Personality classification from text using bidirectional long short-term memory model
    Khattak, Asad
    Jellani, Nosheen
    Asghar, Muhammad Zubair
    Asghar, Usama
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (10) : 28849 - 28873
  • [2] Personality classification from text using bidirectional long short-term memory model
    Asad Khattak
    Nosheen Jellani
    Muhammad Zubair Asghar
    Usama Asghar
    [J]. Multimedia Tools and Applications, 2024, 83 : 28849 - 28873
  • [3] Feature-Enhanced Nonequilibrium Bidirectional Long Short-Term Memory Model for Chinese Text Classification
    Huan, Hai
    Yan, Jiayu
    Xie, Yaqin
    Chen, Yifei
    Li, Pengcheng
    Zhu, Rongrong
    [J]. IEEE ACCESS, 2020, 8 : 199629 - 199637
  • [4] A Hybrid Model Based on Convolutional Neural Network and Long Short-Term Memory for Multi-label Text Classification
    Maragheh, Hamed Khataei
    Gharehchopogh, Farhad Soleimanian
    Majidzadeh, Kambiz
    Sangar, Amin Babazadeh
    [J]. NEURAL PROCESSING LETTERS, 2024, 56 (02)
  • [5] A Hybrid Model Based on Convolutional Neural Network and Long Short-Term Memory for Multi-label Text Classification
    Hamed Khataei Maragheh
    Farhad Soleimanian Gharehchopogh
    Kambiz Majidzadeh
    Amin Babazadeh Sangar
    [J]. Neural Processing Letters, 56
  • [6] Text Classification Using Long Short-Term Memory
    Sari, Winda Kurnia
    Rini, Dian Palupi
    Malik, Reza Firsandaya
    [J]. 2019 3RD INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND COMPUTER SCIENCE (ICECOS 2019), 2019, : 150 - 155
  • [7] Beat-to-Beat Electrocardiogram Waveform Classification Based on a Stacked Convolutional and Bidirectional Long Short-Term Memory
    Nurmaini, Siti
    Darmawahyuni, Annisa
    Rachmatullah, Muhammad Naufal
    Effendi, Jannes
    Sapitri, Ade Iriani
    Firdaus, Firdaus
    Tutuko, Bambang
    [J]. IEEE ACCESS, 2021, 9 : 92600 - 92613
  • [8] Sleep Stage Classification using Convolutional Neural Networks and Bidirectional Long Short-Term Memory
    Yulita, Intan Nurma
    Fanany, Mohamad Ivan
    Arymurthy, Aniati Murni
    [J]. 2017 INTERNATIONAL CONFERENCE ON ADVANCED COMPUTER SCIENCE AND INFORMATION SYSTEMS (ICACSIS), 2017, : 303 - 307
  • [9] A short-term prediction model of global ionospheric VTEC based on the combination of long short-term memory and convolutional long short-term memory
    Peng Chen
    Rong Wang
    Yibin Yao
    Hao Chen
    Zhihao Wang
    Zhiyuan An
    [J]. Journal of Geodesy, 2023, 97
  • [10] A short-term prediction model of global ionospheric VTEC based on the combination of long short-term memory and convolutional long short-term memory
    Chen, Peng
    Wang, Rong
    Yao, Yibin
    Chen, Hao
    Wang, Zhihao
    An, Zhiyuan
    [J]. JOURNAL OF GEODESY, 2023, 97 (05)