A Comparative Study of Neural Network for Text Classification

被引:1
|
作者
Peng, Xi [1 ]
机构
[1] Jilin Univ, Coll Math, Changchun, Jilin, Peoples R China
关键词
machine learning; neural network; natural language processing; ARCHITECTURES;
D O I
10.1109/TOCS50858.2020.9339702
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This With the popularity of artificial intelligence in recent years, Natural Language Processing (NLP) technology has also become the focus of research. NLP technology's unique machine translation and text sentiment analysis functions can prevent people from experiencing poor language communication when travelling abroad and help artificial intelligence understand people's language better. This article has made corresponding practice and analysis for the critical requirement of "text classification" in NLP. In the experiment, we used the Internet Movie Database (IMDB) film review forum as the dataset. Recurrent Neural Network (RNN) and the corresponding variants of RNN (Long Short Term Memory (LSTM)) are analyzed and compared from the theoretical aspect. Moreover, we introduced a bidirectional mechanism to optimize RNN and reduce the influence of parameter changes on model training by comparing specific neural network structures. We found the benefits of LSTM in text classification applications compared with RNN and simple neural networks by comparing experiments. Besides, we explored the role of the bidirectional mechanism for RNN. Finally, we create a two-way LSTM model for text classification model and obtain the model training results indicating less overfitting and less loss than other structures.
引用
收藏
页码:214 / 218
页数:5
相关论文
共 50 条
  • [1] A Comparative Study of Deep Neural Network Models on Multi-Label Text Classification in Finance
    Maia, Macedo
    Sales, Juliano Efson
    Freitas, Andre
    Handschuh, Siegfried
    Endres, Markus
    [J]. 2021 IEEE 15TH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC 2021), 2021, : 183 - 190
  • [2] A Comparative Study of Short Text Classification with Spiking Neural Networks
    Maciag, Piotr S.
    Sitek, Wojciech
    Skonieczny, Lukasz
    Rybinski, Henryk
    [J]. PROCEEDINGS OF THE 2022 17TH CONFERENCE ON COMPUTER SCIENCE AND INTELLIGENCE SYSTEMS (FEDCSIS), 2022, : 79 - 88
  • [3] Study a Text Classification Method Based on Neural Network Model
    Chen, Jian
    Pan, Hailan
    Ao, Qinyun
    [J]. ADVANCES IN MULTIMEDIA, SOFTWARE ENGINEERING AND COMPUTING, VOL 1, 2011, 128 : 471 - 475
  • [4] Neural Network for Arabic Text Classification
    Harrag, Fouzi
    El-Qawasmah, Eyas
    [J]. 2009 SECOND INTERNATIONAL CONFERENCE ON THE APPLICATIONS OF DIGITAL INFORMATION AND WEB TECHNOLOGIES (ICADIWT 2009), 2009, : 778 - +
  • [5] Text Level Graph Neural Network for Text Classification
    Huang, Lianzhe
    Ma, Dehong
    Li, Sujian
    Zhang, Xiaodong
    Wang, Houfeng
    [J]. 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 3444 - 3450
  • [6] A Comparative Study of Neural Network Models for Sentence Classification
    Phuong Le-Hong
    Anh-Cuong Le
    [J]. PROCEEDINGS OF 2018 5TH NAFOSTED CONFERENCE ON INFORMATION AND COMPUTER SCIENCE (NICS 2018), 2018, : 360 - 365
  • [7] Comparative effectiveness of convolutional neural network (CNN) and recurrent neural network (RNN) architectures for radiology text report classification
    Banerjee, Imon
    Ling, Yuan
    Chen, Matthew C.
    Hasan, Sadid A.
    Langlotz, Curtis P.
    Moradzadeh, Nathaniel
    Chapman, Brian
    Amrhein, Timothy
    Mong, David
    Rubin, Daniel L.
    Farri, Oladimeji
    Lungren, Matthew P.
    [J]. ARTIFICIAL INTELLIGENCE IN MEDICINE, 2019, 97 : 79 - 88
  • [8] Comparative Analysis of Convolutional Neural Network and LSTM in Text-Based Sentiment Classification
    Kalaivani, M. S.
    Jayalakshmi, S.
    [J]. PROCEEDINGS OF THE 2021 FIFTH INTERNATIONAL CONFERENCE ON I-SMAC (IOT IN SOCIAL, MOBILE, ANALYTICS AND CLOUD) (I-SMAC 2021), 2021, : 1205 - 1211
  • [9] Text classification based recurrent neural network
    Hu, Haojin
    Liao, Mengfan
    Zhang, Chao
    Jing, Yanmei
    [J]. PROCEEDINGS OF 2020 IEEE 5TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2020), 2020, : 657 - 660
  • [10] Review of Graph Neural Network in Text Classification
    Malekzadeh, Masoud
    Hajibabaee, Parisa
    Heidari, Maryam
    Zad, Samira
    Uzuner, Ozlem
    Jones, James H. Jr Jr
    [J]. 2021 IEEE 12TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2021, : 84 - 91