Attention-based Spatialized Word Embedding Bi-LSTM Model for Sentiment Analysis

被引:0
|
作者
Zhu, Kun [1 ]
Samsudin, Nur Hana [1 ]
机构
[1] Univ Sains Malaysia, Sch Comp Sci, Usm Penang 11800, Malaysia
来源
关键词
Attention-based deep neural network; data mining; deep learning; natural language processing; sentiment analysis; BIDIRECTIONAL LSTM; NEURAL-NETWORKS; RECOGNITION; RUMORS; CNN;
D O I
10.47836/pjst.32.1.05
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Movie reviews provide a medium of communication for the movie fans community. Movie reviews not only help viewers and potential viewers to obtain a general opinion about a movie but also allow the fans to construct an opinion of the movie. In this work, an analysis of over 60,000 movie reviews has been implemented to find meaningful text representation via text embedding. We improved the text embedding by proposing an attention-based Bidirectional Long-Short Term Memory (Bi-LSTM) network by using over 60,000 movie review text data as the training set and over 20,000 movie review text data as the testing set. Based on the data features, we performed a probabilistic analysis of the information related to words and phrases, combined the analysis results with text embedding, spatialized the text embedding, and compared the performance of the proposed attention-based spatialized word embedding Bi-LSTM model with several traditional machine learning models. The attention-based spatialized word embedding Bi-LSTM model proposed in this paper achieves an F1 score of 0.91 on the movie review sentiment classification dataset, with a prediction accuracy of 91%, outperforming the results of the current state-of-the-art research. The model can effectively identify the sentimental tendencies of movie reviews and use the analyzed sentimental tendencies to guide consumers in their consumption and obtain feedback on movie content.
引用
收藏
页码:79 / 98
页数:20
相关论文
共 50 条
  • [1] Attention-Based CNN and Bi-LSTM Model Based on TF-IDF and GloVe Word Embedding for Sentiment Analysis
    Kamyab, Marjan
    Liu, Guohua
    Adjeisah, Michael
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (23):
  • [2] Attention-Based Bi-LSTM Model for Arabic Depression Classification
    Almars, Abdulqader M.
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 71 (02): : 3091 - 3106
  • [3] Sentiment Analysis Model Using Word2vec, Bi-LSTM and Attention Mechanism
    Jaca-Madariaga, M.
    Zarrabeitia-Bilbao, E.
    Rio-Belver, R. M.
    Moens, M. F.
    [J]. IOT AND DATA SCIENCE IN ENGINEERING MANAGEMENT, 2023, 160 : 239 - 244
  • [4] Twitter Sentiment Analysis via Bi-sense Emoji Embedding and Attention-based LSTM
    Chen, Yuxiao
    Yuan, Jianbo
    You, Quanzeng
    Luo, Jiebo
    [J]. PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 117 - 125
  • [5] Attention-based Bi-LSTM Model for Anomalous HTTP Traffic Detection
    Yu, Yuqi
    Liu, Guannan
    Yan, Hanbing
    Li, Hong
    Guan, Hongchao
    [J]. 2018 15TH INTERNATIONAL CONFERENCE ON SERVICE SYSTEMS AND SERVICE MANAGEMENT (ICSSSM), 2018,
  • [6] CoBiCo: A model using multi-stage ConvNet with attention-based Bi-LSTM for efficient sentiment classification
    Ranjan, Roop
    Daniel, A. K.
    [J]. INTERNATIONAL JOURNAL OF KNOWLEDGE-BASED AND INTELLIGENT ENGINEERING SYSTEMS, 2023, 27 (01) : 1 - 24
  • [7] Hint-Embedding Attention-Based LSTM for Aspect Identification Sentiment Analysis
    Ahmed, Murtadha
    Chen, Qun
    Wang, Yanyan
    Li, Zhanhuai
    [J]. PRICAI 2019: TRENDS IN ARTIFICIAL INTELLIGENCE, PT II, 2019, 11671 : 569 - 581
  • [8] Attention-Based Bi-LSTM for Chinese Named Entity Recognition
    Zhang, Kai
    Ren, Weiping
    Zhang, Yangsen
    [J]. CHINESE LEXICAL SEMANTICS, CLSW 2018, 2018, 11173 : 643 - 652
  • [9] Attention-Based Bi-LSTM Network for Abusive Language Detection
    Nelatoori, Kiran Babu
    Kommanti, Hima Bindu
    [J]. IETE JOURNAL OF RESEARCH, 2023, 69 (11) : 7884 - 7892
  • [10] Sentiment analysis for user reviews using Bi-LSTM self-attention based CNN model
    Bhuvaneshwari, P.
    Rao, A. Nagaraja
    Robinson, Y. Harold
    Thippeswamy, M. N.
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (09) : 12405 - 12419