Attention-based aspect sentiment classification using enhanced learning through CNN-BiLSTM networks

被引:32
|
作者
Ayetiran, Eniafe Festus [1 ]
机构
[1] Achievers Univ, Dept Math Sci, Owo, Nigeria
关键词
Transfer learning; Attention; CNN; Bi LSTM; Joint learning;
D O I
10.1016/j.knosys.2022.109409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep neural networks (DNN) techniques for aspect -based sentiment classification have been widely studied. The success of these methods depends largely on training data which are often inadequate because of the rigor involved in manually tagging large collection of opinionated texts. Attempts have been made to transfer knowledge from document -level to aspect -level sentiment task. However, the success of this approach is also dependent on the model because aspect sentiment data like other type of texts contain complex semantic features. In this paper, we present an attention -based deep learning technique which jointly learns on document and aspect -level sentiment data and which also transfers learning from the document -level data to aspect -level sentiment classification. It basically consists of a convolutional layer and a bidirectional long short-term memory (BiLSTM) layer. The first variant of our technique uses convolutional neural network (CNN) to extract high-level semantic features. The output of the feature extraction is then fed into the BiLSTM layer which captures the contextual feature representation of the texts. The second variant applies the BiLSTM layer directly on the input data. In both variants, the output hidden representation is passed to an output layer using softmax activation function for sentiment polarity classification. We evaluate our model on four standard benchmark datasets which shows the effectiveness of our approach with improvements over baselines. We also conduct ablation studies to show the effect of the different document -level weights on the learning techniques. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Aspect Based Sentiment Analysis With Feature Enhanced Attention CNN-BiLSTM
    Meng, Wei
    Wei, Yongqing
    Liu, Peiyu
    Zhu, Zhenfang
    Yin, Hongxia
    [J]. IEEE ACCESS, 2019, 7 : 167240 - 167249
  • [2] Chinese News Text Classification based on Attention-based CNN-BiLSTM
    Wang, Meng
    Cai, Qiong
    Wang, Liya
    Li, Jun
    Wang, Xiaoke
    [J]. MIPPR 2019: PATTERN RECOGNITION AND COMPUTER VISION, 2020, 11430
  • [3] Music Audio Sentiment Classification Based on CNN-BiLSTM and Attention Model
    Chen Zhen
    Liu Changhui
    [J]. 2021 4TH INTERNATIONAL CONFERENCE ON ROBOTICS, CONTROL AND AUTOMATION ENGINEERING (RCAE 2021), 2021, : 156 - 160
  • [4] CBMAFM: CNN-BiLSTM Multi-Attention Fusion Mechanism for sentiment classification
    Mayur Wankhade
    Chandra Sekhara Rao Annavarapu
    Ajith Abraham
    [J]. Multimedia Tools and Applications, 2024, 83 : 51755 - 51786
  • [5] CBMAFM: CNN-BiLSTM Multi-Attention Fusion Mechanism for sentiment classification
    Wankhade, Mayur
    Annavarapu, Chandra Sekhara Rao
    Abraham, Ajith
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (17) : 51755 - 51786
  • [6] An attention-based CNN-BiLSTM hybrid neural network enhanced with features of discrete wavelet transformation for fetal acidosis classification
    Liu, Mujun
    Lu, Yaosheng
    Long, Shun
    Bai, Jieyun
    Lian, Wanmin
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 186
  • [7] An attention-based CNN-BiLSTM model for depression detection on social media text
    Thekkekara, Joel Philip
    Yongchareon, Sira
    Liesaputra, Veronica
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 249
  • [8] Consumer reviews sentiment analysis based on CNN-BiLSTM
    Guo X.
    Zhao N.
    Cui S.
    [J]. 1600, Systems Engineering Society of China (40): : 653 - 663
  • [9] Attention-Based CNN-BiLSTM for Sleep State Classification of Spatiotemporal Wide-Field Calcium Imaging Data
    Zhang, Xiaohui
    Landsness, Eric C.
    Culver, Joseph P.
    Lee, Jin-Moo
    Anastasio, Mark A.
    [J]. NEURAL IMAGING AND SENSING 2023, 2023, 12365
  • [10] Attention-based CNN-BiLSTM for sleep state classification of spatiotemporal wide-field calcium imaging data
    Zhang, Xiaohui
    Landsness, Eric C.
    Miao, Hanyang
    Chen, Wei
    Tang, Michelle J.
    Brier, Lindsey M.
    Culver, Joseph P.
    Lee, Jin-Moo
    Anastasio, Mark A.
    [J]. JOURNAL OF NEUROSCIENCE METHODS, 2024, 411