Multi-head self-attention based gated graph convolutional networks for aspect-based sentiment classification

被引:0
|
作者
Luwei Xiao
Xiaohui Hu
Yinong Chen
Yun Xue
Bingliang Chen
Donghong Gu
Bixia Tang
机构
[1] South China Normal University,Guangdong Provincial Key Laboratory of Quantum Engineering and Quantum Materials, GPETR Center for Quantum Precision Measurement, SPTE, School of Physics and Telecommunication Engineering
[2] Arizona State University,School of Computing, Informatics, and Decision Systems Engineering
来源
关键词
Aspect-based sentiment classification; Multi-head Self-Attention; Gated graph convolutional networks; Syntax-aware Context Dynamic Weighted;
D O I
暂无
中图分类号
学科分类号
摘要
Aspect-based sentiment classification aims to predict the sentiment polarity of specific aspects appeared in a sentence. Nowadays, most current methods mainly focus on the semantic information by exploiting traditional attention mechanisms combined with recurrent neural networks to capture the interaction between the contexts and the targets. However, these models did not consider the importance of the relevant syntactical constraints. In this paper, we propose to employ a novel gated graph convolutional networks on the dependency tree to encode syntactical information, and we design a Syntax-aware Context Dynamic Weighted layer to guide our model to pay more attention to the local syntax-aware context. Moreover, Multi-head Attention is utilized for capturing both semantic information and interactive information between semantics and syntax. We conducted experiments on five datasets and the results demonstrate the effectiveness of the proposed model.
引用
下载
收藏
页码:19051 / 19070
页数:19
相关论文
共 50 条
  • [1] Multi-head self-attention based gated graph convolutional networks for aspect-based sentiment classification
    Xiao, Luwei
    Hu, Xiaohui
    Chen, Yinong
    Xue, Yun
    Chen, Bingliang
    Gu, Donghong
    Tang, Bixia
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (14) : 19051 - 19070
  • [2] Attention-Enhanced Graph Convolutional Networks for Aspect-Based Sentiment Classification with Multi-Head Attention
    Xu, Guangtao
    Liu, Peiyu
    Zhu, Zhenfang
    Liu, Jie
    Xu, Fuyong
    APPLIED SCIENCES-BASEL, 2021, 11 (08):
  • [3] Multi-Head Self-Attention Transformation Networks for Aspect-Based Sentiment Analysis
    Lin, Yuming
    Wang, Chaoqiang
    Song, Hao
    Li, You
    IEEE ACCESS, 2021, 9 : 8762 - 8770
  • [4] Convolutional multi-head self-attention on memory for aspect sentiment classification
    Zhang, Yaojie
    Xu, Bing
    Zhao, Tiejun
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2020, 7 (04) : 1038 - 1044
  • [5] Convolutional Multi-Head Self-Attention on Memory for Aspect Sentiment Classification
    Yaojie Zhang
    Bing Xu
    Tiejun Zhao
    IEEE/CAA Journal of Automatica Sinica, 2020, 7 (04) : 1038 - 1044
  • [6] Affective-Knowledge-Enhanced Graph Convolutional Networks for Aspect-Based Sentiment Analysis with Multi-Head Attention
    Cui, Xiaodong
    Tao, Wenbiao
    Cui, Xiaohui
    APPLIED SCIENCES-BASEL, 2023, 13 (07):
  • [7] Graph Convolutional Networks with Bidirectional Attention for Aspect-Based Sentiment Classification
    Liu, Jie
    Liu, Peiyu
    Zhu, Zhenfang
    Li, Xiaowen
    Xu, Guangtao
    APPLIED SCIENCES-BASEL, 2021, 11 (04): : 1 - 15
  • [8] Aspect Based Sentiment Analysis with Self-Attention and Gated Convolutional Networks
    Yang, Jian
    Yang, Juan
    PROCEEDINGS OF 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2020), 2020, : 146 - 149
  • [9] Graph convolutional networks with hierarchical multi-head attention for aspect-level sentiment classification
    Li, Xiaowen
    Lu, Ran
    Liu, Peiyu
    Zhu, Zhenfang
    JOURNAL OF SUPERCOMPUTING, 2022, 78 (13): : 14846 - 14865
  • [10] Graph convolutional networks with hierarchical multi-head attention for aspect-level sentiment classification
    Xiaowen Li
    Ran Lu
    Peiyu Liu
    Zhenfang Zhu
    The Journal of Supercomputing, 2022, 78 : 14846 - 14865