Multi-head self-attention based gated graph convolutional networks for aspect-based sentiment classification

被引:0
|
作者
Luwei Xiao
Xiaohui Hu
Yinong Chen
Yun Xue
Bingliang Chen
Donghong Gu
Bixia Tang
机构
[1] South China Normal University,Guangdong Provincial Key Laboratory of Quantum Engineering and Quantum Materials, GPETR Center for Quantum Precision Measurement, SPTE, School of Physics and Telecommunication Engineering
[2] Arizona State University,School of Computing, Informatics, and Decision Systems Engineering
来源
关键词
Aspect-based sentiment classification; Multi-head Self-Attention; Gated graph convolutional networks; Syntax-aware Context Dynamic Weighted;
D O I
暂无
中图分类号
学科分类号
摘要
Aspect-based sentiment classification aims to predict the sentiment polarity of specific aspects appeared in a sentence. Nowadays, most current methods mainly focus on the semantic information by exploiting traditional attention mechanisms combined with recurrent neural networks to capture the interaction between the contexts and the targets. However, these models did not consider the importance of the relevant syntactical constraints. In this paper, we propose to employ a novel gated graph convolutional networks on the dependency tree to encode syntactical information, and we design a Syntax-aware Context Dynamic Weighted layer to guide our model to pay more attention to the local syntax-aware context. Moreover, Multi-head Attention is utilized for capturing both semantic information and interactive information between semantics and syntax. We conducted experiments on five datasets and the results demonstrate the effectiveness of the proposed model.
引用
收藏
页码:19051 / 19070
页数:19
相关论文
共 50 条
  • [21] An interactive multi-head self-attention capsule network model for aspect sentiment classification
    Lina She
    Hongfang Gong
    Siyu Zhang
    The Journal of Supercomputing, 2024, 80 : 9327 - 9352
  • [22] GRAPH ATTENTION NETWORKS WITH STRUCTURAL ATTENTION MECHANISM FOR ASPECT-BASED SENTIMENT CLASSIFICATION
    Li, Xiaowen
    Lu, Ran
    Liu, Peiyu
    Zhu, Zhengfang
    JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2021, 22 (09) : 1805 - 1819
  • [23] Aspect-based Sentiment Classification with Dual Cooperative Graph Attention Networks
    Cui, Xiyong
    Fang, Wei
    2022 5TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND NATURAL LANGUAGE PROCESSING, MLNLP 2022, 2022, : 135 - 141
  • [24] Memory network with hierarchical multi-head attention for aspect-based sentiment analysis
    Yuzhong Chen
    Tianhao Zhuang
    Kun Guo
    Applied Intelligence, 2021, 51 : 4287 - 4304
  • [25] Memory network with hierarchical multi-head attention for aspect-based sentiment analysis
    Chen, Yuzhong
    Zhuang, Tianhao
    Guo, Kun
    APPLIED INTELLIGENCE, 2021, 51 (07) : 4287 - 4304
  • [26] Lexical attention and aspect-oriented graph convolutional networks for aspect-based sentiment analysis
    Li, Wenwen
    Yin, Shiqun
    Pu, Ting
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (03) : 1643 - 1654
  • [27] Sentiment interaction and multi-graph perception with graph convolutional networks for aspect-based sentiment analysis
    Lu, Qiang
    Sun, Xia
    Sutcliffe, Richard
    Xing, Yaqiong
    Zhang, Hao
    KNOWLEDGE-BASED SYSTEMS, 2022, 256
  • [28] Multiple graph convolutional networks for aspect-based sentiment analysis
    Yuting Ma
    Rui Song
    Xue Gu
    Qiang Shen
    Hao Xu
    Applied Intelligence, 2023, 53 : 12985 - 12998
  • [29] Multiple graph convolutional networks for aspect-based sentiment analysis
    Ma, Yuting
    Song, Rui
    Gu, Xue
    Shen, Qiang
    Xu, Hao
    APPLIED INTELLIGENCE, 2023, 53 (10) : 12985 - 12998
  • [30] Improving Aspect-based Sentiment Analysis with Gated Graph Convolutional Networks and Syntax-based Regulation
    Ben Veyseh, Amir Pouran
    Nouri, Nasim
    Dernoncourt, Franck
    Quan Hung Tran
    Dou, Dejing
    Thien Huu Nguyen
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020, : 4543 - 4548