Multi-head self-attention based gated graph convolutional networks for aspect-based sentiment classification

被引:0
|
作者
Luwei Xiao
Xiaohui Hu
Yinong Chen
Yun Xue
Bingliang Chen
Donghong Gu
Bixia Tang
机构
[1] South China Normal University,Guangdong Provincial Key Laboratory of Quantum Engineering and Quantum Materials, GPETR Center for Quantum Precision Measurement, SPTE, School of Physics and Telecommunication Engineering
[2] Arizona State University,School of Computing, Informatics, and Decision Systems Engineering
来源
关键词
Aspect-based sentiment classification; Multi-head Self-Attention; Gated graph convolutional networks; Syntax-aware Context Dynamic Weighted;
D O I
暂无
中图分类号
学科分类号
摘要
Aspect-based sentiment classification aims to predict the sentiment polarity of specific aspects appeared in a sentence. Nowadays, most current methods mainly focus on the semantic information by exploiting traditional attention mechanisms combined with recurrent neural networks to capture the interaction between the contexts and the targets. However, these models did not consider the importance of the relevant syntactical constraints. In this paper, we propose to employ a novel gated graph convolutional networks on the dependency tree to encode syntactical information, and we design a Syntax-aware Context Dynamic Weighted layer to guide our model to pay more attention to the local syntax-aware context. Moreover, Multi-head Attention is utilized for capturing both semantic information and interactive information between semantics and syntax. We conducted experiments on five datasets and the results demonstrate the effectiveness of the proposed model.
引用
收藏
页码:19051 / 19070
页数:19
相关论文
共 50 条
  • [31] Hierarchical Gated Convolutional Networks with Multi-Head Attention for Text Classification
    Du, Haizhou
    Qian, Jingu
    2018 5TH INTERNATIONAL CONFERENCE ON SYSTEMS AND INFORMATICS (ICSAI), 2018, : 1170 - 1175
  • [32] Aspect-Guided Multi-Graph Convolutional Networks for Aspect-based Sentiment Analysis
    Wang, Yong
    Yang, Ningchuang
    Miao, Duoqian
    Chen, Qiuyi
    Data Intelligence, 2024, 6 (03): : 771 - 791
  • [33] Aspect-Based Sentiment Classification Using Interactive Gated Convolutional Network
    Kumar, Avinash
    Narapareddy, Vishnu Teja
    Srikanth, Veerubhotla Aditya
    Neti, Lalita Bhanu Murthy
    Malapati, Aruna
    IEEE ACCESS, 2020, 8 : 22445 - 22453
  • [34] Aspect-Guided Multi-Graph Convolutional Networks for Aspect-based Sentiment Analysis
    Yong Wang
    Ningchuang Yang
    Duoqian Miao
    Qiuyi Chen
    Data Intelligence, 2024, 6 (03) : 771 - 791
  • [35] Arrhythmia classification algorithm based on multi-head self-attention mechanism
    Wang, Yue
    Yang, Guanci
    Li, Shaobo
    Li, Yang
    He, Ling
    Liu, Dan
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 79
  • [36] Bidirectional Edge-Enhanced Graph Convolutional Networks for Aspect-based Sentiment Classification
    Du, Jinyang
    Zhang, Yin
    Yue, Binglei
    Chen, Min
    2021 IEEE 45TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2021), 2021, : 1599 - 1604
  • [37] Aspect-Level Sentiment Analysis Based on Self-Attention and Graph Convolutional Network
    Chen K.
    Huang C.
    Lin H.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2024, 47 (01): : 127 - 132
  • [38] Enhanced Multi-Head Self-Attention Graph Neural Networks for Session-based Recommendation
    Pan, Wenhao
    Yang, Kai
    ENGINEERING LETTERS, 2022, 30 (01) : 37 - 44
  • [39] DRGAT: Dual-relational graph attention networks for aspect-based sentiment classification
    You, Lan
    Peng, Jiaheng
    Jin, Hong
    Claramunt, Christophe
    Zeng, Haoqiu
    Zhang, Zhen
    INFORMATION SCIENCES, 2024, 668
  • [40] Interactive Multi-Head Attention Networks for Aspect-Level Sentiment Classification
    Zhang, Qiuyue
    Lu, Ran
    Wang, Qicai
    Zhu, Zhenfang
    Liu, Peiyu
    IEEE ACCESS, 2019, 7 : 160017 - 160028