Aspect-based sentiment classification with multi-attention network

被引:76
|
作者
Xu, Qiannan [1 ]
Zhu, Li [1 ]
Dai, Tao [1 ]
Yan, Chengbing [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Software Engn, Xian, Shaanxi, Peoples R China
关键词
Aspect-based sentiment classification; Sentiment analysis; Attention mechanism; Neural network; ASPECT EXTRACTION;
D O I
10.1016/j.neucom.2020.01.024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aspect-based sentiment classification aims to predict the sentiment polarity of an aspect term in a sentence instead of the sentiment polarity of the entire sentence. Neural networks have been used for this task, and most existing methods have adopted sequence models, which require more training time than other models. When an aspect term comprises several words, most methods involve a coarse-level attention mechanism to model the aspect, and this may result in information loss. In this paper, we propose a multi-attention network (MAN) to address the above problems. The proposed model uses intra- and inter-level attention mechanisms. In the former, the MAN employs a transformer encoder instead of a sequence model to reduce training time. The transformer encoder encodes the input sentence in parallel and preserves long-distance sentiment relations. In the latter, the MAN uses a global and a local attention module to capture differently grained interactive information between aspect and context. The global attention module focuses on the entire relation, whereas the local attention module considers interactions at word level; this was often neglected in previous studies. Experiments demonstrate that the proposed model achieves superior results when compared to the baseline models. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:135 / 143
页数:9
相关论文
共 50 条
  • [31] A Multi-Layer Network for Aspect-Based Cross-Lingual Sentiment Classification
    Sattar, Kalim
    Umer, Qasim
    Vasbieva, Dinara G.
    Chung, Sungwook
    Latif, Zohaib
    Lee, Choonhwa
    [J]. IEEE ACCESS, 2021, 9 : 133961 - 133973
  • [32] Dual-Level Attention Based on Heterogeneous Graph Convolution Network for Aspect-Based Sentiment Classification
    Yuan, Peng
    Jiang, Lei
    Liu, Jianxun
    Zhou, Dong
    Li, Pei
    Gao, Yang
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON SMART CLOUD (SMARTCLOUD 2020), 2020, : 74 - 77
  • [33] Attention-Enhanced Graph Convolutional Networks for Aspect-Based Sentiment Classification with Multi-Head Attention
    Xu, Guangtao
    Liu, Peiyu
    Zhu, Zhenfang
    Liu, Jie
    Xu, Fuyong
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (08):
  • [34] Lightweight multilayer interactive attention network for aspect-based sentiment analysis
    Zheng, Wenjun
    Zhang, Shunxiang
    Yang, Cheng
    Hu, Peng
    [J]. CONNECTION SCIENCE, 2023, 35 (01)
  • [35] Knowledge Guided Capsule Attention Network for Aspect-Based Sentiment Analysis
    Zhang, Bowen
    Li, Xutao
    Xu, Xiaofei
    Leung, Ka-Cheong
    Chen, Zhiyao
    Ye, Yunming
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2020, 28 : 2538 - 2551
  • [36] Aspect-Based Sentiment Analysis with Position Embedding Interactive Attention Network
    Xiang, Yan
    Zhang, Jiqun
    Zhang, Zhoubin
    Yu, Zhengtao
    Xian, Yantuan
    [J]. JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2022, 18 (05): : 614 - 627
  • [37] Explaining a Neural Attention Model for Aspect-Based Sentiment Classification Using Diagnostic Classification
    Meijer, Lisa
    Frasincar, Flavius
    Trusca, Maria Mihaela
    [J]. 36TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2021, 2021, : 821 - 827
  • [38] Aspect Detection and Sentiment Classification using Deep Neural Network for Indonesian Aspect-Based Sentiment Analysis
    Ilmania, Arfinda
    Abdurrahman
    Cahyawijaya, Samuel
    Purwarianti, Ayu
    [J]. 2018 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP), 2018, : 62 - 67
  • [39] Improving aspect-based neural sentiment classification with lexicon enhancement, attention regularization and sentiment induction
    Bao, Lingxian
    Lambert, Patrik
    Badia, Toni
    [J]. NATURAL LANGUAGE ENGINEERING, 2024, 30 (01) : 1 - 30
  • [40] Attention-based Sentiment Reasoner for aspect-based sentiment analysis
    Liu, Ning
    Shen, Bo
    Zhang, Zhenjiang
    Zhang, Zhiyuan
    Mi, Kun
    [J]. HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2019, 9 (01)