Aspect-based sentiment classification with multi-attention network

被引:76
|
作者
Xu, Qiannan [1 ]
Zhu, Li [1 ]
Dai, Tao [1 ]
Yan, Chengbing [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Software Engn, Xian, Shaanxi, Peoples R China
关键词
Aspect-based sentiment classification; Sentiment analysis; Attention mechanism; Neural network; ASPECT EXTRACTION;
D O I
10.1016/j.neucom.2020.01.024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aspect-based sentiment classification aims to predict the sentiment polarity of an aspect term in a sentence instead of the sentiment polarity of the entire sentence. Neural networks have been used for this task, and most existing methods have adopted sequence models, which require more training time than other models. When an aspect term comprises several words, most methods involve a coarse-level attention mechanism to model the aspect, and this may result in information loss. In this paper, we propose a multi-attention network (MAN) to address the above problems. The proposed model uses intra- and inter-level attention mechanisms. In the former, the MAN employs a transformer encoder instead of a sequence model to reduce training time. The transformer encoder encodes the input sentence in parallel and preserves long-distance sentiment relations. In the latter, the MAN uses a global and a local attention module to capture differently grained interactive information between aspect and context. The global attention module focuses on the entire relation, whereas the local attention module considers interactions at word level; this was often neglected in previous studies. Experiments demonstrate that the proposed model achieves superior results when compared to the baseline models. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:135 / 143
页数:9
相关论文
共 50 条
  • [1] Multi-Attention Network for Aspect Sentiment Analysis
    Han, Huiyu
    Li, Xiaoge
    Zhi, Shuting
    Wang, Haoyue
    [J]. 2019 8TH INTERNATIONAL CONFERENCE ON SOFTWARE AND COMPUTER APPLICATIONS (ICSCA 2019), 2019, : 22 - 26
  • [2] A Context Enhanced Attention Network for Aspect-Based Sentiment Classification
    Zhu, Yinglin
    Zheng, Wenbin
    Zheng, Jiaoling
    [J]. 2020 INTERNATIONAL CONFERENCE ON BIG DATA & ARTIFICIAL INTELLIGENCE & SOFTWARE ENGINEERING (ICBASE 2020), 2020, : 108 - 112
  • [3] Aspect opinion routing network with interactive attention for aspect-based sentiment classification
    Yang, Baiyu
    Han, Donghong
    Zhou, Rui
    Gao, Di
    Wu, Gang
    [J]. INFORMATION SCIENCES, 2022, 616 : 52 - 65
  • [4] Targeted sentiment classification with multi-attention network
    Tian, Xiao
    Liu, Peiyu
    Zhu, Zhenfang
    [J]. International Journal of Wireless and Mobile Computing, 2022, 23 (3-4) : 231 - 238
  • [5] Joint LSTM with multi-CNN network by hierarchical attention for aspect-based sentiment classification
    Qiao, Dong
    Yin, Chengfeng
    Jia, Zhen
    Li, Tianrui
    [J]. DEVELOPMENTS OF ARTIFICIAL INTELLIGENCE TECHNOLOGIES IN COMPUTATION AND ROBOTICS, 2020, 12 : 725 - 732
  • [6] A Multi-Attention Network for Aspect-Level Sentiment Analysis
    Zhang, Qiuyue
    Lu, Ran
    [J]. FUTURE INTERNET, 2019, 11 (07):
  • [7] Graph Attention Network for Financial Aspect-based Sentiment Classification with Contrastive Learning
    Huang, Zhenhuan
    Wu, Guansheng
    Qian, Xiang
    Zhang, Baochang
    [J]. 2022 IEEE 20TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), 2022, : 668 - 673
  • [8] Deep Multi-Head Attention Network for Aspect-Based Sentiment Analysis
    Yan, Danfeng
    Chen, Jiyuan
    Cui, Jianfei
    Shan, Ao
    Shi, Wenting
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 695 - 700
  • [9] Transformer Based Multi-Grained Attention Network for Aspect-Based Sentiment Analysis
    Sun, Jiahui
    Han, Ping
    Cheng, Zheng
    Wu, Enming
    Wang, Wenqing
    [J]. IEEE ACCESS, 2020, 8 : 211152 - 211163
  • [10] Multiple Interactive Attention Networks for Aspect-Based Sentiment Classification
    Zhang, Dianyuan
    Zhu, Zhenfang
    Lu, Qiang
    Pei, Hongli
    Wu, Wenqing
    Guo, Qiangqiang
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (06): : 1 - 15