Aspect-based sentiment analysis with component focusing multi-head co-attention networks

被引:22
|
作者
Cheng, Li-Chen [1 ]
Chen, Yen-Liang [2 ]
Liao, Yuan-Yu [2 ]
机构
[1] Natl Taipei Univ Technol, Dept Informat & Finance Management, Taipei 100, Taiwan
[2] Natl Cent Univ, Chungli 320, Taiwan
关键词
Deep learning; Neural network; Sentiment analysis; BERT;
D O I
10.1016/j.neucom.2022.03.027
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
User-generated content based on customer opinions and experience has become a rich source of valuable information for enterprises. The purpose of aspect-based sentiment analysis is to predict the sentiment polarity of specific targets from user-generated content. This study proposes a component focusing multi-head co-attention network model which contains three modules: extended context, component focusing, and multi-headed co-attention, designed to improve upon problems encountered in the past. The extended context module improves the ability of bidirectional encoder representations from trans-formers to handle aspect-based sentiment analysis tasks, and the component focusing module improves the weighting of adjectives and adverbs, to alleviate the problem of average pooling, which treats every word as an equally important term. The multi-head co-attention network is applied to learn the impor-tant words in a multi-word target before acquiring the context representation and performs the attention mechanism on the sequence data. The performance of the proposed model is evaluated in extensive experiments on publicly available datasets. The results show that the performance of the proposed model is better than that of the recent state-of-the-art models.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:9 / 17
页数:9
相关论文
共 50 条
  • [1] Multi-Head Self-Attention Transformation Networks for Aspect-Based Sentiment Analysis
    Lin, Yuming
    Wang, Chaoqiang
    Song, Hao
    Li, You
    [J]. IEEE ACCESS, 2021, 9 : 8762 - 8770
  • [2] Deep Multi-Head Attention Network for Aspect-Based Sentiment Analysis
    Yan, Danfeng
    Chen, Jiyuan
    Cui, Jianfei
    Shan, Ao
    Shi, Wenting
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 695 - 700
  • [3] Memory network with hierarchical multi-head attention for aspect-based sentiment analysis
    Yuzhong Chen
    Tianhao Zhuang
    Kun Guo
    [J]. Applied Intelligence, 2021, 51 : 4287 - 4304
  • [4] Memory network with hierarchical multi-head attention for aspect-based sentiment analysis
    Chen, Yuzhong
    Zhuang, Tianhao
    Guo, Kun
    [J]. APPLIED INTELLIGENCE, 2021, 51 (07) : 4287 - 4304
  • [5] Attention-Enhanced Graph Convolutional Networks for Aspect-Based Sentiment Classification with Multi-Head Attention
    Xu, Guangtao
    Liu, Peiyu
    Zhu, Zhenfang
    Liu, Jie
    Xu, Fuyong
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (08):
  • [6] Affective-Knowledge-Enhanced Graph Convolutional Networks for Aspect-Based Sentiment Analysis with Multi-Head Attention
    Cui, Xiaodong
    Tao, Wenbiao
    Cui, Xiaohui
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (07):
  • [7] Multi-head self-attention based gated graph convolutional networks for aspect-based sentiment classification
    Luwei Xiao
    Xiaohui Hu
    Yinong Chen
    Yun Xue
    Bingliang Chen
    Donghong Gu
    Bixia Tang
    [J]. Multimedia Tools and Applications, 2022, 81 : 19051 - 19070
  • [8] Multi-head self-attention based gated graph convolutional networks for aspect-based sentiment classification
    Xiao, Luwei
    Hu, Xiaohui
    Chen, Yinong
    Xue, Yun
    Chen, Bingliang
    Gu, Donghong
    Tang, Bixia
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (14) : 19051 - 19070
  • [9] Targeted Aspect-Based Multimodal Sentiment Analysis: An Attention Capsule Extraction and Multi-Head Fusion Network
    Gu, Donghong
    Wang, Jiaqian
    Cai, Shaohua
    Yang, Chi
    Song, Zhengxin
    Zhao, Haoliang
    Xiao, Luwei
    Wang, Hua
    [J]. IEEE ACCESS, 2021, 9 : 157329 - 157336
  • [10] Co-attention networks based on aspect and context for aspect-level sentiment analysis
    Liu, MeiZhen
    Zhou, FengYu
    Chen, Ke
    Zhao, Yang
    [J]. KNOWLEDGE-BASED SYSTEMS, 2021, 217