Aspect-based sentiment analysis with component focusing multi-head co-attention networks

被引:22
|
作者
Cheng, Li-Chen [1 ]
Chen, Yen-Liang [2 ]
Liao, Yuan-Yu [2 ]
机构
[1] Natl Taipei Univ Technol, Dept Informat & Finance Management, Taipei 100, Taiwan
[2] Natl Cent Univ, Chungli 320, Taiwan
关键词
Deep learning; Neural network; Sentiment analysis; BERT;
D O I
10.1016/j.neucom.2022.03.027
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
User-generated content based on customer opinions and experience has become a rich source of valuable information for enterprises. The purpose of aspect-based sentiment analysis is to predict the sentiment polarity of specific targets from user-generated content. This study proposes a component focusing multi-head co-attention network model which contains three modules: extended context, component focusing, and multi-headed co-attention, designed to improve upon problems encountered in the past. The extended context module improves the ability of bidirectional encoder representations from trans-formers to handle aspect-based sentiment analysis tasks, and the component focusing module improves the weighting of adjectives and adverbs, to alleviate the problem of average pooling, which treats every word as an equally important term. The multi-head co-attention network is applied to learn the impor-tant words in a multi-word target before acquiring the context representation and performs the attention mechanism on the sequence data. The performance of the proposed model is evaluated in extensive experiments on publicly available datasets. The results show that the performance of the proposed model is better than that of the recent state-of-the-art models.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:9 / 17
页数:9
相关论文
共 50 条
  • [41] Polarity enriched attention network for aspect-based sentiment analysis
    Wadawadagi R.
    Pagi V.
    [J]. International Journal of Information Technology, 2022, 14 (6) : 2767 - 2778
  • [42] Aspect-Based Sentiment Analysis on Convolution Neural Network and Multi-Hierarchical Attention
    Lou, Zhixiong
    Wu, Yuexin
    Fan, Chunxiao
    Chen, Wentong
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE (TAAI 2020), 2020, : 193 - 198
  • [43] Relational Graph Attention Network for Aspect-based Sentiment Analysis
    Wang, Kai
    Shen, Weizhou
    Yang, Yunyi
    Quan, Xiaojun
    Wang, Rui
    [J]. 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 3229 - 3238
  • [44] Learning Polarity Embedding Attention for Aspect-based Sentiment Analysis
    Wadawadagi, Ramesh
    Hatture, Sanjeevakumar M.
    Pagi, Veerappa
    [J]. INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2024, 33 (01)
  • [45] Aspect-Guided Multi-Graph Convolutional Networks for Aspect-based Sentiment Analysis
    Yong Wang
    Ningchuang Yang
    Duoqian Miao
    Qiuyi Chen
    [J]. Data Intelligence., 2024, 6 (03) - 791
  • [46] Graph Convolutional Networks with Bidirectional Attention for Aspect-Based Sentiment Classification
    Liu, Jie
    Liu, Peiyu
    Zhu, Zhenfang
    Li, Xiaowen
    Xu, Guangtao
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (04): : 1 - 15
  • [47] Earlier Attention? Aspect-Aware LSTM for Aspect-Based Sentiment Analysis
    Xing, Bowen
    Liao, Lejian
    Song, Dandan
    Wang, Jingang
    Zhang, Fuzheng
    Wang, Zhongyuan
    Huang, Heyan
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 5313 - 5319
  • [48] Combining Multi-Head Attention and Sparse Multi-Head Attention Networks for Session-Based Recommendation
    Zhao, Zhiwei
    Wang, Xiaoye
    Xiao, Yingyuan
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [49] CO-ATTENTION NETWORK AND LOW-RANK BILINEAR POOLING FOR ASPECT BASED SENTIMENT ANALYSIS
    Zhang, Peiran
    Zhu, Hongbo
    Xiong, Tao
    Yang, Yihui
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 6725 - 6729
  • [50] Sentiment Difficulty in Aspect-Based Sentiment Analysis
    Chifu, Adrian-Gabriel
    Fournier, Sebastien
    [J]. MATHEMATICS, 2023, 11 (22)