A Self-Attention-Based Multi-Level Fusion Network for Aspect Category Sentiment Analysis

被引:3
|
作者
Tian, Dong [1 ]
Shi, Jia [1 ]
Feng, Jianying [1 ]
机构
[1] China Agr Univ, Coll Informat & Elect Engn, 537,17 Qinghuadonglu, Beijing 100083, Peoples R China
关键词
Aspect category sentiment analysis; Self-attention; Natural language processing; Fusion mechanism; Text analysis;
D O I
10.1007/s12559-023-10160-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aspect category-based sentiment analysis (ACSA) is a fine-grained sentiment analysis approach for predicting the sentiment polarity associated with the different aspect categories in a text. While numerous strategies have incorporated attention mechanisms to generate contextual features for specific aspectual objectives, their sole use may be influenced by the sentiments conveyed in other aspect categories. This can occur when aspectual targets are absent from the sentence and when words carry varying contextual sentiments across multiple aspect categories. This paper introduces the attention-based multi-level feature aggregation (AMFA) network, which simultaneously considers local and global information by applying attention to convolutional filters. It further employs context-guided self-attention modules at multiple levels to efficiently amalgamate learned different aspects and the interactions between contextual features within a cohesive framework. We tested the proposed approach on four public datasets. The results demonstrated the efficiency of our model in extracting more precise semantics and sentiments related to specific feature categories. To examine the practicality of AMFA, we constructed an online review dataset of table grapes from an e-commerce platform, where our model outperformed the baseline models with an accuracy of 88% and a macro-averaged F-1 score of 73.23%. We also validated the effectiveness of each AMFA module by testing them separately on all datasets. Experimental results prove that our proposed model is adept at semantically separating aspect embeddings from words in sentences and minimizing the impact of irrelevant information. Additionally, the robustness of our model is substantiated by supplementary experiments conducted on a constructed Chinese dataset.
引用
收藏
页码:1372 / 1390
页数:19
相关论文
共 50 条
  • [31] Bi-graph attention network for aspect category sentiment classification
    Shan, Yongxue
    Che, Chao
    Wei, Xiaopeng
    Wang, Xiaodong
    Zhu, Yongjun
    Jin, Bo
    KNOWLEDGE-BASED SYSTEMS, 2022, 258
  • [32] Multi-level feature fusion capsule network with self-attention for facial expression recognition
    Huang, Zhiji
    Yu, Songsen
    Liang, Jun
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (02)
  • [33] Filter gate network based on multi-head attention for aspect-level sentiment classification
    Zhou, Ziyu
    Liu, Fang'ai
    NEUROCOMPUTING, 2021, 441 (441) : 214 - 225
  • [34] Attention-based Multi-Level Fusion Network for Light Field Depth Estimation
    Chen, Jiaxin
    Zhang, Shuo
    Lin, Youfang
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 1009 - 1017
  • [35] A Deep Multi-level Attentive Network for Multimodal Sentiment Analysis
    Yadav, Ashima
    Vishwakarma, Dinesh Kumar
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (01)
  • [36] Multi-Level Context Pyramid Network for Visual Sentiment Analysis
    Ou, Haochun
    Qing, Chunmei
    Xu, Xiangmin
    Jin, Jianxiu
    SENSORS, 2021, 21 (06) : 1 - 20
  • [37] Multi-level graph neural network for text sentiment analysis
    Liao, Wenxiong
    Zeng, Bi
    Liu, Jianqi
    Wei, Pengfei
    Cheng, Xiaochun
    Zhang, Weiwen
    COMPUTERS & ELECTRICAL ENGINEERING, 2021, 92
  • [38] Collaborative Filtering system based on multi-level user clustering and aspect sentiment
    Poudel S.
    Bikdash M.
    Data and Information Management, 2022, 6 (04):
  • [39] MSRL-Net: A multi-level semantic relation-enhanced learning network for aspect-based sentiment analysis
    Hu, Zhenda
    Wang, Zhaoxia
    Wang, Yinglin
    Tan, Ah-Hwee
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 217
  • [40] Memory network with hierarchical multi-head attention for aspect-based sentiment analysis
    Chen, Yuzhong
    Zhuang, Tianhao
    Guo, Kun
    APPLIED INTELLIGENCE, 2021, 51 (07) : 4287 - 4304