A Self-Attention-Based Multi-Level Fusion Network for Aspect Category Sentiment Analysis

被引:3
|
作者
Tian, Dong [1 ]
Shi, Jia [1 ]
Feng, Jianying [1 ]
机构
[1] China Agr Univ, Coll Informat & Elect Engn, 537,17 Qinghuadonglu, Beijing 100083, Peoples R China
关键词
Aspect category sentiment analysis; Self-attention; Natural language processing; Fusion mechanism; Text analysis;
D O I
10.1007/s12559-023-10160-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aspect category-based sentiment analysis (ACSA) is a fine-grained sentiment analysis approach for predicting the sentiment polarity associated with the different aspect categories in a text. While numerous strategies have incorporated attention mechanisms to generate contextual features for specific aspectual objectives, their sole use may be influenced by the sentiments conveyed in other aspect categories. This can occur when aspectual targets are absent from the sentence and when words carry varying contextual sentiments across multiple aspect categories. This paper introduces the attention-based multi-level feature aggregation (AMFA) network, which simultaneously considers local and global information by applying attention to convolutional filters. It further employs context-guided self-attention modules at multiple levels to efficiently amalgamate learned different aspects and the interactions between contextual features within a cohesive framework. We tested the proposed approach on four public datasets. The results demonstrated the efficiency of our model in extracting more precise semantics and sentiments related to specific feature categories. To examine the practicality of AMFA, we constructed an online review dataset of table grapes from an e-commerce platform, where our model outperformed the baseline models with an accuracy of 88% and a macro-averaged F-1 score of 73.23%. We also validated the effectiveness of each AMFA module by testing them separately on all datasets. Experimental results prove that our proposed model is adept at semantically separating aspect embeddings from words in sentences and minimizing the impact of irrelevant information. Additionally, the robustness of our model is substantiated by supplementary experiments conducted on a constructed Chinese dataset.
引用
收藏
页码:1372 / 1390
页数:19
相关论文
共 50 条
  • [21] Syntactic Graph Attention Network for Aspect-Level Sentiment Analysis
    Yuan L.
    Wang J.
    Yu L.-C.
    Zhang X.
    IEEE. Trans. Artif. Intell., 2024, 1 (140-153): : 140 - 153
  • [22] Joint Attention LSTM Network for Aspect-Level Sentiment Analysis
    Cai, Guoyong
    Li, Hongyu
    INFORMATION RETRIEVAL, CCIR 2018, 2018, 11168 : 147 - 157
  • [23] Interactive Rule Attention Network for Aspect-Level Sentiment Analysis
    Lu, Qiang
    Zhu, Zhenfang
    Zhang, Dianyuan
    Wu, Wenqing
    Guo, Qiangqiang
    IEEE ACCESS, 2020, 8 : 52505 - 52516
  • [24] Multi-grained Attention Network for Aspect-Level Sentiment Classification
    Fan, Feifan
    Feng, Yansong
    Zhao, Dongyan
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 3433 - 3442
  • [25] Multi-head attention model for aspect level sentiment analysis
    Zhang, Xinsheng
    Gao, Teng
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 38 (01) : 89 - 96
  • [26] Transformer Based Multi-Grained Attention Network for Aspect-Based Sentiment Analysis
    Sun, Jiahui
    Han, Ping
    Cheng, Zheng
    Wu, Enming
    Wang, Wenqing
    IEEE ACCESS, 2020, 8 : 211152 - 211163
  • [27] Multilayer Gating and Relational Graph Attention Fusion Network for Aspect-Based Sentiment Analysis
    Luo, Rongrong
    Gong, Hongfang
    Xu, Dan
    Computer Engineering and Applications, 2023, 59 (15) : 169 - 176
  • [28] Aspect category sentiment analysis based on prompt-based learning with attention mechanism
    Ping, Zhichao
    Sang, Guoming
    Liu, Zhi
    Zhang, Yijia
    NEUROCOMPUTING, 2024, 565
  • [29] Aspect-based sentiment classification with multi-attention network
    Xu, Qiannan
    Zhu, Li
    Dai, Tao
    Yan, Chengbing
    NEUROCOMPUTING, 2020, 388 : 135 - 143
  • [30] Effective Self Attention Modeling for Aspect Based Sentiment Analysis
    Cai, Ningning
    Ma, Can
    Wang, Weiping
    Meng, Dan
    COMPUTATIONAL SCIENCE - ICCS 2019, PT V, 2019, 11540 : 3 - 14