Aspect category sentiment analysis based on prompt-based learning with attention mechanism

被引:2
|
作者
Ping, Zhichao [1 ]
Sang, Guoming [1 ]
Liu, Zhi [1 ]
Zhang, Yijia [1 ]
机构
[1] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian 116024, Liaoning, Peoples R China
关键词
Prompt-based learning; Aspect category sentiment analysis; Attention mechanism;
D O I
10.1016/j.neucom.2023.126994
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aspect category sentiment analysis (ACSA) excels at identifying the aspect categories and corresponding sentiments involved in a sentence, regardless of whether the aspect terms are explicitly mentioned or not. However, current methods tend to overinflate the original data, resulting in the introduction of unnecessary information, and fail to capture the inter-task relationship sufficiently. This paper presents a new method termed the prompt-based joint model (PBJM) to address these complications. PBJM treats the sentiment polarity prediction as binary classification and leverages a natural language prompt template, a concise sentence that guides the model to perform aspect category identification subtask and curtails the need for data augmentation. The two subtasks are jointly trained in pre-trained language models (PLMs) to capture their correlation. Further, the attention mechanism for aspect categories enables the model to concentrate selectively on significant features such as phrases and words during the predictions. In addition, the verbalizer employs a set of parameters to balance the weight of each label word while projecting between the label space and the label words space. Through experiments on four datasets, our model demonstrated remarkable performance in detecting category-sentiment pairs.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Using Dependency Information to Enhance Attention Mechanism for Aspect-Based Sentiment Analysis
    Pu, Luwen
    Zou, Yuexian
    Zhang, Jian
    Huang, Shilei
    Yao, Lin
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING (NLPCC 2019), PT I, 2019, 11838 : 672 - 684
  • [22] An improved aspect-category sentiment analysis model for text sentiment analysis based on RoBERTa
    Liao, Wenxiong
    Zeng, Bi
    Yin, Xiuwen
    Wei, Pengfei
    APPLIED INTELLIGENCE, 2021, 51 (06) : 3522 - 3533
  • [23] An improved aspect-category sentiment analysis model for text sentiment analysis based on RoBERTa
    Wenxiong Liao
    Bi Zeng
    Xiuwen Yin
    Pengfei Wei
    Applied Intelligence, 2021, 51 : 3522 - 3533
  • [24] EAFL: Equilibrium Augmentation Mechanism to Enhance Federated Learning for Aspect Category Sentiment Analysis
    Ahmad, Khwaja Mutahir
    Liu, Qiao
    Khan, Abdullah Aman
    Gan, Yanglei
    Lin, Run
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 256
  • [25] Unified Multi-modal Pre-training for Few-shot Sentiment Analysis with Prompt-based Learning
    Yu, Yang
    Zhang, Dong
    Li, Shoushan
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022,
  • [26] A Transfer Learning based Approach for Aspect Based Sentiment Analysis
    Fang, Xing
    Tao, Jie
    2019 SIXTH INTERNATIONAL CONFERENCE ON SOCIAL NETWORKS ANALYSIS, MANAGEMENT AND SECURITY (SNAMS), 2019, : 478 - 483
  • [27] Supervised Learning Based Approach to Aspect Based Sentiment Analysis
    Pannala, Nipuna Upeka
    Nawarathna, Chamira Priyamanthi
    Jayakody, J. T. K.
    Rupasinghe, Lakmal
    Krishnadeva, Kesavan
    2016 IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY (CIT), 2016, : 662 - 666
  • [28] Soft prompt enhanced joint learning for cross-domain aspect-based sentiment analysis
    Shi J.
    Li W.
    Bai Q.
    Yang Y.
    Jiang J.
    Intelligent Systems with Applications, 2023, 20
  • [29] Aspect Category Sentiment Analysis with Self-Attention Fusion Networks
    Huang, Zelin
    Hui, Zhao
    Peng, Feng
    Chen, Qinhui
    Zhao, Gang
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2020), PT III, 2020, 12114 : 154 - 168
  • [30] Introducing Language Guidance in Prompt-based Continual Learning
    Khan, Muhammad Gul Zain Ali
    Naeem, Muhammad Ferjad
    Van Gool, Luc
    Stricker, Didier
    Tombari, Federico
    Afzal, Muhammad Zeshan
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 11429 - 11439