Improving Cross-Domain Aspect-Based Sentiment Analysis using Bert-BiLSTM Model and Dual Attention Mechanism

被引:0
|
作者
Xu, Yadi [1 ]
Ibrahim, Noor Farizah [1 ]
机构
[1] Univ Sains Malaysia, Sch Comp Sci, George Town 11800, Malaysia
关键词
Aspect-based sentiment analysis; Cross-domain; BERT-BiLSTM; Dual Interaction Mechanism; ADAPTATION; EXTRACTION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Data across different domains can be influenced by variations in language styles and expressions, making it challenging to migrate specialized words, particularly when focusing on aspectual words. This complexity poses difficulties in conducting cross-domain aspect- based sentiment analysis. The article begins by introducing BERT for generating word vectors as representations of training texts, enhancing text semantics in the word vector representation stage. To capture more nuanced interaction information and context-related details, the paper proposes the Bert-BiLSTM model with a dual attention mechanism(BBDAM), which divides the original input sequence into three parts: above, aspectual words, and below. A dual attention mechanism was used to assess the interaction of aspect words with the three aspects (above, below, and neighboring words) in the three discourse segments. This mechanism allows for the comprehensive extraction of interaction information. By comparing with other modeling approaches, the experimental results show that the BB-DAM model produces good results in fine-grained cross-domain sentiment analysis.
引用
收藏
页码:2468 / 2489
页数:22
相关论文
共 50 条
  • [21] Cross-Domain Data Augmentation with Domain-Adaptive Language Modeling for Aspect-Based Sentiment Analysis
    Yu, Jianfei
    Zhao, Qiankun
    Xia, Rui
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 1456 - 1470
  • [22] Aspect-based sentiment analysis of drug reviews using multi-task learning based dual BiLSTM model
    Rani, Somiya
    Jain, Amita
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (8) : 22473 - 22501
  • [23] Aspect-based sentiment analysis of drug reviews using multi-task learning based dual BiLSTM model
    Somiya Rani
    Amita Jain
    Multimedia Tools and Applications, 2024, 83 : 22473 - 22501
  • [24] Aspect-Based Sentiment Analysis with Cross-Heads Attention
    Zhou, Runmin
    Hu, Xuyao
    Wu, Kewei
    Yu, Lei
    Xie, Zhao
    Jiang, Long
    Computer Engineering and Applications, 2023, 59 (09) : 190 - 197
  • [25] Aspect-Based Sentiment Analysis of Drug Reviews Applying Cross-Domain and Cross-Data Learning
    Grasser, Felix
    Kallumadi, Surya
    Malberg, Hagen
    Zaunseder, Sebastian
    DH '18: PROCEEDINGS OF THE 2018 INTERNATIONAL CONFERENCE ON DIGITAL HEALTH, 2018, : 121 - 125
  • [26] Using Dependency Information to Enhance Attention Mechanism for Aspect-Based Sentiment Analysis
    Pu, Luwen
    Zou, Yuexian
    Zhang, Jian
    Huang, Shilei
    Yao, Lin
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING (NLPCC 2019), PT I, 2019, 11838 : 672 - 684
  • [27] An Improved Self Attention Mechanism Based on Optimized BERT-BiLSTM Model for Accurate Polarity Prediction
    Shobana, J.
    Murali, M.
    COMPUTER JOURNAL, 2023, 66 (05): : 1279 - 1294
  • [28] Adversarial Training for Aspect-Based Sentiment Analysis with BERT
    Karimi, Akbar
    Rossi, Leonardo
    Prati, Andrea
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 8797 - 8803
  • [29] Aspect-Based Sentiment Analysis Using Adversarial BERT with Capsule Networks
    Peng Yang
    Penghui Zhang
    Bing Li
    Shunhang Ji
    Meng Yi
    Neural Processing Letters, 2023, 55 : 8041 - 8058
  • [30] Aspect-Based Sentiment Analysis Using Adversarial BERT with Capsule Networks
    Yang, Peng
    Zhang, Penghui
    Li, Bing
    Ji, Shunhang
    Yi, Meng
    NEURAL PROCESSING LETTERS, 2023, 55 (06) : 8041 - 8058