Comparative Analysis of Deep Natural Networks and Large Language Models for Aspect-Based Sentiment Analysis

被引:3
|
作者
Mughal, Nimra [1 ]
Mujtaba, Ghulam [1 ]
Shaikh, Sarang [2 ]
Kumar, Aveenash [3 ]
Daudpota, Sher Muhammad [4 ]
机构
[1] Sukkur IBA Univ, Ctr Excellence Robot Artificial Intelligence & Blo, Dept Comp Sci, Sukkur 65200, Sindh, Pakistan
[2] Norwegian Univ Sci & Technol NTNU, Dept Informat Secur & Commun Technol IIK, N-7034 Gjovik, Trondheim, Norway
[3] Learners Ai, Toronto, ON M5C 2B5, Canada
[4] Sukkur IBA Univ, Dept Comp Sci, Sukkur 65200, Sindh, Pakistan
关键词
Aspect-based sentiment analysis (ABSA); large language model (LLM); GPT; PaLM; BERT; NEURAL-NETWORK; EXTRACTION;
D O I
10.1109/ACCESS.2024.3386969
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sentiment analysis is essential for comprehending public opinion, particularly when considering e-commerce and the expansion of online businesses. Early approaches treated sentiment analysis as a document or sentence-level classification problem, lacking the ability to capture nuanced opinions about specific aspects. This limitation was addressed by the development of aspect-based sentiment analysis (ABSA), which links sentiment to specific aspects that are mentioned explicitly or implicitly in the review. ABSA is relatively a recent field of sentiment analysis and the existing models for ABSA face three main challenges, including domain-specificity, reliance on labeled data, and a lack of exploration into the potential of newer large language models (LLMs) such as GPT, PaLM, and T5. Leveraging a diverse set of datasets, including DOTSA, MAMS, and SemEval16, we evaluate the performance of prominent models such as ATAE-LSTM, flan-t5-large-absa, DeBERTa, PaLM, and GPT-3.5-Turbo. Our findings reveal nuanced strengths and weaknesses of these models across different domains, with DeBERTa emerging as consistently high-performing and PaLM demonstrating remarkable competitiveness for aspect term sentiment analysis (ATSA) tasks. In addition, the PaLM demonstrates competitive performance for all the domains that were used in the experiments including the restaurant, hotel, books, clothing, and laptop reviews. Notably, the analysis underscores the models' domain sensitivity, shedding light on their varying efficacy for both ATSA and ACSA tasks. These insights contribute to a deeper understanding of model applicability and highlight potential areas for improvement in ABSA research and development.
引用
收藏
页码:60943 / 60959
页数:17
相关论文
共 50 条
  • [21] Aspect-Based Sentiment Analysis: A Survey of Deep Learning Methods
    Liu, Haoyue
    Chatterjee, Ishani
    Zhou, MengChu
    Lu, Xiaoyu Sean
    Abusorrah, Abdullah
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2020, 7 (06): : 1358 - 1375
  • [22] Aspect-Based Sentiment Analysis of Vietnamese Texts with Deep Learning
    Long Mai
    Bac Le
    INTELLIGENT INFORMATION AND DATABASE SYSTEMS, ACIIDS 2018, PT I, 2018, 10751 : 149 - 158
  • [23] Multiple graph convolutional networks for aspect-based sentiment analysis
    Yuting Ma
    Rui Song
    Xue Gu
    Qiang Shen
    Hao Xu
    Applied Intelligence, 2023, 53 : 12985 - 12998
  • [24] Explainable Aspect-Based Sentiment Analysis Using Transformer Models
    Perikos, Isidoros
    Diamantopoulos, Athanasios
    BIG DATA AND COGNITIVE COMPUTING, 2024, 8 (11)
  • [25] Multiple graph convolutional networks for aspect-based sentiment analysis
    Ma, Yuting
    Song, Rui
    Gu, Xue
    Shen, Qiang
    Xu, Hao
    APPLIED INTELLIGENCE, 2023, 53 (10) : 12985 - 12998
  • [26] Aspect-based sentiment analysis using adaptive aspect-based lexicons
    Mowlaei, Mohammad Erfan
    Abadeh, Mohammad Saniee
    Keshavarz, Hamidreza
    EXPERT SYSTEMS WITH APPLICATIONS, 2020, 148
  • [27] A Challenge Dataset and Effective Models for Aspect-Based Sentiment Analysis
    Jiang, Qingnan
    Chen, Lei
    Xu, Ruifeng
    Ao, Xiang
    Yang, Min
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 6280 - 6285
  • [28] Aspect-based sentiment analysis via dual residual networks with sentiment knowledge
    Zhu, Chao
    Ding, Qiang
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (01):
  • [29] Aspect-gated graph convolutional networks for aspect-based sentiment analysis
    Qiang Lu
    Zhenfang Zhu
    Guangyuan Zhang
    Shiyong Kang
    Peiyu Liu
    Applied Intelligence, 2021, 51 : 4408 - 4419
  • [30] Aspect-gated graph convolutional networks for aspect-based sentiment analysis
    Lu, Qiang
    Zhu, Zhenfang
    Zhang, Guangyuan
    Kang, Shiyong
    Liu, Peiyu
    APPLIED INTELLIGENCE, 2021, 51 (07) : 4408 - 4419