Bidirectional transfer learning model for sentiment analysis of natural language

被引:0
|
作者
Shivani Malhotra
Vinay Kumar
Alpana Agarwal
机构
[1] Thapar Institute of Engineering and Technology,Department of Electronics and Communication Engineering
关键词
Universal language model fine-tuning (ULMFit); Bidirectional encoder representations from transformers (BERT); Average stochastic gradient weight-dropped LSTM (AWD-LSTM); Transfer learning; Sentiment classification;
D O I
暂无
中图分类号
学科分类号
摘要
The contemporary unsupervised word representation methods have been successful in capturing semantic statistics on various Natural Language Processing tasks. However, these methods proved to be futile in addressing tasks like polysemy or homonymy, which prevail in such tasks. There has been a rise in the number of state-of-the-art transfer learning techniques bringing into play the language models pre-trained on large inclusive corpus. Motivated by these techniques, the present paper proposes an efficacious transfer learning based ensemble model. This model is inspired by ULMFit and presents results on challenging sentiment analysis tasks such as contextualization and regularization. We have empirically validated the efficiency of our proposed model by applying it to three conventional datasets for sentiment classification task. Our model accomplished the state-of-the-art outcomes remarkably when compared to acknowledged baselines in terms of classification accuracy.
引用
收藏
页码:10267 / 10287
页数:20
相关论文
共 50 条
  • [31] Sentiment Analysis: Automated Evaluation Using Natural Language Processing
    Novak, Michal
    CREATING GLOBAL COMPETITIVE ECONOMIES: 2020 VISION PLANNING & IMPLEMENTATION, VOLS 1-3, 2013, : 973 - 975
  • [32] Performance Evaluation of Natural Language Processing Algorithms for Sentiment Analysis
    S. H. Annie Silviya
    S. Julia Faith
    R. Seetha
    M. Hemalatha
    SN Computer Science, 5 (6)
  • [33] The Impact of Natural Language Preprocessing on Big Data Sentiment Analysis
    Khader, Mariam
    Awajan, Arafat
    Al-Naymat, Ghazi
    INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, 2019, 16 (3A) : 506 - 513
  • [34] Performance Evaluation of Reddit Comments Using Machine Learning and Natural Language Processing Methods in Sentiment Analysis
    Zhang, Xiaoxia
    Qi, Xiuyuan
    Teng, Zixin
    COMPUTATIONAL AND EXPERIMENTAL SIMULATIONS IN ENGINEERING, ICCES 2024-VOL 2, 2025, 173 : 14 - 24
  • [35] NEURAL KNOWLEDGE TRANSFER FOR SENTIMENT ANALYSIS IN TEXTS WITH FIGURATIVE LANGUAGE
    Karamouzas, Dionysios
    Mademlis, Ioannis
    Pitas, Ioannis
    2022 IEEE 32ND INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2022,
  • [36] Neural Transfer Learning For Vietnamese Sentiment Analysis Using Pre-trained Contextual Language Models
    An Pha Le
    Tran Vu Pham
    Thanh-Van Le
    Huynh, Duy, V
    2021 IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLIED NETWORK TECHNOLOGIES (ICMLANT II), 2021, : 84 - 88
  • [37] Cross Domain Sentiment Analysis Using Transfer Learning
    Gupta, Bharat
    Awasthi, Shivam
    Singh, Parshant
    Ram, Likhama
    Kumar, Pramod
    Prasad, Bakshi Rohit
    Agarwal, Sonali
    2017 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL AND INFORMATION SYSTEMS (ICIIS), 2017, : 175 - 179
  • [38] Multi-Step Transfer Learning for Sentiment Analysis
    Golubev, Anton
    Loukachevitch, Natalia
    NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS (NLDB 2021), 2021, 12801 : 209 - 217
  • [39] A Helping Hand: Transfer Learning for Deep Sentiment Analysis
    Dong, Xin
    de Melo, Gerard
    PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, 2018, : 2524 - 2534
  • [40] Roman Urdu Sentiment Analysis Using Transfer Learning
    Li, Dun
    Ahmed, Kanwal
    Zheng, Zhiyun
    Mohsan, Syed Agha Hassnain
    Alsharif, Mohammed H.
    Hadjouni, Myriam
    Jamjoom, Mona M.
    Mostafa, Samih M.
    APPLIED SCIENCES-BASEL, 2022, 12 (20):