Bidirectional transfer learning model for sentiment analysis of natural language

被引:0
|
作者
Shivani Malhotra
Vinay Kumar
Alpana Agarwal
机构
[1] Thapar Institute of Engineering and Technology,Department of Electronics and Communication Engineering
关键词
Universal language model fine-tuning (ULMFit); Bidirectional encoder representations from transformers (BERT); Average stochastic gradient weight-dropped LSTM (AWD-LSTM); Transfer learning; Sentiment classification;
D O I
暂无
中图分类号
学科分类号
摘要
The contemporary unsupervised word representation methods have been successful in capturing semantic statistics on various Natural Language Processing tasks. However, these methods proved to be futile in addressing tasks like polysemy or homonymy, which prevail in such tasks. There has been a rise in the number of state-of-the-art transfer learning techniques bringing into play the language models pre-trained on large inclusive corpus. Motivated by these techniques, the present paper proposes an efficacious transfer learning based ensemble model. This model is inspired by ULMFit and presents results on challenging sentiment analysis tasks such as contextualization and regularization. We have empirically validated the efficiency of our proposed model by applying it to three conventional datasets for sentiment classification task. Our model accomplished the state-of-the-art outcomes remarkably when compared to acknowledged baselines in terms of classification accuracy.
引用
收藏
页码:10267 / 10287
页数:20
相关论文
共 50 条
  • [21] A Hybrid Deep Implicit Neural Model for Sentiment Analysis via Transfer Learning
    Jahanbin, Kia
    Chahooki, Mohammad Ali Zare
    IEEE ACCESS, 2024, 12 : 131468 - 131486
  • [22] A Survey of Sentiment Analysis Based on Transfer Learning
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, 2023, : 6709 - 6715
  • [23] Sentiment-enhanced learning model for online language learning system
    Li, Li
    ELECTRONIC COMMERCE RESEARCH, 2018, 18 (01) : 23 - 64
  • [24] Sentiment-enhanced learning model for online language learning system
    Li Li
    Electronic Commerce Research, 2018, 18 : 23 - 64
  • [25] Mask and Infill: Applying Masked Language Model to Sentiment Transfer
    Wu, Xing
    Zhang, Tao
    Zang, Liangjun
    Han, Jizhong
    Hu, Songlin
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 5271 - 5277
  • [26] Deep Learning for Chinese Language Sentiment Extraction and Analysis
    Zhu, Zhu
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [27] Deep Learning for Chinese Language Sentiment Extraction and Analysis
    Zhu, Zhu
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [28] Deep Learning for Chinese Language Sentiment Extraction and Analysis
    Zhu, Zhu
    Mathematical Problems in Engineering, 2022, 2022
  • [29] A Framework for Youth Sentiment Analysis Using Natural Language Processing
    ElStohy, Rasha A.
    JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2023, 14 (06) : 1331 - 1338
  • [30] Natural Language Processing on Marketplace Product Review Sentiment Analysis
    Rohman, Arif Nur
    Musyarofah, Rizqa Luviana
    Utami, Ema
    Raharjo, Suwanto
    PROCEEDINGS OF ICORIS 2020: 2020 THE 2ND INTERNATIONAL CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEM (ICORIS), 2020, : 223 - 227