Bidirectional transfer learning model for sentiment analysis of natural language

被引:0
|
作者
Shivani Malhotra
Vinay Kumar
Alpana Agarwal
机构
[1] Thapar Institute of Engineering and Technology,Department of Electronics and Communication Engineering
关键词
Universal language model fine-tuning (ULMFit); Bidirectional encoder representations from transformers (BERT); Average stochastic gradient weight-dropped LSTM (AWD-LSTM); Transfer learning; Sentiment classification;
D O I
暂无
中图分类号
学科分类号
摘要
The contemporary unsupervised word representation methods have been successful in capturing semantic statistics on various Natural Language Processing tasks. However, these methods proved to be futile in addressing tasks like polysemy or homonymy, which prevail in such tasks. There has been a rise in the number of state-of-the-art transfer learning techniques bringing into play the language models pre-trained on large inclusive corpus. Motivated by these techniques, the present paper proposes an efficacious transfer learning based ensemble model. This model is inspired by ULMFit and presents results on challenging sentiment analysis tasks such as contextualization and regularization. We have empirically validated the efficiency of our proposed model by applying it to three conventional datasets for sentiment classification task. Our model accomplished the state-of-the-art outcomes remarkably when compared to acknowledged baselines in terms of classification accuracy.
引用
收藏
页码:10267 / 10287
页数:20
相关论文
共 50 条
  • [1] Bidirectional transfer learning model for sentiment analysis of natural language
    Malhotra, Shivani
    Kumar, Vinay
    Agarwal, Alpana
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 12 (11) : 10267 - 10287
  • [2] Natural Language Processing for the Analysis Sentiment using a LSTM Model
    Berrajaa, Achraf
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (05) : 777 - 785
  • [3] Hybrid Natural Language Processing Model for Sentiment Analysis during Natural Crisis
    Horvat, Marko
    Gledec, Gordan
    Leontic, Fran
    ELECTRONICS, 2024, 13 (10)
  • [4] Sentiment analysis and the complex natural language
    Khan, Muhammad Taimoor
    Durrani, Mehr
    Ali, Armughan
    Inayat, Irum
    Khalid, Shehzad
    Khan, Kamran Habib
    COMPLEX ADAPTIVE SYSTEMS MODELING, 2016, 4
  • [5] Natural Language Processing for Sentiment Analysis
    Chong, Wei Yen
    Selvaretnam, Bhawani
    Soon, Lay-Ki
    PROCEEDINGS 2014 4TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE WITH APPLICATIONS IN ENGINEERING AND TECHNOLOGY ICAIET 2014, 2014, : 212 - 217
  • [6] Transfer Learning for Sentiment Classification Using Bidirectional Encoder Representations from Transformers (BERT) Model
    Areshey, Ali
    Mathkour, Hassan
    SENSORS, 2023, 23 (11)
  • [7] Application of Sentiment Analysis to Language Learning
    Chen, Mai-Hua
    Chen, Wei-Fan
    Ku, Lun-Wei
    IEEE ACCESS, 2018, 6 : 24433 - 24442
  • [8] NATURAL LANGUAGE COMPLEXITY. SENTIMENT ANALYSIS
    Gifu, Daniela
    Scutelnicu, A. C. S. Andrei
    STUDIES ON LITERATURE, DISCOURSE AND MULTICULTURAL DIALOGUE: LANGUAGE AND DISCOURSE, 2013, : 944 - 954
  • [9] Knowledge-Guided Sentiment Analysis Via Learning From Natural Language Explanations
    Ke, Zunwang
    Sheng, Jiabao
    Li, Zhe
    Silamu, Wushour
    Guo, Qinglang
    IEEE ACCESS, 2021, 9 : 3570 - 3578
  • [10] APPLICATION OF THE COMPOSITIONAL MACHINE LEARNING DYNAMIC CLASSIFICATION ALGORITHM FOR NATURAL LANGUAGE SENTIMENT ANALYSIS
    Yosifova, Veneta
    Tasheva, Antoniya
    INTERNATIONAL JOURNAL ON INFORMATION TECHNOLOGIES AND SECURITY, 2024, 16 (04): : 61 - 72