A BERT Framework to Sentiment Analysis of Tweets

被引:47
|
作者
Bello, Abayomi [1 ]
Ng, Sin-Chun [1 ]
Leung, Man-Fai [1 ]
机构
[1] Anglia Ruskin Univ, Fac Sci & Engn, Sch Comp & Informat Sci, Cambridge CB1 1PT, England
关键词
sentiment analysis; deep learning; tweets; BERT; LSTM; CNN;
D O I
10.3390/s23010506
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Sentiment analysis has been widely used in microblogging sites such as Twitter in recent decades, where millions of users express their opinions and thoughts because of its short and simple manner of expression. Several studies reveal the state of sentiment which does not express sentiment based on the user context because of different lengths and ambiguous emotional information. Hence, this study proposes text classification with the use of bidirectional encoder representations from transformers (BERT) for natural language processing with other variants. The experimental findings demonstrate that the combination of BERT with CNN, BERT with RNN, and BERT with BiLSTM performs well in terms of accuracy rate, precision rate, recall rate, and F1-score compared to when it was used with Word2vec and when it was used with no variant.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Multilingual evaluation of pre-processing for BERT-based sentiment analysis of tweets
    Pota, Marco
    Ventura, Mirko
    Fujita, Hamido
    Esposito, Massimo
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 181
  • [2] Sentiment Analysis on Tweets
    Khatoon, Mehjabin
    Banu, W. Aisha
    Zohra, A. Ayesha
    Chinthamani, S.
    [J]. SOFTWARE ENGINEERING (CSI 2015), 2019, 731 : 717 - 724
  • [3] BERT-deep CNN: state of the art for sentiment analysis of COVID-19 tweets
    Javad Hassannataj Joloudari
    Sadiq Hussain
    Mohammad Ali Nematollahi
    Rouhollah Bagheri
    Fatemeh Fazl
    Roohallah Alizadehsani
    Reza Lashgari
    Ashis Talukder
    [J]. Social Network Analysis and Mining, 13
  • [4] Sentiment Analysis on COVID Tweets Using COVID-Twitter-BERT with Auxiliary Sentence Approach
    Lin, Hung Yeh
    Moh, Teng-Sheng
    [J]. ACMSE 2021: PROCEEDINGS OF THE 2021 ACM SOUTHEAST CONFERENCE, 2021, : 234 - 238
  • [5] BERT-deep CNN: state of the art for sentiment analysis of COVID-19 tweets
    Joloudari, Javad Hassannataj
    Hussain, Sadiq
    Nematollahi, Mohammad Ali
    Bagheri, Rouhollah
    Fazl, Fatemeh
    Alizadehsani, Roohallah
    Lashgari, Reza
    Talukder, Ashis
    [J]. SOCIAL NETWORK ANALYSIS AND MINING, 2023, 13 (01)
  • [6] Sentiment Analysis in Arabic Tweets
    Duwairi, R. M.
    Marji, Raed
    Sha'ban, Narmeen
    Rushaidat, Sally
    [J]. 2014 5TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2014,
  • [7] How good BERT based models are in sentiment analysis of Croatian tweets: comparison of four multilingual BERTs
    Pticek, Martina
    [J]. CENTRAL EUROPEAN CONFERENCE ON INFORMATION AND INTELLIGENT SYSTEMS (CECIIS 2021), 2021, : 175 - 182
  • [8] BERT: a sentiment analysis odyssey
    Alaparthi, Shivaji
    Mishra, Manit
    [J]. JOURNAL OF MARKETING ANALYTICS, 2021, 9 (02) : 118 - 126
  • [9] BERT: a sentiment analysis odyssey
    Shivaji Alaparthi
    Manit Mishra
    [J]. Journal of Marketing Analytics, 2021, 9 : 118 - 126
  • [10] Tweets Classification and Sentiment Analysis for Personalized Tweets Recommendation
    Khattak, Asad Masood
    Batool, Rabia
    Satti, Fahad Ahmed
    Hussain, Jamil
    Khan, Wajahat Ali
    Khan, Adil Mehmood
    Hayat, Bashir
    [J]. COMPLEXITY, 2020, 2020