BERT Based Semi-Supervised Hybrid Approach for Aspect and Sentiment Classification

被引:0
|
作者
Avinash Kumar
Pranjal Gupta
Raghunathan Balan
Lalita Bhanu Murthy Neti
Aruna Malapati
机构
[1] Birla Institute of Technology & Science,
[2] Pilani—Hyderabad,undefined
来源
Neural Processing Letters | 2021年 / 53卷
关键词
ABSA; Language model; BERT; Deep neural network; Attention mechanism; Unsupervised learning;
D O I
暂无
中图分类号
学科分类号
摘要
Aspect-based sentiment analysis (ABSA) includes two sub-tasks namely, aspect extraction and aspect-level sentiment classification. Most existing works address these sub-tasks independently by applying a supervised learning approach using labeled data. However, obtaining such labeled sentences is difficult and extremely expensive. Hence, it is important to solve ABSA without taking a dependency on labeled sentences. In this work, we propose a three-step semi-supervised hybrid approach that jointly detects an aspect and its associated sentiment in a given review sentence. The first step of our approach takes a small set of seed words for each aspect and sentiment class to construct respective semantically coherent class vocabularies. The second step makes use of these constructed vocabularies along with POS tags to label a subset of sentences from the training corpus. As we adopt a semi-automated approach to label the data, this process may induce noise in the labels during the annotation. In the last step, we use such labeled sentences to build a noise-robust deep neural network for aspect and sentiment classification. We conduct experiments on two real data sets to verify the effectiveness of our model (https://github.com/Raghu150999/UnsupervisedABSA).
引用
收藏
页码:4207 / 4224
页数:17
相关论文
共 50 条
  • [1] BERT Based Semi-Supervised Hybrid Approach for Aspect and Sentiment Classification
    Kumar, Avinash
    Gupta, Pranjal
    Balan, Raghunathan
    Neti, Lalita Bhanu Murthy
    Malapati, Aruna
    [J]. NEURAL PROCESSING LETTERS, 2021, 53 (06) : 4207 - 4224
  • [2] A Semi-supervised Learning Approach for Microblog Sentiment Classification
    Yu, Zhiwei
    Wong, Raymond K.
    Chi, Chi-Hung
    Chen, Fang
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON SMART CITY/SOCIALCOM/SUSTAINCOM (SMARTCITY), 2015, : 339 - 344
  • [3] Semi-supervised sentiment classification based on sentiment feature clustering
    Li, Suke
    Jiang, Yanbing
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2013, 50 (12): : 2570 - 2577
  • [4] Semi-supervised Aspect-level Sentiment Classification Model based on Variational Autoencoder
    Fu, Xianghua
    Wei, Yanzhi
    Xu, Fan
    Wang, Ting
    Lu, Yu
    Li, Jianqiang
    Huang, Joshua Zhexue
    [J]. KNOWLEDGE-BASED SYSTEMS, 2019, 171 : 81 - 92
  • [5] Cooperative Hybrid Semi-Supervised Learning for Text Sentiment Classification
    Li, Yang
    Lv, Ying
    Wang, Suge
    Liang, Jiye
    Li, Juanzi
    Li, Xiaoli
    [J]. SYMMETRY-BASEL, 2019, 11 (02):
  • [6] Semi-Supervised Model for Aspect Sentiment Detection
    Madhoushi, Zohreh
    Hamdan, Abdul Razak
    Zainudin, Suhaila
    [J]. INFORMATION, 2023, 14 (05)
  • [7] Semi-Supervised Learning for Aspect-Based Sentiment Analysis
    Zheng, Hang
    Zhang, Jianhui
    Suzuki, Yoshimi
    Fukumoto, Fumiyo
    Nishizaki, Hiromitsu
    [J]. 2021 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW 2021), 2021, : 209 - 212
  • [8] Semi-Stacking for Semi-supervised Sentiment Classification
    Li, Shoushan
    Huang, Lei
    Wang, Jingjing
    Zhou, Guodong
    [J]. PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL) AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (IJCNLP), VOL 2, 2015, : 27 - 31
  • [9] A semi-supervised short text sentiment classification method based on improved Bert model from unlabelled data
    Haochen Zou
    Zitao Wang
    [J]. Journal of Big Data, 10
  • [10] Semi-supervised Sentiment Classification Based on Auxiliary Task Learning
    Liu, Huan
    Wang, Jingjing
    Li, Shoushan
    Li, Junhui
    Zhou, Guodong
    [J]. NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2018, PT II, 2018, 11109 : 372 - 382