A Multi-Layer Dual Attention Deep Learning Model With Refined Word Embeddings for Aspect-Based Sentiment Analysis

被引:20
|
作者
Rida-E-Fatima, Syeda [1 ]
Javed, Ali [1 ,2 ]
Banjar, Ameen [3 ]
Irtaza, Aun [4 ]
Dawood, Hassan [1 ]
Dawood, Hussain [5 ]
Alamri, Abdullah [3 ]
机构
[1] Univ Engn & Technol, Dept Software Engn, Taxila 47050, Punjab, Pakistan
[2] Oakland Univ, Dept Comp Sci & Engn, Rochester, MI 48309 USA
[3] Univ Jeddah, Dept Informat Syst & Technol, Coll Comp Sci & Engn, Jeddah 23890, Saudi Arabia
[4] Univ Engn & Technol, Dept Comp Sci, Taxila 47050, Punjab, Pakistan
[5] Univ Jeddah, Dept Comp & Network Engn, Coll Comp Sci & Engn, Jeddah 23890, Saudi Arabia
关键词
Aspect based sentiment analysis; deep learning; natural language processing; opinion mining and word embeddings;
D O I
10.1109/ACCESS.2019.2927281
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Although the sentiment analysis domain has been deeply studied in the last few years, the analysis of social media content is still a challenging task due to the exponential growth of multimedia content. Natural language ambiguities and indirect sentiments within the social media text have made it hard to classify. Aspect-based sentiment analysis creates a need to develop explicit extraction techniques using syntactic parsers to exploit the relationship between the aspect and sentiment terms. Along with the extraction approaches, word embeddings are generated through Word2Vec models for the continuous low-dimensional vector representation of text that fails to capture the significant sentiment information. This paper presents a co-extraction model with refined word embeddings to exploit the dependency structures without using syntactic parsers. For this purpose, a deep learning-based multilayer dual-attention model is proposed to exploit the indirect relation between the aspect and opinion terms. In addition, word embeddings are refined by providing distinct vector representations to dissimilar sentiments, unlike the Word2Vec model. For this, we have employed a sentiment refinement technique for pre-trained word embedding model to overcome the problem of similar vector representations of opposite sentiments. Performance of the proposed model is evaluated on three benchmark datasets of SemEval Challenge 2014 and 2015. The experimental results indicate the effectiveness of our model compared to the existing state-of-the-art models for the aspect-based sentiment analysis.
引用
收藏
页码:114795 / 114807
页数:13
相关论文
共 50 条
  • [1] Learning Word Embeddings for Aspect-Based Sentiment Analysis
    Duc-Hong Pham
    Anh-Cuong Le
    Thi-Kim-Chung Le
    [J]. COMPUTATIONAL LINGUISTICS, PACLING 2017, 2018, 781 : 28 - 40
  • [2] Syntax-enhanced aspect-based sentiment analysis with multi-layer attention
    Shi, Jingli
    Li, Weihua
    Bai, Quan
    Yang, Yi
    Jiang, Jianhua
    [J]. NEUROCOMPUTING, 2023, 557
  • [3] Sentiment classification and aspect-based sentiment analysis on yelp reviews using deep learning and word embeddings
    Alamoudi, Eman Saeed
    Alghamdi, Norah Saleh
    [J]. JOURNAL OF DECISION SYSTEMS, 2021, 30 (2-3) : 259 - 281
  • [4] A Hybrid Approach for Aspect-Based Sentiment Analysis Using Deep Contextual Word Embeddings and Hierarchical Attention
    Trusca, Maria Mihaela
    Wassenberg, Daan
    Frasincar, Flavius
    Dekker, Rommert
    [J]. WEB ENGINEERING, ICWE 2020, 2020, 12128 : 365 - 380
  • [5] Aspect-based sentiment analysis with enhanced aspect-sensitive word embeddings
    Qi, Yusi
    Zheng, Xiaoqing
    Huang, Xuanjing
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2022, 64 (07) : 1845 - 1861
  • [6] Aspect-based sentiment analysis with enhanced aspect-sensitive word embeddings
    Yusi Qi
    Xiaoqing Zheng
    Xuanjing Huang
    [J]. Knowledge and Information Systems, 2022, 64 : 1845 - 1861
  • [7] Fine-Tuning Word Embeddings for Aspect-Based Sentiment Analysis
    Duc-Hong Pham
    Thi-Thanh-Tan Nguyen
    Anh-Cuong Le
    [J]. TEXT, SPEECH, AND DIALOGUE, TSD 2017, 2017, 10415 : 500 - 508
  • [8] Aspect-Based Sentiment Analysis Model Based on Dual-Attention Networks
    Sun, Xiaowan
    Wang, Ying
    Wang, Xin
    Sun, Yudong
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2019, 56 (11): : 2384 - 2395
  • [9] Deep Multi-Head Attention Network for Aspect-Based Sentiment Analysis
    Yan, Danfeng
    Chen, Jiyuan
    Cui, Jianfei
    Shan, Ao
    Shi, Wenting
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 695 - 700
  • [10] Using Word Embeddings for Ontology-Driven Aspect-Based Sentiment Analysis
    de Kok, Sophie
    Frasincar, Flavius
    [J]. PROCEEDINGS OF THE 35TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING (SAC'20), 2020, : 834 - 842