A Deep Learning Model Based on Neural Bag-of-Words Attention for Sentiment Analysis

被引：0

作者：

Liao, Jing ^{[1
]}

Yi, Zhixiang ^{[1
]}

机构：

[1] Hunan Univ Sci & Technol, Sch Comp Engn & Sci, Xiangtan, Peoples R China

来源：

KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I | 2021年 / 12815卷

关键词：

Sentiment analysis; Deep learning; Attention mechanism; Neural bag-of-words;

D O I：

10.1007/978-3-030-82136-4_38

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In the field of Natural Language Processing, sentiment analysis is one of core research directions. The hot issue of sentiment analysis is how to avoid the shortcoming of using fixed vector to calculate attention distribution. In this paper, we proposed a novel sentiment analysis model based on neural bag-of-words attention, which utilizes Bidirectional Long Short-Term Memory (BiLSTM) to capture the deep semantic features of text, and fusion these features by attention distribution based on neural bag-of-words. The experimental results show that the proposed method has improved 2.53%-6.46% accuracy compared with the benchmark.

引用

下载

页码：467 / 478

页数：12

共 50 条

[41] A bag-of-words equivalent recurrent neural network for action recognition
Richard, Alexander
Gall, Juergen
COMPUTER VISION AND IMAGE UNDERSTANDING, 2017, 156 : 79 - 91
[42] Do Important Words in Bag-of-Words Model of Text Relatedness Help?
Islam, Aminul
Milios, Evangelos
Keselj, Vlado
TEXT, SPEECH, AND DIALOGUE (TSD 2015), 2015, 9302 : 569 - 577
[43] Time series classification with temporal bag-of-words model
Gui, Zi-Wen
Yeh, Yi-Ren
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2014, 8916 : 145 - 153
[44] A Two-Level Recurrent Neural Network Language Model Based on the Continuous Bag-of-Words Model for Sentence Classification
Lee, Yo Han
Kim, Dong W.
Lim, Myo Taeg
INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2019, 28 (01)
[45] A Novel Deep Learning-Based Multilevel Parallel Attention Neural (MPAN) Model for Multidomain Arabic Sentiment Analysis
El-Affendi, Mohammed A.
Alrajhi, Khawla
Hussain, Amir
IEEE ACCESS, 2021, 9 : 7508 - 7518
[46] E2BoWs: An end-to-end Bag-of-Words model via deep convolutional neural network for image retrieval: E2BoWs: An end-to-end Bag-of-Words model via deep convolutional neural network for image retrieval
Liu X.
Zhang S.
Huang T.
Tian Q.
Zhang, Shiliang (slzhang.jdl@pku.edu.cn), 1600, Elsevier B.V., Netherlands (395): : 188 - 198
[47] Bag-of-Words Vector Quantization Based Face Identification
Liu, Di
Sun, Dong-mei
Qiu, Zheng-ding
PROCEEDINGS OF THE SECOND INTERNATIONAL SYMPOSIUM ON ELECTRONIC COMMERCE AND SECURITY, VOL II, 2009, : 29 - 33
[48] Bag-of-Words Model for Image Classification Based on Harris Corner Features Weighting
Sheng, Haidi
Duan, Huichuan
Kong, Chao
INTERNATIONAL CONFERENCE ON COMPUTATIONAL AND INFORMATION SCIENCES (ICCIS 2014), 2014, : 1284 - 1289
[49] Predicting Clinical Events Based on Raw Text: From Bag-of-Words to Attention-Based Transformers
Roussinov, Dmitri
Conkie, Andrew
Patterson, Andrew
Sainsbury, Christopher
FRONTIERS IN DIGITAL HEALTH, 2022, 3
[50] Tolerance Rough Set-Based Bag-of-Words Model for Document Representation
Qiu, Dong
Jiang, Haihuan
Yan, Ruiteng
INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2020, 13 (01) : 1218 - 1226

← 1 2 3 4 5 →