Aspect-Level Sentiment Classification for Sentences Based on Dependency Tree and Distance Attention

被引:0
|
作者
Su J. [1 ]
Ouyang Z. [1 ]
Yu S. [2 ]
机构
[1] College of Computer Science and Engineering, South China University of Technology, Guangzhou
[2] College of Medical Information Engineering, Guangdong Pharmaceutical University, Guangzhou
关键词
Aspect-level sentiment classification; Attention; Deep learning; Dependency tree; Natural language processing;
D O I
10.7544/issn1000-1239.2019.20190102
中图分类号
学科分类号
摘要
Current attention-based approaches for aspect-level sentiment classification usually neglect the contexts of aspects and the distance feature between words and aspects, which as a result make it difficult for attention mechanism to learn suitable attention weights. To address this problem, a dependency tree and distance attention-based model DTDA for aspect-level sentiment classification is proposed. Firstly, DTDA extracts dependency subtree (aspect sub-sentence) that contains the modification information of the aspect with the help of dependency tree of sentences, and then uses bidirectional GRU networks to learn the contexts of sentence and aspects. After that, the position weights are determined according to the syntactic distance between words and aspect along their path on the dependency tree, which are then further combined with relative distance to build sentence representations that contain semantic and distance information. The aspect-related sentiment feature representations are finally generated via attention mechanism and merged with sentence-related contexts, which are fed to a softmax layer for classification. Experimental results show that DTDA achieves comparable results with those current state-of-the-art methods on the two benchmark datasets of SemEval 2014, Laptop and Restaurant. When using word vectors pre-trained on domain-relative data, DTDA achieves the results with the precision of 77.01% on Laptop and 81.68% on Restaurant. © 2019, Science Press. All right reserved.
引用
收藏
页码:1731 / 1745
页数:14
相关论文
共 22 条
  • [1] Pontiki M., Galanis D., Pavlopoulos J., Et al., Semeval-2014 task 4: Aspect based sentiment analysis, Proc of the 8th Int Workshop on Semantic Evaluation (SemEval 2014), pp. 27-35, (2014)
  • [2] Liu B., Liu Q., Xu J., Et al., Aspect-based sentiment analysis based on multi-attention CNN, Journal of Computer Research and Development, 54, 8, pp. 1724-1735, (2017)
  • [3] Ding X., Liu B., Yu P.S., Et al., A holistic lexicon-based approach to opinion mining, Proc of the 2008 Int Conf on Web Search and Data Mining, pp. 231-240, (2008)
  • [4] Boiy E., Moens M.F., A machine learning approach to sentiment analysis in multilingual Web texts, Information Retrieval, 12, 5, pp. 526-558, (2009)
  • [5] Jiang L., Yu M., Zhou M., Et al., Target-dependent twitter sentiment classification, Proc of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, 1, pp. 151-160, (2011)
  • [6] Li D., Wei F., Tan C., Et al., Adaptive recursive neural network for target-dependent Twitter sentiment classification, Proc of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2, pp. 49-54, (2014)
  • [7] Tang D., Qin B., Feng X., Et al., Effective LSTMs for Target-Dependent Sentiment Classification, Proc of the 26th Int Conf on Computational Linguistics, pp. 3298-3307, (2016)
  • [8] Zhang M., Zhang Y., Vo D.T., Gated neural networks for targeted sentiment analysis, Proc of the 13th AAAI Conf on Artificial Intelligence, pp. 3087-3093, (2016)
  • [9] Nguyen T.H., Shirai K., PhraseRNN: Phrase recursive neural network for aspect-based sentiment analysis, Proc of the 2015 Conf on Empirical Methods in Natural Language Processing, pp. 2509-2514, (2015)
  • [10] Ruder S., Ghaffari P., Breslin J.G., A hierarchical model of reviews for aspect-based sentiment analysis, Proc of the 2016 Conf on Empirical Methods in Natural Language Processing, pp. 999-1005, (2016)