A semantics-aware approach for multilingual natural language inference

被引:0
|
作者
Phuong Le-Hong
Erik Cambria
机构
[1] Vietnam National University,School of Computer Science and Engineering
[2] NTU,undefined
来源
关键词
Language inference; Semantics; Recurrent neural networks; Transformers; Commonsense; Text;
D O I
暂无
中图分类号
学科分类号
摘要
This paper introduces a semantics-aware approach to natural language inference which allows neural network models to perform better on natural language inference benchmarks. We propose to incorporate explicit lexical and concept-level semantics from knowledge bases to improve inference accuracy. We conduct an extensive evaluation of four models using different sentence encoders, including continuous bag-of-words, convolutional neural network, recurrent neural network, and the transformer model. Experimental results demonstrate that semantics-aware neural models give better accuracy than those without semantics information. On average of the three strong models, our semantic-aware approach improves natural language inference in different languages.
引用
收藏
页码:611 / 639
页数:28
相关论文
共 50 条
  • [31] Special issue - Semantics-aware techniques for security
    Damiani, E
    COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2004, 19 (03): : 119 - 120
  • [32] XINFOTABS: Evaluating Multilingual Tabular Natural Language Inference
    Minhas, Bhavnick
    Shankhdhar, Anant
    Gupta, Vivek
    Aggrawal, Divyanshu
    Zhang, Shuo
    PROCEEDINGS OF THE FIFTH FACT EXTRACTION AND VERIFICATION WORKSHOP (FEVER 2022), 2022, : 59 - 77
  • [33] Learning with Semantics: Towards a Semantics-Aware Routing Anomaly Detection System
    Chen, Yihao
    Yin, Qilei
    Li, Qi
    Liu, Zhuotao
    Xu, Ke
    Xu, Yi
    Xu, Mingwei
    Liu, Ziqian
    Wu, Jianping
    PROCEEDINGS OF THE 33RD USENIX SECURITY SYMPOSIUM, SECURITY 2024, 2024, : 5143 - 5160
  • [34] Semantics-aware data integration for heterogeneous data sources
    Leida, Marcello
    Gusmini, Alex
    Davies, John
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2013, 4 (04) : 471 - 491
  • [35] Extending context descriptions in semantics-aware Access Control
    Damiani, E.
    di Vimercati, S. De Capitani
    Fugazza, C.
    Samarati, P.
    INFORMATION SYSTEMS SECURITY, PROCEEDINGS, 2006, 4332 : 162 - +
  • [36] A Process Framework for Semantics-Aware Tourism Information Systems
    Daramola, Olawande J.
    CURRENT TRENDS IN WEB ENGINEERING, 2010, 6385s : 521 - 532
  • [37] Preserving details in semantics-aware context for scene parsing
    Shuai Ma
    Yanwei Pang
    Jing Pan
    Ling Shao
    Science China Information Sciences, 2020, 63
  • [38] Semantics-aware data integration for heterogeneous data sources
    Marcello Leida
    Alex Gusmini
    John Davies
    Journal of Ambient Intelligence and Humanized Computing, 2013, 4 : 471 - 491
  • [39] Semantics-Aware Document Retrieval for Government Administrative Data
    Kulkarni, Apurva
    Ramanathan, Chandrashekar
    Venugopal, Vinu E.
    INTERNATIONAL JOURNAL OF SEMANTIC COMPUTING, 2023, 17 (03) : 477 - 491
  • [40] Semantics-Aware Hidden Markov Model for Human Mobility
    Shi, Hongzhi
    Li, Yong
    Cao, Hancheng
    Zhou, Xiangxin
    Zhang, Chao
    Kostakos, Vassilis
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (03) : 1183 - 1194