A semantics-aware approach for multilingual natural language inference

被引:3
|
作者
Le-Hong, Phuong [1 ]
Cambria, Erik [2 ]
机构
[1] Vietnam Natl Univ, Hanoi, Vietnam
[2] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
关键词
Language inference; Semantics; Recurrent neural networks; Transformers; Commonsense; Text;
D O I
10.1007/s10579-023-09635-6
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper introduces a semantics-aware approach to natural language inference which allows neural network models to perform better on natural language inference benchmarks. We propose to incorporate explicit lexical and concept-level semantics from knowledge bases to improve inference accuracy. We conduct an extensive evaluation of four models using different sentence encoders, including continuous bag-of-words, convolutional neural network, recurrent neural network, and the transformer model. Experimental results demonstrate that semantics-aware neural models give better accuracy than those without semantics information. On average of the three strong models, our semantic-aware approach improves natural language inference in different languages.
引用
收藏
页码:611 / 639
页数:29
相关论文
共 50 条
  • [41] Semantics-Aware Hidden Markov Model for Human Mobility
    Shi, Hongzhi
    Li, Yong
    Cao, Hancheng
    Zhou, Xiangxin
    Zhang, Chao
    Kostakos, Vassilis
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (03) : 1183 - 1194
  • [42] Semantics-aware typographical choices via affective associations
    Kulahcioglu, Tugba
    de Melo, Gerard
    LANGUAGE RESOURCES AND EVALUATION, 2021, 55 (01) : 105 - 126
  • [43] Preserving details in semantics-aware context for scene parsing
    Shuai MA
    Yanwei PANG
    Jing PAN
    Ling SHAO
    ScienceChina(InformationSciences), 2020, 63 (02) : 79 - 92
  • [44] An adaptive semantics-aware replacement algorithm for web caching
    Negrao, Andre Pessoa
    Roque, Carlos
    Ferreira, Paulo
    Veiga, Luis
    JOURNAL OF INTERNET SERVICES AND APPLICATIONS, 2015, 6
  • [45] Preserving details in semantics-aware context for scene parsing
    Ma, Shuai
    Pang, Yanwei
    Pan, Jing
    Shao, Ling
    SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (02)
  • [46] Semantics-Aware Prediction for Analytic Queries in MapReduce Environment
    Yu, Weikuan
    Liu, Zhuo
    Ding, Xiaoning
    47TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING (ICPP '18), 2018,
  • [47] SemSwap: Semantics-aware Swapping in Memory Disaggregated Datacenters
    Cui, Siwei
    Jin, Liuyi
    Khanh Nguyen
    Wang, Chenxi
    PROCEEDINGS OF THE 13TH ACM SIGOPS ASIA-PACIFIC WORKSHOP ON SYSTEMS, APSYS 2022, 2022, : 9 - 17
  • [48] Toward semantics-aware management of intellectual property rights
    Damiani, Ernesto
    Fugazza, Cristiano
    ONLINE INFORMATION REVIEW, 2007, 31 (01) : 59 - 72
  • [49] Invited talk - Towards semantics-aware access control
    Damiani, E
    di Vimercati, SD
    RESEARCH DIRECTIONS IN DATA AND APPLICATIONS SECURITY XVIII, 2004, 144 : 177 - 188
  • [50] Toward semantics-aware annotation and retrieval of spatial data
    Cristiano Fugazza
    Earth Science Informatics, 2011, 4 : 225 - 239