A semantics-aware approach for multilingual natural language inference

被引:2
|
作者
Le-Hong, Phuong [1 ]
Cambria, Erik [2 ]
机构
[1] Vietnam Natl Univ, Hanoi, Vietnam
[2] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
关键词
Language inference; Semantics; Recurrent neural networks; Transformers; Commonsense; Text;
D O I
10.1007/s10579-023-09635-6
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper introduces a semantics-aware approach to natural language inference which allows neural network models to perform better on natural language inference benchmarks. We propose to incorporate explicit lexical and concept-level semantics from knowledge bases to improve inference accuracy. We conduct an extensive evaluation of four models using different sentence encoders, including continuous bag-of-words, convolutional neural network, recurrent neural network, and the transformer model. Experimental results demonstrate that semantics-aware neural models give better accuracy than those without semantics information. On average of the three strong models, our semantic-aware approach improves natural language inference in different languages.
引用
收藏
页码:611 / 639
页数:29
相关论文
共 50 条
  • [1] A semantics-aware approach for multilingual natural language inference
    Phuong Le-Hong
    Erik Cambria
    [J]. Language Resources and Evaluation, 2023, 57 : 611 - 639
  • [2] Semantics-Aware Inferential Network for Natural Language Understanding
    Zhang, Shuailiang
    Zhao, Hai
    Zhou, Junru
    Zhou, Xi
    Zhou, Xiang
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 14437 - 14445
  • [3] Semantics-Aware BERT for Language Understanding
    Zhang, Zhuosheng
    Wu, Yuwei
    Zhao, Hai
    Li, Zuchao
    Zhang, Shuailiang
    Zhou, Xi
    Zhou, Xiang
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 9628 - 9635
  • [4] A Semantics-Aware Approach to Automated Claim Verification
    Figueras, Blanca Calvo
    Cuadros, Montse
    Agerri, Rodrigo
    [J]. PROCEEDINGS OF THE FIFTH FACT EXTRACTION AND VERIFICATION WORKSHOP (FEVER 2022), 2022, : 37 - 48
  • [5] Semantics-Aware Autoencoder
    Bellini, Vito
    Di Noia, Tommaso
    Di Sciascio, Eugenio
    Schiavone, Angelo
    [J]. IEEE ACCESS, 2019, 7 : 166122 - 166137
  • [6] LAIR: A Language for Automated Semantics-Aware Text Sanitization based on Frame Semantics
    Hedegaard, Steffen
    Houen, Soren
    Simonsen, Jakob Grue
    [J]. 2009 IEEE THIRD INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC 2009), 2009, : 47 - 52
  • [7] A Semantics-Aware Classification Approach for Data Leakage Prevention
    Alneyadi, Sultan
    Sithirasenan, Elankayer
    Muthukkumarasamy, Vallipuram
    [J]. INFORMATION SECURITY AND PRIVACY, ACISP 2014, 2014, 8544 : 413 - 421
  • [8] A Semantics-Aware Approach to the Automated Network Protocol Identification
    Yun, Xiaochun
    Wang, Yipeng
    Zhang, Yongzheng
    Zhou, Yu
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2016, 24 (01) : 583 - 595
  • [9] Semantics-aware malware detection
    Christodorescu, M
    Jha, S
    Seshia, SA
    Song, D
    Bryant, RE
    [J]. 2005 IEEE SYMPOSIUM ON SECURITY AND PRIVACY, PROCEEDINGS, 2005, : 32 - 46
  • [10] Semantics-aware perimeter protection
    Cremonini, M
    Damiani, E
    Samarati, P
    [J]. DATA AND APPLICATIONS SECURITY XVII: STATUS AND PROSPECTS, 2004, 142 : 229 - 242