A Sentence-Matching Model Based on Multi-Granularity Contextual Key Semantic Interaction

被引:0
|
作者
Li, Jinhang [1 ]
Li, Yingna [1 ,2 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Peoples R China
[2] Comp Technol Applicat Key Lab Yunnan Prov, Kunming 650500, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 12期
关键词
sentence matching; multi-granularity feature extraction; attention mechanism; semantic interaction;
D O I
10.3390/app14125197
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
In the task of matching Chinese sentences, the key semantics within sentences and the deep interaction between them significantly affect the matching performance. However, previous studies mainly relied on shallow interactions based on a single semantic granularity, which left them vulnerable to interference from overlapping terms. It is particularly challenging to distinguish between positive and negative examples within datasets from the same thematic domain. This paper proposes a sentence-matching model that incorporates multi-granularity contextual key semantic interaction. The model combines multi-scale convolution and multi-level convolution to extract different levels of contextual semantic information at word, phrase, and sentence granularities. It employs multi-head self-attention and cross-attention mechanisms to align the key semantics between sentences. Furthermore, the model integrates the original, similarity, and dissimilarity information of sentences to establish deep semantic interaction. Experimental results on both open- and closed-domain datasets demonstrate that the proposed model outperforms existing baseline models in terms of matching performance. Additionally, the model achieves matching effectiveness comparable to large-scale pre-trained language models while utilizing a lightweight encoder.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Chinese Sentence Semantic Matching Based on Multi-Granularity Fusion Model
    Zhang, Xu
    Lu, Wenpeng
    Zhang, Guoqiang
    Li, Fangfang
    Wang, Shoujin
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2020, PT II, 2020, 12085 : 246 - 257
  • [2] Multi-granularity interaction model based on pinyins and radicals for Chinese semantic matching
    Pengyu Zhao
    Wenpeng Lu
    Shoujin Wang
    Xueping Peng
    Ping Jian
    Hao Wu
    Weiyu Zhang
    [J]. World Wide Web, 2022, 25 : 1703 - 1723
  • [3] Multi-granularity interaction model based on pinyins and radicals for Chinese semantic matching
    Zhao, Pengyu
    Lu, Wenpeng
    Wang, Shoujin
    Peng, Xueping
    Jian, Ping
    Wu, Hao
    Zhang, Weiyu
    [J]. WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2022, 25 (04): : 1703 - 1723
  • [4] SEMANTIC SIMILARITY MODELING BASED ON MULTI-GRANULARITY INTERACTION MATCHING
    Li, Xu
    Yao, Chunlong
    Zhang, Qinyang
    Zhang, Guoqi
    [J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2019, 15 (05): : 1685 - 1700
  • [5] Short text matching model with multiway semantic interaction based on multi-granularity semantic embedding
    Xianlun Tang
    Yang Luo
    Deyi Xiong
    Jingming Yang
    Rui Li
    Deguang Peng
    [J]. Applied Intelligence, 2022, 52 : 15632 - 15642
  • [6] Short text matching model with multiway semantic interaction based on multi-granularity semantic embedding
    Tang, Xianlun
    Luo, Yang
    Xiong, Deyi
    Yang, Jingming
    Li, Rui
    Peng, Deguang
    [J]. APPLIED INTELLIGENCE, 2022, 52 (13) : 15632 - 15642
  • [7] MatchACNN: A Multi-Granularity Deep Matching Model
    Chang, Guanghui
    Wang, Weihan
    Hu, Shiyang
    [J]. NEURAL PROCESSING LETTERS, 2023, 55 (04) : 4419 - 4438
  • [8] MatchACNN: A Multi-Granularity Deep Matching Model
    Guanghui Chang
    Weihan Wang
    Shiyang Hu
    [J]. Neural Processing Letters, 2023, 55 : 4419 - 4438
  • [9] Chinese Semantic Matching with Multi-granularity Alignment and Feature Fusion
    Zhao, Pengyu
    Lu, Wenpeng
    Li, Yifeng
    Yu, Jiguo
    Jian, Ping
    Zhang, Xu
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [10] Chinese Medical Q&A Matching Model Based on Multi-Granularity Semantic Information and Knowledge Graph
    Guan, Liben
    Li, Shi
    [J]. Computer Engineering and Applications, 2024, 60 (14) : 152 - 161