Chinese Semantic Matching with Multi-granularity Alignment and Feature Fusion

被引:0
|
作者
Zhao, Pengyu [1 ]
Lu, Wenpeng [1 ]
Li, Yifeng [2 ]
Yu, Jiguo [1 ]
Jian, Ping [3 ]
Zhang, Xu [1 ]
机构
[1] Qilu Univ Technol, Shandong Acad Sci, Sch Comp Sci & Technol, Jinan, Peoples R China
[2] Brock Univ, Dept Comp Sci, St Catharines, ON, Canada
[3] Beijing Inst Technol, Sch Comp, Beijing, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
D O I
10.1109/IJCNN52387.2021.9534130
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Chinese semantic matching is a fundamental task in natural language processing, which is critical and yet challenging for a series of downstream tasks. Although recent work on text representation learning has shown its potential in improving the performance on semantic matching, relatively limited work has been done on exploring the relevant interactive information between two granularity of Chinese text, i.e., character and word. Existing methods usually focus on capturing the interactive features from single granularity, which lead to inefficient text representation. Also, they typically fail to consider the fusion of features from different granularity. As a result, they only achieve limited performance improvement. This paper proposes a novel Chinese semantic matching model based on multi-granularity alignment and feature fusion (MAFFo). To be specific, we first encode the texts from different granularity, which are further handled with soft-alignment attention mechanism to extract relevant interactive information between texts on different granularity. In addition, we devise a feature fusion structure to merge the features from different granularity to generate an ideal representation for the pair of input text sequences, followed by a sigmoid function to judge the semantic matching degree. Extensive experiments on the publicly available dataset BQ demonstrate that our model can effectively improve the performance of semantic matching task and achieve comparable performance with BERT-based methods.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Chinese Sentence Semantic Matching Based on Multi-Granularity Fusion Model
    Zhang, Xu
    Lu, Wenpeng
    Zhang, Guoqiang
    Li, Fangfang
    Wang, Shoujin
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2020, PT II, 2020, 12085 : 246 - 257
  • [2] Multi-granularity interaction model based on pinyins and radicals for Chinese semantic matching
    Pengyu Zhao
    Wenpeng Lu
    Shoujin Wang
    Xueping Peng
    Ping Jian
    Hao Wu
    Weiyu Zhang
    [J]. World Wide Web, 2022, 25 : 1703 - 1723
  • [3] Multi-granularity interaction model based on pinyins and radicals for Chinese semantic matching
    Zhao, Pengyu
    Lu, Wenpeng
    Wang, Shoujin
    Peng, Xueping
    Jian, Ping
    Wu, Hao
    Zhang, Weiyu
    [J]. WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2022, 25 (04): : 1703 - 1723
  • [4] SEMANTIC SIMILARITY MODELING BASED ON MULTI-GRANULARITY INTERACTION MATCHING
    Li, Xu
    Yao, Chunlong
    Zhang, Qinyang
    Zhang, Guoqi
    [J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2019, 15 (05): : 1685 - 1700
  • [5] A Multi-Granularity Word Fusion Method for Chinese NER
    Liu, Tong
    Gao, Jian
    Ni, Weijian
    Zeng, Qingtian
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [6] Multi-Granularity Denoising and Bidirectional Alignment for Weakly Supervised Semantic Segmentation
    Chen, Tao
    Yao, Yazhou
    Tang, Jinhui
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 2960 - 2971
  • [7] Multi-granularity feature fusion for person re-identification
    Zhang Liang
    Che Jin
    Yang Qi
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2020, 35 (06) : 555 - 563
  • [8] Multi-Granularity Feature Fusion for Enhancing Encrypted Traffic Classification
    Ding, Quan
    Zha, Zhengpeng
    Li, Yanjun
    Ling, Zhenhua
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (04) : 1090 - 1097
  • [9] Multi-granularity semantic alignment distillation learning for remote sensing image semantic segmentation
    Di Zhang
    Yong Zhou
    Jiaqi Zhao
    Zhongyuan Yang
    Hui Dong
    Rui Yao
    Huifang Ma
    [J]. Frontiers of Computer Science, 2022, 16
  • [10] Multi-granularity semantic alignment distillation learning for remote sensing image semantic segmentation
    Zhang, Di
    Zhou, Yong
    Zhao, Jiaqi
    Yang, Zhongyuan
    Dong, Hui
    Yao, Rui
    Ma, Huifang
    [J]. FRONTIERS OF COMPUTER SCIENCE, 2022, 16 (04)