Chinese Semantic Matching with Multi-granularity Alignment and Feature Fusion

被引:1
|
作者
Zhao, Pengyu [1 ]
Lu, Wenpeng [1 ]
Li, Yifeng [2 ]
Yu, Jiguo [1 ]
Jian, Ping [3 ]
Zhang, Xu [1 ]
机构
[1] Qilu Univ Technol, Shandong Acad Sci, Sch Comp Sci & Technol, Jinan, Peoples R China
[2] Brock Univ, Dept Comp Sci, St Catharines, ON, Canada
[3] Beijing Inst Technol, Sch Comp, Beijing, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
D O I
10.1109/IJCNN52387.2021.9534130
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Chinese semantic matching is a fundamental task in natural language processing, which is critical and yet challenging for a series of downstream tasks. Although recent work on text representation learning has shown its potential in improving the performance on semantic matching, relatively limited work has been done on exploring the relevant interactive information between two granularity of Chinese text, i.e., character and word. Existing methods usually focus on capturing the interactive features from single granularity, which lead to inefficient text representation. Also, they typically fail to consider the fusion of features from different granularity. As a result, they only achieve limited performance improvement. This paper proposes a novel Chinese semantic matching model based on multi-granularity alignment and feature fusion (MAFFo). To be specific, we first encode the texts from different granularity, which are further handled with soft-alignment attention mechanism to extract relevant interactive information between texts on different granularity. In addition, we devise a feature fusion structure to merge the features from different granularity to generate an ideal representation for the pair of input text sequences, followed by a sigmoid function to judge the semantic matching degree. Extensive experiments on the publicly available dataset BQ demonstrate that our model can effectively improve the performance of semantic matching task and achieve comparable performance with BERT-based methods.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Short text matching model with multiway semantic interaction based on multi-granularity semantic embedding
    Xianlun Tang
    Yang Luo
    Deyi Xiong
    Jingming Yang
    Rui Li
    Deguang Peng
    [J]. Applied Intelligence, 2022, 52 : 15632 - 15642
  • [22] Short text matching model with multiway semantic interaction based on multi-granularity semantic embedding
    Tang, Xianlun
    Luo, Yang
    Xiong, Deyi
    Yang, Jingming
    Li, Rui
    Peng, Deguang
    [J]. APPLIED INTELLIGENCE, 2022, 52 (13) : 15632 - 15642
  • [23] Multi-granularity Convolutional Neural Network with Feature Fusion and Refinement for User Profiling
    Xu, Bo
    Tadesse, Michael M.
    Fei, Peng
    Lin, Hongfei
    [J]. INFORMATION RETRIEVAL (CCIR 2019), 2019, 11772 : 161 - 172
  • [24] Multi-Granularity Feature Fusion Network for Dynamic Sequential Facial Expression Recognition
    Guo, Xiao-Ying
    Mao, Xin-Chen
    Li, Wen-Shu
    Bai, Ru-Yi
    [J]. Proceedings - 2023 China Automation Congress, CAC 2023, 2023, : 7064 - 7069
  • [25] MatchACNN: A Multi-Granularity Deep Matching Model
    Chang, Guanghui
    Wang, Weihan
    Hu, Shiyang
    [J]. NEURAL PROCESSING LETTERS, 2023, 55 (04) : 4419 - 4438
  • [26] MatchACNN: A Multi-Granularity Deep Matching Model
    Guanghui Chang
    Weihan Wang
    Shiyang Hu
    [J]. Neural Processing Letters, 2023, 55 : 4419 - 4438
  • [27] A Sentence-Matching Model Based on Multi-Granularity Contextual Key Semantic Interaction
    Li, Jinhang
    Li, Yingna
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (12):
  • [28] Multi-Granularity Feature Fusion for Image-Guided Story Ending Generation
    Li, Pijian
    Huang, Qingbao
    Li, Zhigang
    Cai, Yi
    Shuang, Feng
    Li, Qing
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 3437 - 3449
  • [29] Multi-granularity Feature Fusion for Transformer-Based Single Object Tracking
    Wang, Ziye
    Miao, Duoqian
    [J]. ROUGH SETS, IJCRS 2023, 2023, 14481 : 311 - 323
  • [30] MIFM: Multi-Granularity Information Fusion Model for Chinese Named Entity Recognition
    Zhang, Naixin
    Xu, Guangluan
    Zhang, Zequen
    Li, Feng
    [J]. IEEE ACCESS, 2019, 7 : 181648 - 181655