Exploiting Explicit Matching Knowledge with Long Short-Term Memory

被引:0
|
作者
Bao, Xinqi [1 ]
Wu, Yunfang [1 ]
机构
[1] Peking Univ, Sch Elect Engn & Comp Sci, Key Lab Computat Linguist, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家高技术研究发展计划(863计划);
关键词
Lexical matching knowledge; LSTM; Question answering;
D O I
10.1007/978-3-319-69005-6_26
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently neural network models are widely applied in text-matching tasks like community-based question answering (cQA). The strong generalization power of neural networks enables these methods to find texts with similar topics but miss detailed matching information. However, as proven by traditional methods, the explicit lexical matching knowledge is important for effective answer retrieval. In this paper, we propose an ExMaLSTM model to incorporate the explicit matching knowledge into the long short-term memory (LSTM) neural network. We extract explicit lexical matching features with prior knowledge and then add them to the local representations of questions. We summarize the overall matching status by using a bi-directional LSTM. The final relevance score is calculated using a gate network, which can dynamically assign appropriate weights to the explicit matching score and the implicit relevance score. We conduct extensive experiments for answer retrieval in a cQA dataset. The results show that our proposed ExMaLSTM model outperforms both the traditional methods and various state-of-the-art neural network models significantly.
引用
收藏
页码:306 / 317
页数:12
相关论文
共 50 条
  • [1] Keyword spotting exploiting Long Short-Term Memory
    Woellmer, Martin
    Schuller, Bjoern
    Rigoll, Gerhard
    SPEECH COMMUNICATION, 2013, 55 (02) : 252 - 265
  • [2] Matching Biomedical Ontologies with Long Short-Term Memory Networks
    Jiang, Chao
    Xue, Xingsi
    2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 2484 - 2489
  • [3] Proxy-basedWeb Prefetching Exploiting Long Short-Term Memory
    Won, Jiwoong
    Zou, Wenbo
    Ahn, Jemin
    Lim, Jiseoup
    Kim, Gun-Woo
    Kang, Kyungtae
    38TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2023, 2023, : 1831 - 1834
  • [4] Long short-term memory
    Hochreiter, S
    Schmidhuber, J
    NEURAL COMPUTATION, 1997, 9 (08) : 1735 - 1780
  • [5] Long Short-Term Memory Implementation Exploiting Passive RRAM Crossbar Array
    Nikam, Honey
    Satyam, Siddharth
    Sahay, Shubham
    IEEE TRANSACTIONS ON ELECTRON DEVICES, 2022, 69 (04) : 1743 - 1751
  • [6] Deep Pain: Exploiting Long Short-Term Memory Networks for Facial Expression Classification
    Rodriguez, Pau
    Cucurull, Guillem
    Gonzalez, Jordi
    Gonfaus, Josep M.
    Nasrollahi, Kamal
    Moeslund, Thomas B.
    Roca, F. Xavier
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (05) : 3314 - 3324
  • [7] Short-term Load Forecasting with Distributed Long Short-Term Memory
    Dong, Yi
    Chen, Yang
    Zhao, Xingyu
    Huang, Xiaowei
    2023 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE, ISGT, 2023,
  • [8] A short-term prediction model of global ionospheric VTEC based on the combination of long short-term memory and convolutional long short-term memory
    Peng Chen
    Rong Wang
    Yibin Yao
    Hao Chen
    Zhihao Wang
    Zhiyuan An
    Journal of Geodesy, 2023, 97
  • [9] A short-term prediction model of global ionospheric VTEC based on the combination of long short-term memory and convolutional long short-term memory
    Chen, Peng
    Wang, Rong
    Yao, Yibin
    Chen, Hao
    Wang, Zhihao
    An, Zhiyuan
    JOURNAL OF GEODESY, 2023, 97 (05)
  • [10] QUANTUM LONG SHORT-TERM MEMORY
    Chen, Samuel Yen-Chi
    Yoo, Shinjae
    Fang, Yao-Lung L.
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 8622 - 8626