Exploiting Explicit Matching Knowledge with Long Short-Term Memory

被引:0
|
作者
Bao, Xinqi [1 ]
Wu, Yunfang [1 ]
机构
[1] Peking Univ, Sch Elect Engn & Comp Sci, Key Lab Computat Linguist, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家高技术研究发展计划(863计划);
关键词
Lexical matching knowledge; LSTM; Question answering;
D O I
10.1007/978-3-319-69005-6_26
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently neural network models are widely applied in text-matching tasks like community-based question answering (cQA). The strong generalization power of neural networks enables these methods to find texts with similar topics but miss detailed matching information. However, as proven by traditional methods, the explicit lexical matching knowledge is important for effective answer retrieval. In this paper, we propose an ExMaLSTM model to incorporate the explicit matching knowledge into the long short-term memory (LSTM) neural network. We extract explicit lexical matching features with prior knowledge and then add them to the local representations of questions. We summarize the overall matching status by using a bi-directional LSTM. The final relevance score is calculated using a gate network, which can dynamically assign appropriate weights to the explicit matching score and the implicit relevance score. We conduct extensive experiments for answer retrieval in a cQA dataset. The results show that our proposed ExMaLSTM model outperforms both the traditional methods and various state-of-the-art neural network models significantly.
引用
收藏
页码:306 / 317
页数:12
相关论文
共 50 条
  • [21] Long Short-Term Memory Neural Equalizer
    Wang, Zihao
    Xu, Zhifei
    He, Jiayi
    Delingette, Hervé
    Fan, Jun
    IEEE Transactions on Signal and Power Integrity, 2023, 2 (01): : 13 - 22
  • [22] A review on the long short-term memory model
    Van Houdt, Greg
    Mosquera, Carlos
    Napoles, Gonzalo
    ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (08) : 5929 - 5955
  • [23] Reinforcement learning with long short-term memory
    Bakker, B
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 14, VOLS 1 AND 2, 2002, 14 : 1475 - 1482
  • [24] A Modified Long Short-Term Memory Cell
    Haralabopoulos, Giannis
    Razis, Gerasimos
    Anagnostopoulos, Ioannis
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2023, 33 (07)
  • [25] Shallow parsing with long short-term memory
    Hammerton, J
    PROCEEDINGS OF THE 7TH JOINT CONFERENCE ON INFORMATION SCIENCES, 2003, : 1512 - 1515
  • [26] On the Initialization of Long Short-Term Memory Networks
    Ghazi, Mostafa Mehdipour
    Nielsen, Mads
    Pai, Akshay
    Modat, Marc
    Cardoso, M. Jorge
    Ourselin, Sebastien
    Sorensen, Lauge
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT I, 2019, 11953 : 275 - 286
  • [27] Video Summarization with Long Short-Term Memory
    Zhang, Ke
    Chao, Wei-Lun
    Sha, Fei
    Grauman, Kristen
    COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 : 766 - 782
  • [28] A review on the long short-term memory model
    Greg Van Houdt
    Carlos Mosquera
    Gonzalo Nápoles
    Artificial Intelligence Review, 2020, 53 : 5929 - 5955
  • [29] Evolving Long Short-Term Memory Networks
    Neto, Vicente Coelho Lobo
    Passos, Leandro Aparecido
    Papa, Joao Paulo
    COMPUTATIONAL SCIENCE - ICCS 2020, PT II, 2020, 12138 : 337 - 350
  • [30] Long Short-Term Memory with Smooth Adaptation
    Mojica, Francisco
    Villasenor, Carlos
    Alanis, Alma Y.
    Arana-Daniel, Nancy
    2019 IEEE INTERNATIONAL AUTUMN MEETING ON POWER, ELECTRONICS AND COMPUTING (ROPEC 2019), 2019,