Bi-directional Long Short-Term Memory Model with Semantic Positional Attention for the Question Answering System

被引:1
|
作者
Bi, Mingwen [1 ]
Zhang, Qingchuan [2 ]
Zuo, Min [2 ]
Xu, Zelong [2 ]
Jin, Qingyu [2 ]
机构
[1] China Agr Univ, Coll Informat & Elect Engn, Key Lab Agr Informatizat Standardizat, Minist Agr & Rural Affairs, Beijing, Peoples R China
[2] Beijing Technol & Business Univ, Natl Engn Lab Agriprod Qual Traceabil, Beijing, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Question answering; BLSTM model; semantic positional-based attention; Chinese semantic mapping mechanism;
D O I
10.1145/3439800
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The intelligent question answering system aims to provide quick and concise feedback on the questions of users. Although the performance of phrase-level and numerous attention models have been improved, the sentence components and position information are not emphasized enough. This article combines Ci-Lin and word2vec to divide all of the words in the question-answer pairs into groups according to the semantics and select one kernel word in each group. The remaining words are common words and realize the semantic mapping mechanism between kernel words and common words. With this Chinese semantic mapping mechanism, the common words in all questions and answers are replaced by the semantic kernel words to realize the normalization of the semantic representation. Meanwhile, based on the bi-directional LSTM model, this article introduces a method of the combination of semantic role labeling and positional context, dividing the sentence into multiple semantic segments according to semantic logic. The weight is given to the neighboring words in the same semantic segment and propose semantic role labeling position attention based on the bi-directional LSTM model (BLSTM-SRLP). The good performance of the BLSTM-SRLP model has been demonstrated in comparative experiments on the food safety field dataset (FS-QA).
引用
下载
收藏
页数:13
相关论文
共 50 条
  • [21] Attention-Based Bi-Directional Long-Short Term Memory Network for Earthquake Prediction
    Banna, Md. Hasan Al
    Ghosh, Tapotosh
    Nahian, Md. Jaber Al
    Taher, Kazi Abu
    Kaiser, M. Shamim
    Mahmud, Mufti
    Hossain, Mohammad Shahadat
    Andersson, Karl
    IEEE ACCESS, 2021, 9 : 56589 - 56603
  • [22] State of Charge Estimation of Lithium-Ion Batteries Using Long Short-Term Memory and Bi-directional Long Short-Term Memory Neural Networks
    Namboothiri K.M.
    Sundareswaran K.
    Nayak P.S.R.
    Simon S.P.
    Journal of The Institution of Engineers (India): Series B, 2024, 105 (01) : 175 - 182
  • [23] Fake news detection system based on modified bi-directional long short term memory
    Chetan Agrawal
    Anjana Pandey
    Sachin Goyal
    Multimedia Tools and Applications, 2022, 81 : 24199 - 24223
  • [24] Fake news detection system based on modified bi-directional long short term memory
    Agrawal, Chetan
    Pandey, Anjana
    Goyal, Sachin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (17) : 24199 - 24223
  • [25] A performance degradation prediction model for PEMFC based on bi-directional long short-term memory and multi-head self-attention mechanism
    Jia, Chunchun
    He, Hongwen
    Zhou, Jiaming
    Li, Kunang
    Li, Jianwei
    Wei, Zhongbao
    INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2024, 60 : 133 - 146
  • [26] Congestive heart failure detection based on attention mechanism-enabled bi-directional long short-term memory model in the internet of medical things
    Shi, Xin
    Zhang, Xiaobin
    Zhuang, Fei
    Lu, Yanqiao
    Liang, Feng
    Zhao, Naishi
    Wang, Xia
    Li, Yi
    Cai, Zhaohua
    Wu, Zhiqiang
    Shen, Linghong
    He, Ben
    JOURNAL OF INDUSTRIAL INFORMATION INTEGRATION, 2022, 30
  • [27] Congestive heart failure detection based on attention mechanism-enabled bi-directional long short-term memory model in the internet of medical things
    Shi, Xin
    Zhang, Xiaobin
    Zhuang, Fei
    Lu, Yanqiao
    Liang, Feng
    Zhao, Naishi
    Wang, Xia
    Li, Yi
    Cai, Zhaohua
    Wu, Zhiqiang
    Shen, Linghong
    He, Ben
    Journal of Industrial Information Integration, 2022, 30
  • [28] Forecast of short-term daily reference evapotranspiration under limited meteorological variables using a hybrid bi-directional long short-term memory model (Bi-LSTM)
    Yin, Juan
    Deng, Zhen
    Ines, Amor V. M.
    Wu, Junbin
    Rasu, Eeswaran
    AGRICULTURAL WATER MANAGEMENT, 2020, 242
  • [29] An energy prediction approach using bi-directional long short-term memory for a hydropower plant in Laos
    Kaewarsa, Suriya
    Kongpaseuth, Vanhkham
    ELECTRICAL ENGINEERING, 2024, 106 (03) : 2609 - 2625
  • [30] Runoff Forecasting using Convolutional Neural Networks and optimized Bi-directional Long Short-term Memory
    Junhao Wu
    Zhaocai Wang
    Yuan Hu
    Sen Tao
    Jinghan Dong
    Water Resources Management, 2023, 37 : 937 - 953