Bi-directional Long Short-Term Memory Model with Semantic Positional Attention for the Question Answering System

被引:1
|
作者
Bi, Mingwen [1 ]
Zhang, Qingchuan [2 ]
Zuo, Min [2 ]
Xu, Zelong [2 ]
Jin, Qingyu [2 ]
机构
[1] China Agr Univ, Coll Informat & Elect Engn, Key Lab Agr Informatizat Standardizat, Minist Agr & Rural Affairs, Beijing, Peoples R China
[2] Beijing Technol & Business Univ, Natl Engn Lab Agriprod Qual Traceabil, Beijing, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Question answering; BLSTM model; semantic positional-based attention; Chinese semantic mapping mechanism;
D O I
10.1145/3439800
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The intelligent question answering system aims to provide quick and concise feedback on the questions of users. Although the performance of phrase-level and numerous attention models have been improved, the sentence components and position information are not emphasized enough. This article combines Ci-Lin and word2vec to divide all of the words in the question-answer pairs into groups according to the semantics and select one kernel word in each group. The remaining words are common words and realize the semantic mapping mechanism between kernel words and common words. With this Chinese semantic mapping mechanism, the common words in all questions and answers are replaced by the semantic kernel words to realize the normalization of the semantic representation. Meanwhile, based on the bi-directional LSTM model, this article introduces a method of the combination of semantic role labeling and positional context, dividing the sentence into multiple semantic segments according to semantic logic. The weight is given to the neighboring words in the same semantic segment and propose semantic role labeling position attention based on the bi-directional LSTM model (BLSTM-SRLP). The good performance of the BLSTM-SRLP model has been demonstrated in comparative experiments on the food safety field dataset (FS-QA).
引用
下载
收藏
页数:13
相关论文
共 50 条
  • [1] Deep Bi-directional Long Short-Term Memory Model for Short-Term Traffic Flow Prediction
    Wang, Jingyuan
    Hu, Fei
    Li, Li
    NEURAL INFORMATION PROCESSING, ICONIP 2017, PT V, 2017, 10638 : 306 - 316
  • [2] Spatial attention model-modulated bi-directional long short-term memory for unsupervised video summarisation
    Zhong, Rui
    Xiao, Diyang
    Dong, Shi
    Hu, Min
    ELECTRONICS LETTERS, 2021, 57 (06) : 252 - 254
  • [3] Stock Market Prediction Using Deep Attention Bi-directional Long Short-Term Memory
    Prakash, B.
    Saleena, B.
    COMPUTATIONAL ECONOMICS, 2024,
  • [4] Bi-directional Long Short-Term Memory model to analyze psychological effects on gamers
    Ghosh, Lidia
    Saha, Sriparna
    Konar, Amit
    APPLIED SOFT COMPUTING, 2020, 95
  • [5] Learning to Track by Bi-directional Long Short-Term Memory Networks
    Pan, Chen
    Shi, Dianxi
    Guan, Naiyang
    Zhang, Yongjun
    Wang, Liujing
    Jin, Songchang
    2019 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI 2019), 2019, : 783 - 790
  • [6] Diabetes Prediction Using Bi-directional Long Short-Term Memory
    Jaiswal S.
    Gupta P.
    SN Computer Science, 4 (4)
  • [7] Bi-directional long short-term memory method based on attention mechanism and rolling update for short-term load forecasting
    Wang, Shouxiang
    Wang, Xuan
    Wang, Shaomin
    Wang, Dan
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2019, 109 : 470 - 479
  • [8] Continuous Attention Mechanism Embedded (CAME) Bi-Directional Long Short-Term Memory Model for Fake News Detection
    Choudhary A.
    Arora A.
    International Journal of Ambient Computing and Intelligence, 2022, 13 (01)
  • [9] Sarcasm detection using optimized bi-directional long short-term memory
    Sukhavasi, Vidyullatha
    Sistla, Venkatrama Phani kumar
    Dondeti, Venkatesulu
    KNOWLEDGE AND INFORMATION SYSTEMS, 2024, : 2771 - 2799
  • [10] Maize seeds forecasting with hybrid directional and bi-directional long short-term memory models
    Isik, Hakan
    Tasdemir, Sakir
    Taspinar, Yavuz Selim
    Kursun, Ramazan
    Cinar, Ilkay
    Yasar, Ali
    Yasin, Elham Tahsin
    Koklu, Murat
    FOOD SCIENCE & NUTRITION, 2024, 12 (02): : 786 - 803