DIMN: Dual Integrated Matching Network for multi-choice reading comprehension

被引:0
|
作者
Wei, Qiang [1 ,2 ]
Ma, Kun [1 ,2 ]
Liu, Xinyu [1 ,2 ]
Ji, Ke [1 ,2 ]
Yang, Bo [1 ,2 ]
Abraham, Ajith [3 ]
机构
[1] Univ Jinan, Sch Informat Sci & Engn, Jinan 250022, Peoples R China
[2] Univ Jinan, Shandong Prov Key Lab Network Based Intelligent Co, Jinan 250022, Peoples R China
[3] Sci Network Innovat & Res Excellence, Machine Intelligence Res Labs, Auburn, WA 98071 USA
关键词
Multi-choice reading comprehension; Contextualized representation; Global interactive relationship; Attention; Convolution;
D O I
10.1016/j.engappai.2023.107694
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-choice reading comprehension is a task that involves selecting the correct option from a set of option choices. Recently, the attention mechanism has been widely used to acquire embedding representations. However, there are two significant challenges: (1) generating the contextualized representations, namely, drawing associated information, and (2) capturing the global interactive relationship, namely, drawing local semantics. To address these issues, we have proposed the Dual Integrated Matching Network (DIMN) for multi-choice reading comprehension. It consists of two major parts. Fusing Information from Passage and Question-option pair into Enhanced Embedding Representation (FEER) is proposed to draw associated information to enhance embedding representation, which incorporates the information that reflects the most salient supporting entities to answer the question into the contextualized representations; Linear Integration of Co-Attention and Convolution (LIAC) is proposed to capture the interactive information and local semantics to construct global interactive relationship, which incorporates local semantics of a single sequence into the question-option-aware passage and passage-aware question-option representation. The experiments are shown that our DIMN performs better accuracy on three datasets: RACE (69.34%), DREAM (68.45%) and MCTest (71.81% on MCTest160 and 78.83% on MCTest500). Our DIMN is beneficial for improving the ability of machines to understand natural language. The system we have developed has been applied to customer service support. Our source code is accessible at https://github.com/vqiangv/DIMN.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] DCMN plus : Dual Co-Matching Network for Multi-Choice Reading Comprehension
    Zhang, Shuailiang
    Zhao, Hai
    Wu, Yuwei
    Zhang, Zhuosheng
    Zhou, Xi
    Zhou, Xiang
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 9563 - 9570
  • [2] A Co-Matching Model for Multi-choice Reading Comprehension
    Wang, Shuohang
    Yu, Mo
    Chang, Shiyu
    Jiang, Jing
    [J]. PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 2, 2018, : 746 - 751
  • [3] Option Attentive Capsule Network for Multi-choice Reading Comprehension
    Miao, Hang
    Liu, Ruifang
    Gao, Sheng
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2019), PT III, 2019, 11955 : 306 - 318
  • [4] SSIN: Sentence Semantic Interaction Network for Multi-Choice Reading Comprehension
    Xu, Xiaobo
    Tohti, Turdi
    Hamdulla, Askar
    [J]. IEEE ACCESS, 2022, 10 : 113915 - 113922
  • [5] Multi-Matching Network for Multiple Choice Reading Comprehension
    Tang, Min
    Cai, Jiaran
    Zhuo, Hankz Hankui
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 7088 - 7095
  • [6] Incremental BERT with commonsense representations for multi-choice reading comprehension
    Li, Ronghan
    Wang, Lifang
    Jiang, Zejun
    Liu, Dong
    Zhao, Meng
    Lu, Xinyu
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (21-23) : 32311 - 32333
  • [7] Inter- and Intra-sentence Interaction Network for Multi-choice Reading Comprehension
    Xu, Xiaobo
    Tohti, Turdi
    Hamdulla, Askar
    [J]. 2022 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY, HUMAN-COMPUTER INTERACTION AND ARTIFICIAL INTELLIGENCE, VRHCIAI, 2022, : 66 - 71
  • [8] Leveraging greater relations for improving multi-choice reading comprehension
    Hong Yan
    Lijun Liu
    Xupeng Feng
    Qingsong Huang
    [J]. Neural Computing and Applications, 2022, 34 : 20851 - 20864
  • [9] Incremental BERT with commonsense representations for multi-choice reading comprehension
    Ronghan Li
    Lifang Wang
    Zejun Jiang
    Dong Liu
    Meng Zhao
    Xinyu Lu
    [J]. Multimedia Tools and Applications, 2021, 80 : 32311 - 32333
  • [10] Leveraging greater relations for improving multi-choice reading comprehension
    Yan, Hong
    Liu, Lijun
    Feng, Xupeng
    Huang, Qingsong
    [J]. NEURAL COMPUTING & APPLICATIONS, 2022, 34 (23): : 20851 - 20864