From text to multimodal: a survey of adversarial example generation in question answering systems

被引:0
|
作者
Yigit, Gulsum [1 ,2 ]
Amasyali, Mehmet Fatih [1 ]
机构
[1] Yildiz Tech Univ, Dept Comp Engn, Istanbul, Turkiye
[2] Kadir Has Univ, Dept Comp Engn, Istanbul, Turkiye
关键词
Question answering; Adversarial question generation; Visual question generation; Adversarial datasets; Adversarial evaluation metrics;
D O I
10.1007/s10115-024-02199-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Integrating adversarial machine learning with question answering (QA) systems has emerged as a critical area for understanding the vulnerabilities and robustness of these systems. This article aims to review adversarial example-generation techniques in the QA field, including textual and multimodal contexts. We examine the techniques employed through systematic categorization, providing a structured review. Beginning with an overview of traditional QA models, we traverse the adversarial example generation by exploring rule-based perturbations and advanced generative models. We then extend our research to include multimodal QA systems, analyze them across various methods, and examine generative models, seq2seq architectures, and hybrid methodologies. Our research grows to different defense strategies, adversarial datasets, and evaluation metrics and illustrates the literature on adversarial QA. Finally, the paper considers the future landscape of adversarial question generation, highlighting potential research directions that can advance textual and multimodal QA systems in the context of adversarial challenges.
引用
收藏
页码:7165 / 7204
页数:40
相关论文
共 50 条
  • [41] Short Text Similarity Computing Method towards Agriculture Question and Answering Systems
    Sun, Bingjie
    Liang, Zhichao
    Zeng, Qingtian
    Zhao, Hua
    Ni, Weijian
    Duan, Hua
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION APPLICATIONS (ICCIA 2012), 2012, : 250 - 253
  • [42] Trick Me If You Can: Human-in-the-Loop Generation of Adversarial Examples for Question Answering
    Wallace E.
    Rodriguez P.
    Feng S.
    Boyd-Graber J.
    Yamada I.
    Transactions of the Association for Computational Linguistics, 2019, 7 : 387 - 401
  • [43] Trick Me If You Can: Human-in-the-Loop Generation of Adversarial Examples for Question Answering
    Wallace, Eric
    Rodriguez, Pedro
    Feng, Shi
    Yamada, Ikuya
    Boyd-Graber, Jordan
    TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2019, 7 : 387 - 401
  • [44] A short survey on end-to-end simple question answering systems
    Franco da Silva, Jose Wellington
    Pires Venceslau, Amanda Drielly
    Sales, Juliano Efson
    Rodrigues Maia, Jose Gilvan
    Monteiro Pinheiro, Vladia Celia
    Ponte Vidal, Vania Maria
    ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (07) : 5429 - 5453
  • [45] Core techniques of question answering systems over knowledge bases: a survey
    Dennis Diefenbach
    Vanessa Lopez
    Kamal Singh
    Pierre Maret
    Knowledge and Information Systems, 2018, 55 : 529 - 569
  • [46] Core techniques of question answering systems over knowledge bases: a survey
    Diefenbach, Dennis
    Lopez, Vanessa
    Singh, Kamal
    Maret, Pierre
    KNOWLEDGE AND INFORMATION SYSTEMS, 2018, 55 (03) : 529 - 569
  • [47] A short survey on end-to-end simple question answering systems
    José Wellington Franco da Silva
    Amanda Drielly Pires Venceslau
    Juliano Efson Sales
    José Gilvan Rodrigues Maia
    Vládia Célia Monteiro Pinheiro
    Vânia Maria Ponte Vidal
    Artificial Intelligence Review, 2020, 53 : 5429 - 5453
  • [48] A survey on question answering technology from an information retrieval perspective
    Kolomiyets, Oleksandr
    Moens, Marie-Francine
    INFORMATION SCIENCES, 2011, 181 (24) : 5412 - 5434
  • [49] Multimodal Natural Language Explanation Generation for Visual Question Answering Based on Multiple Reference Data
    Zhu, He
    Togo, Ren
    Ogawa, Takahiro
    Haseyama, Miki
    ELECTRONICS, 2023, 12 (10)
  • [50] UniRaG: Unification, Retrieval, and Generation for Multimodal Question Answering With Pre-Trained Language Models
    Lim, Qi Zhi
    Lee, Chin Poo
    Lim, Kian Ming
    Samingan, Ahmad Kamsani
    IEEE ACCESS, 2024, 12 : 71505 - 71519