From text to multimodal: a survey of adversarial example generation in question answering systems

被引:0
|
作者
Yigit, Gulsum [1 ,2 ]
Amasyali, Mehmet Fatih [1 ]
机构
[1] Yildiz Tech Univ, Dept Comp Engn, Istanbul, Turkiye
[2] Kadir Has Univ, Dept Comp Engn, Istanbul, Turkiye
关键词
Question answering; Adversarial question generation; Visual question generation; Adversarial datasets; Adversarial evaluation metrics;
D O I
10.1007/s10115-024-02199-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Integrating adversarial machine learning with question answering (QA) systems has emerged as a critical area for understanding the vulnerabilities and robustness of these systems. This article aims to review adversarial example-generation techniques in the QA field, including textual and multimodal contexts. We examine the techniques employed through systematic categorization, providing a structured review. Beginning with an overview of traditional QA models, we traverse the adversarial example generation by exploring rule-based perturbations and advanced generative models. We then extend our research to include multimodal QA systems, analyze them across various methods, and examine generative models, seq2seq architectures, and hybrid methodologies. Our research grows to different defense strategies, adversarial datasets, and evaluation metrics and illustrates the literature on adversarial QA. Finally, the paper considers the future landscape of adversarial question generation, highlighting potential research directions that can advance textual and multimodal QA systems in the context of adversarial challenges.
引用
收藏
页码:7165 / 7204
页数:40
相关论文
共 50 条
  • [21] Representations for Question Answering from Documents with Tables and Text
    Zayats, Vicky
    Toutanova, Kristina
    Ostendorf, Mari
    16TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2021), 2021, : 2895 - 2906
  • [22] QuGAN: Quasi Generative Adversarial Network for Tibetan Question Answering Corpus Generation
    Sun, Yuan
    Chen, Chaofan
    Xia, Tianci
    Zhao, Xiaobing
    IEEE ACCESS, 2019, 7 : 116247 - 116255
  • [23] Automatic generation of question answering systems in restricted domains
    Vila, Katia
    Mazon, Jose-Norberto
    Ferrandez, Antonio
    PROFESIONAL DE LA INFORMACION, 2012, 21 (01): : 16 - 26
  • [24] Automated question generation and question answering from Turkish texts
    Akyon, Fatih Cagatay
    Cavusoglu, Devrim
    Cengiz, Cemil
    Altinuc, Sinan Onur
    Temizel, Alptekin
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2022, 30 (05) : 1931 - +
  • [25] A survey on text generation using generative adversarial networks
    de Rosa, Gustavo H.
    Papa, Joao P.
    PATTERN RECOGNITION, 2021, 119
  • [26] DMRFNet: Deep Multimodal Reasoning and Fusion for Visual Question Answering and explanation generation
    Zhang, Weifeng
    Yu, Jing
    Zhao, Wenhong
    Ran, Chuan
    INFORMATION FUSION, 2021, 72 : 70 - 79
  • [27] DMRFNet: Deep Multimodal Reasoning and Fusion for Visual Question Answering and explanation generation
    Zhang, Weifeng
    Yu, Jing
    Zhao, Wenhong
    Ran, Chuan
    Information Fusion, 2021, 72 : 70 - 79
  • [28] Transformer models used for text-based question answering systems
    Nassiri, Khalid
    Akhloufi, Moulay
    APPLIED INTELLIGENCE, 2023, 53 (09) : 10602 - 10635
  • [29] Transformer models used for text-based question answering systems
    Khalid Nassiri
    Moulay Akhloufi
    Applied Intelligence, 2023, 53 : 10602 - 10635
  • [30] EXPERT SYSTEMS USING SEMANTIC REPRESENTATIONS OF FULL TEXT FOR QUESTION ANSWERING
    FUTRELLE, RP
    SMITH, LC
    PROCEEDINGS OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE, 1982, 19 : 103 - 106