From text to multimodal: a survey of adversarial example generation in question answering systems

被引:0
|
作者
Yigit, Gulsum [1 ,2 ]
Amasyali, Mehmet Fatih [1 ]
机构
[1] Yildiz Tech Univ, Dept Comp Engn, Istanbul, Turkiye
[2] Kadir Has Univ, Dept Comp Engn, Istanbul, Turkiye
关键词
Question answering; Adversarial question generation; Visual question generation; Adversarial datasets; Adversarial evaluation metrics;
D O I
10.1007/s10115-024-02199-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Integrating adversarial machine learning with question answering (QA) systems has emerged as a critical area for understanding the vulnerabilities and robustness of these systems. This article aims to review adversarial example-generation techniques in the QA field, including textual and multimodal contexts. We examine the techniques employed through systematic categorization, providing a structured review. Beginning with an overview of traditional QA models, we traverse the adversarial example generation by exploring rule-based perturbations and advanced generative models. We then extend our research to include multimodal QA systems, analyze them across various methods, and examine generative models, seq2seq architectures, and hybrid methodologies. Our research grows to different defense strategies, adversarial datasets, and evaluation metrics and illustrates the literature on adversarial QA. Finally, the paper considers the future landscape of adversarial question generation, highlighting potential research directions that can advance textual and multimodal QA systems in the context of adversarial challenges.
引用
收藏
页码:7165 / 7204
页数:40
相关论文
共 50 条
  • [31] A survey on question answering systems over linked data and documents
    Dimitrakis, Eleftherios
    Sgontzos, Konstantinos
    Tzitzikas, Yannis
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2020, 55 (02) : 233 - 259
  • [32] Selective Benefits of Question Self-Generation and Answering for Remembering Expository Text
    Bugg, Julie M.
    McDaniel, Mark A.
    JOURNAL OF EDUCATIONAL PSYCHOLOGY, 2012, 104 (04) : 922 - 931
  • [33] Generating a Question Answering System from Text Causal Relations
    Garrido Merchan, E. C.
    Puente, C.
    Olivas, J. A.
    HYBRID ARTIFICIAL INTELLIGENT SYSTEMS, HAIS 2019, 2019, 11734 : 14 - 25
  • [34] Visual question answering based evaluation metrics for text-to-image generation
    Miyamoto, Mizuki
    Morita, Ryugo
    Zhou, Jinjia
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,
  • [35] Text-based question answering from information retrieval and deep neural network perspectives: A survey
    Abbasiantaeb, Zahra
    Momtazi, Saeedeh
    WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2021, 11 (06)
  • [36] A Survey of Multi-modal Question Answering Systems for Robotics
    Liu, Xiaomeng
    Long, Fei
    2017 2ND INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM), 2017, : 189 - 194
  • [37] A survey on question answering systems over linked data and documents
    Eleftherios Dimitrakis
    Konstantinos Sgontzos
    Yannis Tzitzikas
    Journal of Intelligent Information Systems, 2020, 55 : 233 - 259
  • [38] Answer Generation for Retrieval-based Question Answering Systems
    Hsu, Chao-Chun
    Lind, Eric
    Soldaini, Luca
    Moschitti, Alessandro
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 4276 - 4282
  • [39] Survey on Adversarial Example Attack for Computer Vision Systems
    Wang Z.-B.
    Wang X.
    Ma J.-J.
    Qin Z.
    Ren J.
    Ren K.
    Jisuanji Xuebao/Chinese Journal of Computers, 2023, 46 (02): : 436 - 468
  • [40] What is the ultimate question answering system? Lessons learned from existing question answering systems
    Loerch, UW
    Guesgen, HW
    Proceedings of the IASTED International Conference on Artificial Intelligence and Applications, Vols 1and 2, 2004, : 323 - 329