From text to multimodal: a survey of adversarial example generation in question answering systems

被引:0
|
作者
Yigit, Gulsum [1 ,2 ]
Amasyali, Mehmet Fatih [1 ]
机构
[1] Yildiz Tech Univ, Dept Comp Engn, Istanbul, Turkiye
[2] Kadir Has Univ, Dept Comp Engn, Istanbul, Turkiye
关键词
Question answering; Adversarial question generation; Visual question generation; Adversarial datasets; Adversarial evaluation metrics;
D O I
10.1007/s10115-024-02199-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Integrating adversarial machine learning with question answering (QA) systems has emerged as a critical area for understanding the vulnerabilities and robustness of these systems. This article aims to review adversarial example-generation techniques in the QA field, including textual and multimodal contexts. We examine the techniques employed through systematic categorization, providing a structured review. Beginning with an overview of traditional QA models, we traverse the adversarial example generation by exploring rule-based perturbations and advanced generative models. We then extend our research to include multimodal QA systems, analyze them across various methods, and examine generative models, seq2seq architectures, and hybrid methodologies. Our research grows to different defense strategies, adversarial datasets, and evaluation metrics and illustrates the literature on adversarial QA. Finally, the paper considers the future landscape of adversarial question generation, highlighting potential research directions that can advance textual and multimodal QA systems in the context of adversarial challenges.
引用
收藏
页码:7165 / 7204
页数:40
相关论文
共 50 条
  • [1] Adversarial Multimodal Network for Movie Story Question Answering
    Yuan, Zhaoquan
    Sun, Siyuan
    Duan, Lixin
    Li, Changsheng
    Wu, Xiao
    Xu, Changsheng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 1744 - 1756
  • [2] Unifying Text, Tables, and Images for Multimodal Question Answering
    Luo, Haohao
    Shen, Ying
    Deng, Yang
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 9355 - 9367
  • [3] A Survey on Multimodal Large Language Models in Radiology for Report Generation and Visual Question Answering
    Yi, Ziruo
    Xiao, Ting
    Albert, Mark V.
    INFORMATION, 2025, 16 (02)
  • [4] A survey on semantic question answering systems
    Antoniou, Christina
    Bassiliades, Nick
    KNOWLEDGE ENGINEERING REVIEW, 2022, 37 (03):
  • [5] A survey on question answering systems with classification
    Mishra, Amit
    Jain, Sanjay Kumar
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2016, 28 (03) : 345 - 361
  • [6] Classification of question answering systems: A survey
    Sandhini, S.
    Binu, R.
    EMERGING TRENDS IN ENGINEERING, SCIENCE AND TECHNOLOGY FOR SOCIETY, ENERGY AND ENVIRONMENT, 2018, : 779 - 784
  • [7] Question Answering Systems: Survey and Trends
    Bouziane, Abdelghani
    Bouchiha, Djelloul
    Doumi, Noureddine
    Malki, Mimoun
    INTERNATIONAL CONFERENCE ON ADVANCED WIRELESS INFORMATION AND COMMUNICATION TECHNOLOGIES (AWICT 2015), 2015, 73 : 366 - 375
  • [8] Arabic Text Question Answering from an Answer Retrieval Point of View: a survey
    Sati, Bodor A. B.
    Ali, Mohammed A. S.
    Abdou, Sherif M.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2016, 7 (07) : 478 - 484
  • [9] Prompt-Enhanced Generation for Multimodal Open Question Answering
    Cui, Chenhao
    Li, Zhoujun
    ELECTRONICS, 2024, 13 (08)
  • [10] Usability survey of biomedical question answering systems
    Bauer, Michael A.
    Berleant, Daniel
    HUMAN GENOMICS, 2012, 6