Poisoning Attacks via Generative Adversarial Text to Image Synthesis

被引:3
|
作者
Kasichainula, Keshav [1 ]
Mansourifar, Hadi [1 ]
Shi, Weidong [1 ]
机构
[1] Univ Houston, Dept Comp Sci, Houston, TX 77204 USA
关键词
Poisoning Attacks; Generative Adversarial Net(GAN); Machine Learning; Convolutional Neural Networks;
D O I
10.1109/DSN-W52860.2021.00035
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
A poisoning attack is where the adversary can inject a small fraction of poisoning instances into the training data used to train a machine learning model to compromise the performance. Poison attacks can significantly affect the learning process and performance as the model is trained on incorrect data. We have seen many works on data poisoning over the years, but it is limited to few deep learning networks. In this work, we introduce a novel approach by leveraging Generative Adversarial Text to Image Synthesis to create poison attacks against machine learning classifiers. Our approach has three components, which are the generator, discriminator, and the target classifier. We performed an extensive experimental evaluation that proves our attack's efficiency to compromise machine learning classifiers including deep networks.
引用
收藏
页码:158 / 165
页数:8
相关论文
共 50 条
  • [1] Generative Adversarial Text to Image Synthesis
    Reed, Scott
    Akata, Zeynep
    Yan, Xinchen
    Logeswaran, Lajanugen
    Schiele, Bernt
    Lee, Honglak
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [2] TEXT TO IMAGE SYNTHESIS WITH ERUDITE GENERATIVE ADVERSARIAL NETWORKS
    Zhang, Zhiqiang
    Yu, Wenxin
    Jiang, Ning
    Zhou, Jinjia
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2438 - 2442
  • [3] TEXT TO IMAGE SYNTHESIS WITH BIDIRECTIONAL GENERATIVE ADVERSARIAL NETWORK
    Wang, Zixu
    Quan, Zhe
    Wang, Zhi-Jie
    Hu, Xinjian
    Chen, Yangyang
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [4] Hybrid Attention Driven Text-to-Image Synthesis via Generative Adversarial Networks
    Cheng, Qingrong
    Gu, Xiaodong
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: WORKSHOP AND SPECIAL SESSIONS, 2019, 11731 : 483 - 495
  • [5] DRAWGAN: TEXT TO IMAGE SYNTHESIS WITH DRAWING GENERATIVE ADVERSARIAL NETWORKS
    Zhang, Zhiqiang
    Zhou, Jinjia
    Yu, Wenxin
    Jiang, Ning
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 4195 - 4199
  • [6] GALIP: Generative Adversarial CLIPs for Text-to-Image Synthesis
    Tao, Ming
    Bao, Bing-Kun
    Tang, Hao
    Xu, Changsheng
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 14214 - 14223
  • [7] Vision-Language Matching for Text-to-Image Synthesis via Generative Adversarial Networks
    Cheng, Qingrong
    Wen, Keyu
    Gu, Xiaodong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 7062 - 7075
  • [8] Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Models
    Shan, Shawn
    Ding, Wenxin
    Passananti, Josephine
    Wu, Stanley
    Zheng, Haitao
    Zhao, Ben Y.
    45TH IEEE SYMPOSIUM ON SECURITY AND PRIVACY, SP 2024, 2024, : 807 - 825
  • [9] TextControlGAN: Text-to-Image Synthesis with Controllable Generative Adversarial Networks
    Ku, Hyeeun
    Lee, Minhyeok
    APPLIED SCIENCES-BASEL, 2023, 13 (08):
  • [10] A survey of generative adversarial networks and their application in text-to-image synthesis
    Zeng, Wu
    Zhu, Heng-liang
    Lin, Chuan
    Xiao, Zheng-ying
    ELECTRONIC RESEARCH ARCHIVE, 2023, 31 (12): : 7142 - 7181