EasyDeep: An IoT Friendly Robust Detection Method for GAN Generated Deepfake Images in Social Media

被引:5
|
作者
Mitra, Alakananda [1 ]
Mohanty, Saraju P. [1 ]
Corcoran, Peter [2 ]
Kougianos, Elias [3 ]
机构
[1] Univ North Texas, Dept Comp Sci & Engn, Denton, TX 76203 USA
[2] Natl Univ Ireland, Sch Engn & Informat, Galway, Ireland
[3] Univ North Texas, Dept Elect Engn, Denton, TX 76203 USA
关键词
Deepfake; IoT; Edge computing; Generative Adversarial Networks (GANs); Image-to-image translation; Texture analysis; Shannon's entropy; Haralick texture feature; CycleGAN; StarGAN;
D O I
10.1007/978-3-030-96466-5_14
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Advancements in artificial intelligence, and especially deep learning technology have given birth to a new era of multimedia forgery. Deepfake takes it to a whole new level. This deep learning based technology creates new images with features which have been acquired from a different set of images. The rapid evolution of Generative Adversarial networks (GANs) provides an available route to create deepfakes. They generate highly sophisticated and realistic images through deep learning and implement deepfake using image-to-image translation. We propose a novel, memory-efficient lightweight machine learning based deepfake detection method which is successfully deployed in the IoT platform. A detection API is proposed along with the detection method. To the best of the authors' knowledge, this effort is the first ever for detecting highly sophisticated GAN generated deepfake images at the edge. The novelty of the work is achieving a considerable amount of accuracy with a short training time and inference at the edge device. The total time for sending the image to the edge, detecting and result display through the API is promising. Some discussion is also provided to improve accuracy and to reduce the inference time. A comparative study is also made by performing a three-fold textural analysis - computation of Shannon's entropy, measurement of some of Haralick's texture features (like contrast, dissimilarity, homogeneity, correlation) and study of the histograms of the generated images. Even when generated fake images look similar to the corresponding real images, the results present clear evidence that they differ significantly from the real images in entropy, contrast, dissimilarity, homogeneity, and correlation.
引用
收藏
页码:217 / 236
页数:20
相关论文
共 50 条
  • [1] A robust ensemble model for Deepfake detection of GAN-generated images on social media
    Preeti Sharma
    Manoj Kumar
    Hitesh Kumar Sharma
    Discover Computing, 28 (1)
  • [2] Level Up the Deepfake Detection: A Method to Effectively Discriminate Images Generated by GAN Architectures and Diffusion Models
    Guarnera, Luca
    Giudice, Oliver
    Battiato, Sebastiano
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 3, INTELLISYS 2024, 2024, 1067 : 615 - 625
  • [3] Comparative Analysis of Deepfake Detection Models on Diverse GAN-Generated Images
    Wyawahare, Medha
    Bhorge, Siddharth
    Rane, Milind
    Parkhi, Vrinda
    Jha, Mayank
    Muhal, Narendra
    INTERNATIONAL JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING SYSTEMS, 2025, 16 (01) : 9 - 18
  • [4] Detection of GAN-generated Fake Images over Social Networks
    Marra, Francesco
    Gragnaniello, Diego
    Cozzolino, Davide
    Verdoliva, Luisa
    IEEE 1ST CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2018), 2018, : 384 - 389
  • [5] A Novel Machine Learning based Method for Deepfake Video Detection in Social Media
    Mitra, Alakananda
    Mohanty, Saraju P.
    Corcoran, Peter
    Kougianos, Elias
    2020 6TH IEEE INTERNATIONAL SYMPOSIUM ON SMART ELECTRONIC SYSTEMS (ISES 2020) (FORMERLY INIS), 2020, : 91 - 96
  • [6] Deepfake Detection on Social Media: Leveraging Deep Learning and FastText Embeddings for Identifying Machine-Generated Tweets
    Sadiq, Saima
    Aljrees, Turki
    Ullah, Saleem
    IEEE ACCESS, 2023, 11 : 95008 - 95021
  • [7] Robust DeepFake Detection Method based on Ensemble of ViT and CNN
    Ha, Hyunsoo
    Kim, Minsang
    Han, Songhun
    Lee, Sangjun
    38TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2023, 2023, : 1092 - 1095
  • [8] Advancing Deepfake Detection Using Xception Architecture: A Robust Approach for Safeguarding against Fabricated News on Social Media
    Alkurdi, Dunya Ahmed
    Cevik, Mesut
    Akgundogdu, Abdurrahim
    Computers, Materials and Continua, 2024, 81 (03): : 4285 - 4305
  • [9] Generalized and robust model for GAN-generated image detection
    Raj, Surbhi
    Mathew, Jimson
    Mondal, Arijit
    PATTERN RECOGNITION LETTERS, 2024, 182 : 104 - 110
  • [10] Robust Detection of Cyberbullying in Social Media
    Yao, Mengfan
    COMPANION OF THE WORLD WIDE WEB CONFERENCE (WWW 2019 ), 2019, : 61 - 66