EasyDeep: An IoT Friendly Robust Detection Method for GAN Generated Deepfake Images in Social Media

被引:5
|
作者
Mitra, Alakananda [1 ]
Mohanty, Saraju P. [1 ]
Corcoran, Peter [2 ]
Kougianos, Elias [3 ]
机构
[1] Univ North Texas, Dept Comp Sci & Engn, Denton, TX 76203 USA
[2] Natl Univ Ireland, Sch Engn & Informat, Galway, Ireland
[3] Univ North Texas, Dept Elect Engn, Denton, TX 76203 USA
关键词
Deepfake; IoT; Edge computing; Generative Adversarial Networks (GANs); Image-to-image translation; Texture analysis; Shannon's entropy; Haralick texture feature; CycleGAN; StarGAN;
D O I
10.1007/978-3-030-96466-5_14
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Advancements in artificial intelligence, and especially deep learning technology have given birth to a new era of multimedia forgery. Deepfake takes it to a whole new level. This deep learning based technology creates new images with features which have been acquired from a different set of images. The rapid evolution of Generative Adversarial networks (GANs) provides an available route to create deepfakes. They generate highly sophisticated and realistic images through deep learning and implement deepfake using image-to-image translation. We propose a novel, memory-efficient lightweight machine learning based deepfake detection method which is successfully deployed in the IoT platform. A detection API is proposed along with the detection method. To the best of the authors' knowledge, this effort is the first ever for detecting highly sophisticated GAN generated deepfake images at the edge. The novelty of the work is achieving a considerable amount of accuracy with a short training time and inference at the edge device. The total time for sending the image to the edge, detecting and result display through the API is promising. Some discussion is also provided to improve accuracy and to reduce the inference time. A comparative study is also made by performing a three-fold textural analysis - computation of Shannon's entropy, measurement of some of Haralick's texture features (like contrast, dissimilarity, homogeneity, correlation) and study of the histograms of the generated images. Even when generated fake images look similar to the corresponding real images, the results present clear evidence that they differ significantly from the real images in entropy, contrast, dissimilarity, homogeneity, and correlation.
引用
收藏
页码:217 / 236
页数:20
相关论文
共 50 条
  • [31] A General Method for Event Detection on Social Media
    Zhang, Yihong
    Shirakawa, Masumi
    Hara, Takahiro
    ADVANCES IN DATABASES AND INFORMATION SYSTEMS, ADBIS 2021, 2021, 12843 : 43 - 56
  • [32] A Survey of Detection and Mitigation for Fake Images on Social Media Platforms
    Sharma, Dilip Kumar
    Singh, Bhuvanesh
    Agarwal, Saurabh
    Garg, Lalit
    Kim, Cheonshik
    Jung, Ki-Hyun
    APPLIED SCIENCES-BASEL, 2023, 13 (19):
  • [33] Towards Robust Gan-Generated Image Detection: A Multi-View Completion Representation
    Liu, Chi
    Zhu, Tianqing
    Shen, Sheng
    Zhou, Wanlei
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 464 - 472
  • [34] A Robust Pedestrian and Cyclist Detection Method Using Thermal Images
    Annapareddy, Navya
    Sahin, Emir
    Abraham, Sander
    Islam, Md Mofijul
    DePiro, Max
    Iqbal, Tariq
    2021 SYSTEMS AND INFORMATION ENGINEERING DESIGN SYMPOSIUM (IEEE SIEDS 2021), 2021, : 69 - 74
  • [35] An Eyes-Based Siamese Neural Network for the Detection of GAN-Generated Face Images
    Wang, Jun
    Tondi, Benedetta
    Barni, Mauro
    FRONTIERS IN SIGNAL PROCESSING, 2022, 2
  • [36] Simplicity is not key: Understanding firm-generated social media images and consumer liking
    Overgoor, Gijs
    Rand, William
    van Dolen, Willemijn
    Mazloom, Masoud
    INTERNATIONAL JOURNAL OF RESEARCH IN MARKETING, 2022, 39 (03) : 639 - 655
  • [37] Authenticating AI-Generated Social Media Images Using Frequency Domain Analysis
    Poredi, Nihal
    Nagothu, Deeraj
    Chen, Yu
    2024 IEEE 21ST CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC, 2024, : 534 - 539
  • [38] Fusion of Infrared-Visible Images in UE-IoT for Fault Point Detection Based on GAN
    Liao, Bin
    Du, You
    Yin, Xiangyun
    IEEE ACCESS, 2020, 8 : 79754 - 79763
  • [39] Lightning Talk-Towards Robust Detection of Cyberbullying in Social Media
    Yao, Mengfan
    Chelmis, Charalampos
    Zois, Daphney-Stavroula
    COMPANION OF THE WORLD WIDE WEB CONFERENCE (WWW 2019 ), 2019, : 1290 - 1291
  • [40] Cyberbullying Ends Here: Towards Robust Detection of Cyberbullying in Social Media
    Yao, Mengfan
    Chelmis, Charalampos
    Zois, Daphney-Stavroula
    WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 3427 - 3433