EasyDeep: An IoT Friendly Robust Detection Method for GAN Generated Deepfake Images in Social Media

被引:5
|
作者
Mitra, Alakananda [1 ]
Mohanty, Saraju P. [1 ]
Corcoran, Peter [2 ]
Kougianos, Elias [3 ]
机构
[1] Univ North Texas, Dept Comp Sci & Engn, Denton, TX 76203 USA
[2] Natl Univ Ireland, Sch Engn & Informat, Galway, Ireland
[3] Univ North Texas, Dept Elect Engn, Denton, TX 76203 USA
关键词
Deepfake; IoT; Edge computing; Generative Adversarial Networks (GANs); Image-to-image translation; Texture analysis; Shannon's entropy; Haralick texture feature; CycleGAN; StarGAN;
D O I
10.1007/978-3-030-96466-5_14
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Advancements in artificial intelligence, and especially deep learning technology have given birth to a new era of multimedia forgery. Deepfake takes it to a whole new level. This deep learning based technology creates new images with features which have been acquired from a different set of images. The rapid evolution of Generative Adversarial networks (GANs) provides an available route to create deepfakes. They generate highly sophisticated and realistic images through deep learning and implement deepfake using image-to-image translation. We propose a novel, memory-efficient lightweight machine learning based deepfake detection method which is successfully deployed in the IoT platform. A detection API is proposed along with the detection method. To the best of the authors' knowledge, this effort is the first ever for detecting highly sophisticated GAN generated deepfake images at the edge. The novelty of the work is achieving a considerable amount of accuracy with a short training time and inference at the edge device. The total time for sending the image to the edge, detecting and result display through the API is promising. Some discussion is also provided to improve accuracy and to reduce the inference time. A comparative study is also made by performing a three-fold textural analysis - computation of Shannon's entropy, measurement of some of Haralick's texture features (like contrast, dissimilarity, homogeneity, correlation) and study of the histograms of the generated images. Even when generated fake images look similar to the corresponding real images, the results present clear evidence that they differ significantly from the real images in entropy, contrast, dissimilarity, homogeneity, and correlation.
引用
收藏
页码:217 / 236
页数:20
相关论文
共 50 条
  • [41] Aggressive Social Media Post Detection System Containing Symbolic Images
    Kumari, Kirti
    Singh, Jyoti Prakash
    Dwivedi, Yogesh K.
    Rana, Nripendra P.
    DIGITAL TRANSFORMATION FOR A SUSTAINABLE SOCIETY IN THE 21ST CENTURY, 2019, 11701 : 415 - 424
  • [42] Towards Automated Detection of Risky Images Shared by Youth on Social Media
    Park, Jinkyung
    Gracie, Joshua
    Alsoubai, Ashwaq
    Stringhini, Gianluca
    Singh, Vivek K.
    Wisniewski, Pamela
    COMPANION OF THE WORLD WIDE WEB CONFERENCE, WWW 2023, 2023, : 1348 - 1357
  • [43] Flood Detection in Social Media Images Using Visual Features and Metadata
    Jony, Rabiul Islam
    Woodley, Alan
    Perrin, Dimitri
    2019 DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2019, : 322 - 329
  • [44] Clickbait Analysis and Detection Method on Chinese Social Media
    Jiayi, Gui
    Ke, Yu
    Zhou, Hao
    Wu, Xiaofei
    2022 8TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS, BIGCOM, 2022, : 342 - 349
  • [45] Robust Edge Detection Method for the Segmentation of Diabetic Foot Ulcer Images
    Mwawado, Rehema
    Maiseli, Baraka
    Dida, Mussa
    ENGINEERING TECHNOLOGY & APPLIED SCIENCE RESEARCH, 2020, 10 (04) : 6034 - 6040
  • [46] A robust digital image watermarking method for forgery detection in printed images
    Cao, W.
    Zhu, B. S.
    Zhu, S. L.
    Ma, Z. G.
    Deng, F. S.
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 3134 - 3137
  • [47] A Robust Method for Ventriculomegaly Detection from Neonatal Brain Ultrasound Images
    Mondal, Prasenjit
    Mukhopadhyay, Jayanta
    Sural, Shamik
    Majumdar, Arun Kumar
    Majumdar, Bandana
    Mukherjee, Suchandra
    Singh, Arun
    JOURNAL OF MEDICAL SYSTEMS, 2012, 36 (05) : 2817 - 2828
  • [48] A Robust Method for Ventriculomegaly Detection from Neonatal Brain Ultrasound Images
    Prasenjit Mondal
    Jayanta Mukhopadhyay
    Shamik Sural
    Arun Kumar Majumdar
    Bandana Majumdar
    Suchandra Mukherjee
    Arun Singh
    Journal of Medical Systems, 2012, 36 : 2817 - 2828
  • [49] A Detection Method of Operated Fake-Images Using Robust Hashing
    Tanaka, Miki
    Shiota, Sayaka
    Kiya, Hitoshi
    JOURNAL OF IMAGING, 2021, 7 (08)
  • [50] A Robust Detection Method of Control Points for Calibration and Measurement With Defocused Images
    Ding, Wendong
    Liu, Xilong
    Xu, De
    Zhang, Dapeng
    Zhang, Zhengtao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2017, 66 (10) : 2725 - 2735