Deepfake Generation and Detection: Case Study and Challenges

被引:12
|
作者
Patel, Yogesh [1 ]
Tanwar, Sudeep [1 ]
Gupta, Rajesh [1 ]
Bhattacharya, Pronaya [2 ]
Davidson, Innocent Ewean [3 ,4 ]
Nyameko, Royi [3 ,4 ]
Aluvala, Srinivas [5 ]
Vimal, Vrince [6 ,7 ]
机构
[1] Nirma Univ, Inst Technol, Dept Comp Sci & Engn, Ahmadabad 382481, Gujarat, India
[2] Amity Univ, Amity Sch Engn & Technol, Dept Comp Sci & Engn, Kolkata 700135, India
[3] Cape Peninsula Univ Technol, African Space Innovat Ctr, Dept Elect Elect & Comp Engn, ZA-7535 Bellville, South Africa
[4] Cape Peninsula Univ Technol, French South African Inst Technol, Dept Elect Elect & Comp Engn, ZA-7535 Bellville, South Africa
[5] SR Univ, Dept Comp Sci & Artificial Intelligence, Warangal 506371, Telangana, India
[6] Graph Era Hill Univ, Dept Comp Sci & Engn, Dehra Dun 248002, India
[7] Graph Era, Dept Comp Sci & Engn, Dehra Dun 248002, Uttarakhand, India
关键词
Artificial intelligence; Deepfake generation; Deepfake detection; fake content; generative adversarial networks; NETWORKS; IMAGES;
D O I
10.1109/ACCESS.2023.3342107
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In smart communities, social media allowed users easy access to multimedia content. With recent advancements in computer vision and natural language processing, machine learning (ML), and deep learning (DL) models have evolved. With advancements in generative adversarial networks (GAN), it has become possible to create fake images/audio/and video streams of a person or use some person's audio and visual details to fit other environments. Thus, deepfakes are specifically used to disseminate fake information and propaganda on social circles that tarnish the reputation of an individual or an organization. Recently, many surveys have focused on generating and detecting deepfake images, audio, and video streams. Existing surveys are mostly aligned toward detecting deepfake contents, but the generation process is not suitably discussed. To address the survey gap, the paper proposes a comprehensive review of deepfake generation and detection and the different ML/DL approaches to synthesize deepfake contents. We discuss a comparative analysis of deepfake models and public datasets present for deepfake detection purposes. We discuss the implementation challenges and future research directions regarding optimized approaches and models. A unique case study, IBMM is discussed, which presents a multi-modal overview of deepfake detection. The proposed survey would benefit researchers, industry, and academia to study deepfake generation and subsequent detection schemes.
引用
收藏
页码:143296 / 143323
页数:28
相关论文
共 50 条
  • [41] Machine learning based medical image deepfake detection: A comparative study
    Solaiyappan, Siddharth
    Wen, Yuxin
    MACHINE LEARNING WITH APPLICATIONS, 2022, 8
  • [42] The growth of distributed generation and associated challenges: A Great Britain case study
    Gordon, Samuel
    McGarry, Connor
    Bell, Keith
    IET RENEWABLE POWER GENERATION, 2022, 16 (09) : 1827 - 1840
  • [43] ResViT: A Framework for Deepfake Videos Detection
    Ahmad, Wasim
    Ali, Imad
    Shahzad, Sahibzada Adil
    Hashmi, Ammarah
    Ghaffar, Faisal
    INTERNATIONAL JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING SYSTEMS, 2022, 13 (09) : 807 - 813
  • [44] DeepFake Detection by Analyzing Convolutional Traces
    Guarnera, Luca
    Giudice, Oliver
    Battiato, Sebastiano
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2841 - 2850
  • [45] Deepfake Detection: A Systematic Literature Review
    Rana, Md Shohel
    Nobi, Mohammad Nur
    Murali, Beddhu
    Sung, Andrew H.
    IEEE ACCESS, 2022, 10 : 25494 - 25513
  • [46] Deepfake Detection through Deep Learning
    Pan, Deng
    Sun, Lixian
    Wang, Rui
    Zhang, Xingjian
    Sinnott, Richard O.
    2020 IEEE/ACM INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING, APPLICATIONS AND TECHNOLOGIES (BDCAT 2020), 2020, : 134 - 143
  • [47] FakeSound: Deepfake General Audio Detection
    Xie, Zeyu
    Li, Baihan
    Xu, Xuenan
    Liang, Zheng
    Yu, Kai
    Wu, Mengyue
    INTERSPEECH 2024, 2024, : 112 - 116
  • [48] Deepfake Detection with Data Privacy Protection
    Wu, Mingkan
    Wang, Fei
    Wu, Xiaohan
    Yu, Fei
    Wang, Bo
    Song, Zengren
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [49] Capturing the Lighting Inconsistency for Deepfake Detection
    Wu, Wenxuan
    Zhou, Wenbo
    Zhang, Weiming
    Fang, Han
    Yu, Nenghai
    ARTIFICIAL INTELLIGENCE AND SECURITY, ICAIS 2022, PT II, 2022, 13339 : 637 - 647
  • [50] Adversarially Robust Deepfake Video Detection
    Devasthale, Aditya
    Sural, Shamik
    2022 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2022, : 396 - 403