Deepfake Generation and Detection: Case Study and Challenges

被引:12
|
作者
Patel, Yogesh [1 ]
Tanwar, Sudeep [1 ]
Gupta, Rajesh [1 ]
Bhattacharya, Pronaya [2 ]
Davidson, Innocent Ewean [3 ,4 ]
Nyameko, Royi [3 ,4 ]
Aluvala, Srinivas [5 ]
Vimal, Vrince [6 ,7 ]
机构
[1] Nirma Univ, Inst Technol, Dept Comp Sci & Engn, Ahmadabad 382481, Gujarat, India
[2] Amity Univ, Amity Sch Engn & Technol, Dept Comp Sci & Engn, Kolkata 700135, India
[3] Cape Peninsula Univ Technol, African Space Innovat Ctr, Dept Elect Elect & Comp Engn, ZA-7535 Bellville, South Africa
[4] Cape Peninsula Univ Technol, French South African Inst Technol, Dept Elect Elect & Comp Engn, ZA-7535 Bellville, South Africa
[5] SR Univ, Dept Comp Sci & Artificial Intelligence, Warangal 506371, Telangana, India
[6] Graph Era Hill Univ, Dept Comp Sci & Engn, Dehra Dun 248002, India
[7] Graph Era, Dept Comp Sci & Engn, Dehra Dun 248002, Uttarakhand, India
关键词
Artificial intelligence; Deepfake generation; Deepfake detection; fake content; generative adversarial networks; NETWORKS; IMAGES;
D O I
10.1109/ACCESS.2023.3342107
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In smart communities, social media allowed users easy access to multimedia content. With recent advancements in computer vision and natural language processing, machine learning (ML), and deep learning (DL) models have evolved. With advancements in generative adversarial networks (GAN), it has become possible to create fake images/audio/and video streams of a person or use some person's audio and visual details to fit other environments. Thus, deepfakes are specifically used to disseminate fake information and propaganda on social circles that tarnish the reputation of an individual or an organization. Recently, many surveys have focused on generating and detecting deepfake images, audio, and video streams. Existing surveys are mostly aligned toward detecting deepfake contents, but the generation process is not suitably discussed. To address the survey gap, the paper proposes a comprehensive review of deepfake generation and detection and the different ML/DL approaches to synthesize deepfake contents. We discuss a comparative analysis of deepfake models and public datasets present for deepfake detection purposes. We discuss the implementation challenges and future research directions regarding optimized approaches and models. A unique case study, IBMM is discussed, which presents a multi-modal overview of deepfake detection. The proposed survey would benefit researchers, industry, and academia to study deepfake generation and subsequent detection schemes.
引用
收藏
页码:143296 / 143323
页数:28
相关论文
共 50 条
  • [31] Coherent adversarial deepfake video generation
    Liu, Honggu
    Zhou, Wenbo
    Chen, Dongdong
    Fang, Han
    Bian, Huanyu
    Liu, Kunlin
    Zhang, Weiming
    Yu, Nenghai
    SIGNAL PROCESSING, 2023, 203
  • [32] Towards Generalization in Deepfake Detection
    Verdoliva, Luisa
    1ST ACM INTERNATIONAL WORKSHOP ON MULTIMEDIA AI AGAINST DISINFORMATION, MAD 2022, 2022, : 1 - 1
  • [33] Unmasking deepfakes: A systematic review of deepfake detection and generation techniques using artificial intelligence
    Abbas, Fakhar
    Taeihagh, Araz
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252
  • [34] ADGD'21: 1stWorkshop on Synthetic Multimedia Audiovisual Deepfake Generation and Detection
    Winkler, Stefan
    Chen, Weiling
    Dhall, Abhinav
    Korshunov, Pavel
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 5698 - 5699
  • [35] Coherent adversarial deepfake video generation
    Liu, Honggu
    Zhou, Wenbo
    Chen, Dongdong
    Fang, Han
    Bian, Huanyu
    Liu, Kunlin
    Zhang, Weiming
    Yu, Nenghai
    SIGNAL PROCESSING, 2023, 203
  • [36] DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection
    Shao, Rui
    Wu, Tianxing
    Nie, Liqiang
    Liu, Ziwei
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025,
  • [37] Explainable AI for DeepFake Detection
    Mansoor, Nazneen
    Iliev, Alexander I.
    APPLIED SCIENCES-BASEL, 2025, 15 (02):
  • [38] The Face Deepfake Detection Challenge
    Guarnera, Luca
    Giudice, Oliver
    Guarnera, Francesco
    Ortis, Alessandro
    Puglisi, Giovanni
    Paratore, Antonino
    Bui, Linh M. Q.
    Fontani, Marco
    Coccomini, Davide Alessandro
    Caldelli, Roberto
    Falchi, Fabrizio
    Gennaro, Claudio
    Messina, Nicola
    Amato, Giuseppe
    Perelli, Gianpaolo
    Concas, Sara
    Cuccu, Carlo
    Orru, Giulia
    Marcialis, Gian Luca
    Battiato, Sebastiano
    JOURNAL OF IMAGING, 2022, 8 (10)
  • [39] Aggregating Layers for Deepfake Detection
    Jevnisek, Amir
    Avidan, Shai
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2027 - 2033
  • [40] A Comprehensive Study on Key Components of Grayscale-based Deepfake Detection
    Son, Seok Bin
    Park, Seong Hee
    Lee, Youn Kyu
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2024, 18 (08): : 2230 - 2252