Deepfake Generation and Detection: Case Study and Challenges

被引:12
|
作者
Patel, Yogesh [1 ]
Tanwar, Sudeep [1 ]
Gupta, Rajesh [1 ]
Bhattacharya, Pronaya [2 ]
Davidson, Innocent Ewean [3 ,4 ]
Nyameko, Royi [3 ,4 ]
Aluvala, Srinivas [5 ]
Vimal, Vrince [6 ,7 ]
机构
[1] Nirma Univ, Inst Technol, Dept Comp Sci & Engn, Ahmadabad 382481, Gujarat, India
[2] Amity Univ, Amity Sch Engn & Technol, Dept Comp Sci & Engn, Kolkata 700135, India
[3] Cape Peninsula Univ Technol, African Space Innovat Ctr, Dept Elect Elect & Comp Engn, ZA-7535 Bellville, South Africa
[4] Cape Peninsula Univ Technol, French South African Inst Technol, Dept Elect Elect & Comp Engn, ZA-7535 Bellville, South Africa
[5] SR Univ, Dept Comp Sci & Artificial Intelligence, Warangal 506371, Telangana, India
[6] Graph Era Hill Univ, Dept Comp Sci & Engn, Dehra Dun 248002, India
[7] Graph Era, Dept Comp Sci & Engn, Dehra Dun 248002, Uttarakhand, India
关键词
Artificial intelligence; Deepfake generation; Deepfake detection; fake content; generative adversarial networks; NETWORKS; IMAGES;
D O I
10.1109/ACCESS.2023.3342107
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In smart communities, social media allowed users easy access to multimedia content. With recent advancements in computer vision and natural language processing, machine learning (ML), and deep learning (DL) models have evolved. With advancements in generative adversarial networks (GAN), it has become possible to create fake images/audio/and video streams of a person or use some person's audio and visual details to fit other environments. Thus, deepfakes are specifically used to disseminate fake information and propaganda on social circles that tarnish the reputation of an individual or an organization. Recently, many surveys have focused on generating and detecting deepfake images, audio, and video streams. Existing surveys are mostly aligned toward detecting deepfake contents, but the generation process is not suitably discussed. To address the survey gap, the paper proposes a comprehensive review of deepfake generation and detection and the different ML/DL approaches to synthesize deepfake contents. We discuss a comparative analysis of deepfake models and public datasets present for deepfake detection purposes. We discuss the implementation challenges and future research directions regarding optimized approaches and models. A unique case study, IBMM is discussed, which presents a multi-modal overview of deepfake detection. The proposed survey would benefit researchers, industry, and academia to study deepfake generation and subsequent detection schemes.
引用
收藏
页码:143296 / 143323
页数:28
相关论文
共 50 条
  • [21] A Measurement Study on Gray Channel-based Deepfake Detection
    Son, Seok Bin
    Park, Seong Hee
    Lee, Youn Kyu
    12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, : 428 - 430
  • [22] Understanding the Security of Deepfake Detection
    Cao, Xiaoyu
    Gong, Neil Zhenqiang
    DIGITAL FORENSICS AND CYBER CRIME, ICDF2C 2021, 2022, 441 : 360 - 378
  • [23] Coherent adversarial deepfake video generation
    Liu H.
    Zhou W.
    Chen D.
    Fang H.
    Bian H.
    Liu K.
    Zhang W.
    Yu N.
    Signal Processing, 2023, 203
  • [24] Image Prefiltering in DeepFake Detection
    Motloch, Szymon
    Szczygielski, Mateusz
    Sarwas, Grzegorz
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 4, 2022, : 476 - 483
  • [25] Multimodal Approach for DeepFake Detection
    Lomnitz, Michael
    Hampel-Arias, Zigfried
    Sandesara, Vishal
    Hu, Simon
    2020 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR): TRUSTED COMPUTING, PRIVACY, AND SECURING MULTIMEDIA, 2020,
  • [26] Towards Generalization in Deepfake Detection
    Verdoliva, Luisa
    PROCEEDINGS OF THE 2022 ACM WORKSHOP ON INFORMATION HIDING AND MULTIMEDIA SECURITY, IH-MMSEC 2022, 2022, : 1 - 1
  • [27] A Survey on Deepfake Video Detection
    Yu, Peipeng
    Xia, Zhihua
    Fei, Jianwei
    Lu, Yujiang
    IET BIOMETRICS, 2021, 10 (06) : 607 - 624
  • [28] Deepfake Speech Recognition and Detection
    Chang, Hung-Chang
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (09)
  • [29] Robust Sequential DeepFake Detection
    Shao, Rui
    Wu, Tianxing
    Liu, Ziwei
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025,
  • [30] Deepfake noise investigation and detection
    Wang, Tianyi
    Liu, Ming
    Cao, Wei
    Chow, Kam Pui
    FORENSIC SCIENCE INTERNATIONAL-DIGITAL INVESTIGATION, 2022, 42