Deepfake Generation and Detection: Case Study and Challenges

被引:12
|
作者
Patel, Yogesh [1 ]
Tanwar, Sudeep [1 ]
Gupta, Rajesh [1 ]
Bhattacharya, Pronaya [2 ]
Davidson, Innocent Ewean [3 ,4 ]
Nyameko, Royi [3 ,4 ]
Aluvala, Srinivas [5 ]
Vimal, Vrince [6 ,7 ]
机构
[1] Nirma Univ, Inst Technol, Dept Comp Sci & Engn, Ahmadabad 382481, Gujarat, India
[2] Amity Univ, Amity Sch Engn & Technol, Dept Comp Sci & Engn, Kolkata 700135, India
[3] Cape Peninsula Univ Technol, African Space Innovat Ctr, Dept Elect Elect & Comp Engn, ZA-7535 Bellville, South Africa
[4] Cape Peninsula Univ Technol, French South African Inst Technol, Dept Elect Elect & Comp Engn, ZA-7535 Bellville, South Africa
[5] SR Univ, Dept Comp Sci & Artificial Intelligence, Warangal 506371, Telangana, India
[6] Graph Era Hill Univ, Dept Comp Sci & Engn, Dehra Dun 248002, India
[7] Graph Era, Dept Comp Sci & Engn, Dehra Dun 248002, Uttarakhand, India
关键词
Artificial intelligence; Deepfake generation; Deepfake detection; fake content; generative adversarial networks; NETWORKS; IMAGES;
D O I
10.1109/ACCESS.2023.3342107
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In smart communities, social media allowed users easy access to multimedia content. With recent advancements in computer vision and natural language processing, machine learning (ML), and deep learning (DL) models have evolved. With advancements in generative adversarial networks (GAN), it has become possible to create fake images/audio/and video streams of a person or use some person's audio and visual details to fit other environments. Thus, deepfakes are specifically used to disseminate fake information and propaganda on social circles that tarnish the reputation of an individual or an organization. Recently, many surveys have focused on generating and detecting deepfake images, audio, and video streams. Existing surveys are mostly aligned toward detecting deepfake contents, but the generation process is not suitably discussed. To address the survey gap, the paper proposes a comprehensive review of deepfake generation and detection and the different ML/DL approaches to synthesize deepfake contents. We discuss a comparative analysis of deepfake models and public datasets present for deepfake detection purposes. We discuss the implementation challenges and future research directions regarding optimized approaches and models. A unique case study, IBMM is discussed, which presents a multi-modal overview of deepfake detection. The proposed survey would benefit researchers, industry, and academia to study deepfake generation and subsequent detection schemes.
引用
收藏
页码:143296 / 143323
页数:28
相关论文
共 50 条
  • [1] Deepfake Attacks: Generation, Detection, Datasets, Challenges, and Research Directions
    Naitali, Amal
    Ridouani, Mohammed
    Salahdine, Fatima
    Kaabouch, Naima
    COMPUTERS, 2023, 12 (10)
  • [2] Deepfake generation and detection, a survey
    Tao Zhang
    Multimedia Tools and Applications, 2022, 81 : 6259 - 6276
  • [3] Deepfake generation and detection, a survey
    Zhang, Tao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (05) : 6259 - 6276
  • [4] Deepfake video detection: challenges and opportunities
    Kaur, Achhardeep
    Hoshyar, Azadeh Noori
    Saikrishna, Vidya
    Firmin, Selena
    Xia, Feng
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (06)
  • [5] Deepfake Generation and Detection: A Benchmark and Survey
    Pei, Gan
    Zhang, Jiangning
    Hu, Menghan
    Zhai, Guangtao
    Wang, Chengjie
    Zhang, Zhenyu
    Yang, Jian
    Shen, Chunhua
    Tao, Dacheng
    arXiv, 1600,
  • [6] DEEPFAKE DETECTION: CURRENT CHALLENGES AND NEXT STEPS
    Lyu, Siwei
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2020,
  • [7] A review on deepfake generation and detection: bibliometric analysis
    Kaushal A.
    Kumar S.
    Kumar R.
    Multimedia Tools and Applications, 2024, 83 (40) : 87579 - 87619
  • [8] A Contemporary Survey on Deepfake Detection: Datasets, Algorithms, and Challenges
    Gong, Liang Yu
    Li, Xue Jun
    ELECTRONICS, 2024, 13 (03)
  • [9] Advancements and Challenges in Deepfake Video Detection: A Comprehensive Review
    Gupta, Deepti
    Jain, Bhawna
    Sharma, Arun
    SMART TRENDS IN COMPUTING AND COMMUNICATIONS, VOL 1, SMARTCOM 2024, 2024, 945 : 353 - 369
  • [10] Unlocking the potential of deepfake generation and detection with a hybrid approach
    Chambial, Shourya
    Pandey, Tanisha
    Budhia, Rishabh
    Tripathy, Balakrushna
    Tripathy, Anurag
    INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2025, 28 (02)