Deepfakes Classification of Faces Using Convolutional Neural Networks

被引:3
|
作者
Sharma, Jatin [1 ]
Sharma, Sahil [1 ]
Kumar, Vijay [2 ]
Hussein, Hany S. [3 ,4 ]
Alshazly, Hammam [5 ]
机构
[1] Thapar Inst Engn & Technol, Comp Sci & Engn Dept, Patiala 147004, Punjab, India
[2] Natl Inst Technol, Comp Sci & Engn Dept, Hamirpur 177005, Himachal Prades, India
[3] King Khalid Univ, Dept Elect Engn, Coll Engn, Abha 62529, Saudi Arabia
[4] Aswan Univ, Dept Elect Engn, Fac Engn, Aswan 81528, Egypt
[5] South Valley Univ, Fac Comp & Informat, Qena 83523, Egypt
关键词
deep learning; transfer learning; fake faces; deepfakes; deep neural networks;
D O I
10.18280/ts.390330
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the recent years, petabytes of data is being generated and uploaded online every second. To successfully detect fake contents, a deepfake detection technique is used to determine whether the uploaded content is real or fake. In this paper, a convolutional neural network -based model is proposed to detect the fake face images. The generative adversarial networks and data augmentation are used to generate the face dataset for real and fake face classification. Transfer learning techniques from pretrained deep models such as VGG16 and ResNet50 are employed in the proposed model. The proposed model is evaluated on three benchmark datasets, namely 140k Real and Fake Faces, Real and Fake Face Detection, and Fake Faces. The proposed model attained accuracies over the three datasets are 95.85%, 53.25%, and 88.63%, respectively. Moreover, to improve the obtained results of the proposed model, we combine it with other pretrained models of VGG16 and ResNet50 to construct deep ensembles. The overall performance is greatly improved with the ensemble model achieving accuracies on the three datasets as 98.79%, 75.79%, and 95.52%, respectively. Furthermore, the obtained results also show that the proposed models have superior performance than existing models.
引用
收藏
页码:1027 / 1037
页数:11
相关论文
共 50 条
  • [1] Sound Classification Using Convolutional Neural Networks
    Jaiswal, Kaustumbh
    Patel, Dhairya Kalpeshbhai
    [J]. 2018 SEVENTH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING IN EMERGING MARKETS (CCEM), 2018, : 81 - 84
  • [2] Plant Classification using Convolutional Neural Networks
    Yalcin, Hulya
    Razavi, Salar
    [J]. 2016 FIFTH INTERNATIONAL CONFERENCE ON AGRO-GEOINFORMATICS (AGRO-GEOINFORMATICS), 2016, : 233 - 237
  • [3] Query Classification Using Convolutional Neural Networks
    Zhang, Hanxiao
    Song, Wei
    Liu, Lizhen
    Du, Chao
    Zhao, Xinlei
    [J]. 2017 10TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 2, 2017, : 441 - 444
  • [4] Clothing Classification Using Convolutional Neural Networks
    Hodecker, Andrei
    Fernandes, Anita M. R.
    Steffens, Alisson
    Crocker, Paul
    Leithardt, Valderi R. Q.
    [J]. 2020 15TH IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (CISTI'2020), 2020,
  • [5] Strabismus Classification using Convolutional Neural Networks
    Kim, Donghwan
    Joo, Jaehan
    Zhu, Guohua
    Seo, Jeongbin
    Ha, Jaeseung
    Kim, Suk Chan
    [J]. 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION (IEEE ICAIIC 2021), 2021, : 216 - 218
  • [6] Classification of Fruits using Convolutional Neural Networks
    Raut, Roshani
    Jadhav, Anuja
    Sorte, Chaitrali
    Chaudhari, Anagha
    [J]. 2022 SECOND INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRICAL, COMPUTING, COMMUNICATION AND SUSTAINABLE TECHNOLOGIES (ICAECT), 2022,
  • [7] Texture classification using convolutional neural networks
    Tivive, Fok Hing Chi
    Bouzerdoum, Abdesselam
    [J]. TENCON 2006 - 2006 IEEE REGION 10 CONFERENCE, VOLS 1-4, 2006, : 660 - +
  • [8] Emphysema Classification Using Convolutional Neural Networks
    Pei, Xiaomin
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2015, PT I, 2015, 9244 : 455 - 461
  • [9] Weather Classification using Convolutional Neural Networks
    An, Jehong
    Chen, Yunfan
    Shin, Hyunchul
    [J]. 2018 INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2018, : 245 - 246
  • [10] Sentiment Classification Using Convolutional Neural Networks
    Kim, Hannah
    Jeong, Young-Seob
    [J]. APPLIED SCIENCES-BASEL, 2019, 9 (11):