Generalizing Face Forgery Detection by Suppressed Texture Network With Two-Branch Convolution

被引:1
|
作者
Zhang, Dengyong [1 ,2 ]
Li, Daijie [1 ,2 ]
Sangaiah, Arun Kumar [3 ,4 ,5 ]
Li, Feng [1 ,2 ]
Deng, Zelin [1 ,2 ]
Wu, Chengcheng [1 ,2 ]
机构
[1] Changsha Univ Sci & Technol, Hunan Prov Key Lab Intelligent Proc Big Data Trans, Changsha 410114, Peoples R China
[2] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410114, Peoples R China
[3] Natl Yunlin Univ Sci & Technol, Int Grad Sch Artificial Intelligence, Touliu 64002, Taiwan
[4] Sunway Univ, Sch Engn & Technol, Petaling Jaya 47500, Selangor, Malaysia
[5] Chandigarh Univ, Chandigarh 140413, Punjab, India
基金
中国国家自然科学基金;
关键词
Forgery; Faces; Kernel; Convolution; Image texture; Feature extraction; Streaming media; Cyber-bullying detection; deep learning; deepfake (DF) detection; face manipulation; generalization ability;
D O I
10.1109/TCSS.2024.3441251
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of Internet technology, deepfake (DF) videos can spread rapidly through online platforms, providing a new way of cyberbullying by generating nude pictures of female victims and using their faces to generate pornographic movies, which bring potential harm to individuals, society, and the country. Recently, there have been some really impressive results with DF detection models. These models have shown excellent outstanding performance when they are trained and tested using data from the same dataset. However, detecting DF remains difficult when the data comes from challenging datasets. To address this issue, this article aims to enhance the model's generalization by taking full advantage of the learning and representation capabilities of convolutional neural networks (CNNs) to adaptively suppress image texture information and catch deeper and more universal forgery features. Specifically, we introduce the texture suppression module (TSM) as a first step to suppress image content while simultaneously revealing the differences between authentic and tampered regions. Then, we carefully designed the cross stream interaction module (CSIM) and the cross stream mix block (CSMB) module to fully exploit the extracted forgery traces. Our proposed model has demonstrated superior generalization performance in extensive experiments.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] A Two-Branch Convolution Residual Network for Image Compressive Sensing
    Gan, Chenquan
    Yan, Xiaoqin
    Wu, Yunfeng
    Zhang, Zufan
    IEEE ACCESS, 2020, 8 (08): : 1705 - 1714
  • [2] TBFormer: Two-Branch Transformer for Image Forgery Localization
    Liu, Yaqi
    Lv, Binbin
    Jin, Xin
    Chen, Xiaoyu
    Zhang, Xiaokun
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 623 - 627
  • [3] Two-branch 3D convolution neural network for gait recognition
    Hui Huang
    Yuanyu Zhang
    Yuhang Si
    Jin Wang
    Dongzhi He
    Signal, Image and Video Processing, 2023, 17 : 3495 - 3504
  • [4] Cattle face recognition based on a Two-Branch convolutional neural network
    Weng, Zhi
    Meng, Fansheng
    Liu, Shaoqing
    Zhang, Yong
    Zheng, Zhiqiang
    Gong, Caili
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2022, 196
  • [5] Two-branch 3D convolution neural network for gait recognition
    Huang, Hui
    Zhang, Yuanyu
    Si, Yuhang
    Wang, Jin
    He, Dongzhi
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (07) : 3495 - 3504
  • [6] Generalizing Face Forgery Detection via Uncertainty Learning
    Wu, Yanqi
    Song, Xue
    Chen, Jingjing
    Jiang, Yu-Gang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1759 - 1767
  • [7] TAENet: Two-branch Autoencoder Network for Interpretable Deepfake Detection
    Du, Fuqiang
    Yu, Min
    Li, Boquan
    Chow, Kam Pui
    Jiang, Jianguo
    Zhang, Yixin
    Liang, Yachao
    Li, Min
    Huang, Weiqing
    FORENSIC SCIENCE INTERNATIONAL-DIGITAL INVESTIGATION, 2024, 50
  • [8] Two-Branch Network with Selective Kernel Convolution for Time-Domain Speech Enhancement
    Li, Hui
    Huang, Zhihua
    Guo, Chuangjian
    2022 13TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2022, : 478 - 482
  • [9] TAN-GFD: generalizing face forgery detection based on texture information and adaptive noise mining
    Zhao, Yi
    Jin, Xin
    Gao, Song
    Wu, Liwen
    Yao, Shaowen
    Jiang, Qian
    APPLIED INTELLIGENCE, 2023, 53 (16) : 19007 - 19027
  • [10] TAN-GFD: generalizing face forgery detection based on texture information and adaptive noise mining
    Yi Zhao
    Xin Jin
    Song Gao
    Liwen Wu
    Shaowen Yao
    Qian Jiang
    Applied Intelligence, 2023, 53 : 19007 - 19027