D-Net: A dual-encoder network for image splicing forgery detection and localization

被引:0
|
作者
Yang, Zonglin [1 ]
Liu, Bo [1 ]
Bi, Xiuli [1 ]
Xiao, Bin [1 ]
Li, Weisheng [1 ]
Wang, Guoyin [1 ]
Gao, Xinbo [1 ]
机构
[1] Chongqing Univ Posts & Telecommun, Sch Comp Sci & Technol, 2 Chongwen Rd, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Image splicing forgery detection; Tampered region localization; Convolutional neural network; Image fingerprints; Global perspective; Dual-encoder; FRAMEWORK;
D O I
10.1016/j.patcog.2024.110727
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many detection methods based on convolutional neural networks (CNNs) have been proposed for image splicing forgery detection. Most of these methods focus on validating local patches or local objects. We regard image splicing forgery detection as a binary classification task that distinguishes tampered and non-tampered regions by forensic fingerprints rather than semantic features. As the network goes deep, its representation ability becomes strong. However, the non-semantic forensic fingerprints can hardly be retained by normal CNNs in deep layers. We proposed a novel dual-encoder network (D-Net) for image splicing forgery detection to resolve these issues, employing an unfixed and a fixed encoder. The unfixed encoder autonomously learns the image fingerprints that differentiate between the tampered and non-tampered regions, whereas the fixed encoder intentionally provides structural information that assists the learning and detection of the forgeries. This dual-encoder is followed by a spatial pyramid global-feature extraction module that expands the global insight of D-Net for classifying the tampered and non-tampered regions more accurately. In an experimental comparison study of D-Net and state-of-the-art methods, D-Net, without pre-training or training on a large number of forgery images, outperformed the other methods in pixel-level forgery detection. Moreover, it is stably robust to different anti-forensic attacks.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Dual encoder network with efficient channel attention refinement module for image splicing forgery detection
    Tan, Xiangqiong
    Zhang, Hongyi
    Wang, Zuoshuai
    Tang, Jun
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (05)
  • [2] Y-Net: A Spatiospectral Dual-Encoder Network for Medical Image Segmentation
    Farshad, Azade
    Yeganeh, Yousef
    Gehlbach, Peter
    Navab, Nassir
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT II, 2022, 13432 : 582 - 592
  • [3] Multiscale Attention Network for Detection and Localization of Image Splicing Forgery
    Xu, Yanzhi
    Irfan, Muhammad
    Fang, Aiqing
    Zheng, Jiangbin
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [4] DCU-Net: a dual-channel U-shaped network for image splicing forgery detection
    Ding, Hongwei
    Chen, Leiyang
    Tao, Qi
    Fu, Zhongwang
    Dong, Liang
    Cui, Xiaohui
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (07): : 5015 - 5031
  • [5] DCU-Net: a dual-channel U-shaped network for image splicing forgery detection
    Hongwei Ding
    Leiyang Chen
    Qi Tao
    Zhongwang Fu
    Liang Dong
    Xiaohui Cui
    [J]. Neural Computing and Applications, 2023, 35 : 5015 - 5031
  • [6] DETisSeg: A dual-encoder network for tissue semantic segmentation of histopathology image
    He, Penghui
    Qu, Aiping
    Xiao, Shuomin
    Ding, Meidan
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 87
  • [7] DEF-Net: A Dual-Encoder Fusion Network for Fundus Retinal Vessel Segmentation
    Li, Jianyong
    Gao, Ge
    Yang, Lei
    Liu, Yanhong
    Yu, Hongnian
    [J]. ELECTRONICS, 2022, 11 (22)
  • [8] DSSE-net: dual stream skip edge-enhanced network with forgery loss for image forgery localization
    Zheng, Aokun
    Huang, Tianqiang
    Huang, Wei
    Huang, Liqing
    Ye, Feng
    Luo, Haifeng
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (06) : 2323 - 2335
  • [9] STRD-Net: A Dual-Encoder Semantic Segmentation Network for Urban Green Space Extraction
    Yu, Mouzhe
    He, Liheng
    Shen, Zhehui
    Lv, Meng
    [J]. IEEE Transactions on Geoscience and Remote Sensing, 2024, 62
  • [10] Reality Transform Adversarial Generators for Image Splicing Forgery Detection and Localization
    Bi, Xiuli
    Zhang, Zhipeng
    Xiao, Bin
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14274 - 14283