MITD-Net: Multi-scale iterative tamper detection network for image manipulation localization

被引:0
|
作者
Deng, Fan [1 ]
Yu, Haibo [1 ]
Liu, Tao [1 ]
Yang, Ruitao [1 ]
机构
[1] School of Computer Science and Technology, Xi'an University of Science and Technology, Xi'an,710054, China
基金
中国国家自然科学基金;
关键词
D O I
10.1016/j.dsp.2024.104901
中图分类号
学科分类号
摘要
Advancements in image tampering technology have escalated social risks and security challenges associated with tampered images. Accurately identifying tampered regions remains a significant challenge. To address the issue effectively, a multi-scale iterative tampering detection network is proposed, which decomposes the task into two phases, the Global-Local Feature Synchronization Phase and the Tampered Area Refinement Phase. Initially, dual-branch preprocessing and parallel feature extraction are employed. The Enhanced Downsampling Attention Block (EDAB) is introduced, and an Edge Enhancement Module (EEM) is implemented to extract edge features. Subsequently, Multi-Scale Dilated Convolution (MSDC) is utilized in the tampered area refinement phase, along with the proposed Pixel-level Feature Clustering Module (PFCM) and an iterative mechanism. Finally, incorporating a cross-scale fusion mechanism enables the synthesis of feature information from various scales, thereby enhancing the model's ability to detect subtle alterations in tampered regions. MITD-Net was validated on publicly available datasets, including CASIA, Columbia, COVERAGE, NIST 16, and IMD 20, achieving AUC scores of 84.5%, 98.5%, 85.8%, 86.6%, and 82.6%, respectively. Numerous experiments indicate that MITD-Net achieves higher detection accuracy, exhibits superior robustness, and can adapt to various tampering types and styles. © 2024 Elsevier Inc.
引用
收藏
相关论文
共 50 条
  • [1] Image manipulation detection and localization using multi-scale contrastive learning
    Bai, Ruyi
    [J]. APPLIED SOFT COMPUTING, 2024, 163
  • [2] MSA-Net: Multi-scale attention network for image splicing localization
    Caiping Yan
    Huajian Wei
    Zhi Lan
    Hong Li
    [J]. Multimedia Tools and Applications, 2024, 83 : 20587 - 20604
  • [3] MSA-Net: Multi-scale attention network for image splicing localization
    Yan, Caiping
    Wei, Huajian
    Lan, Zhi
    Li, Hong
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (07) : 20587 - 20604
  • [4] MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detection
    Dong, Chengbo
    Chen, Xinru
    Hu, Ruohan
    Cao, Juan
    Li, Xirong
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 3539 - 3553
  • [5] Image Manipulation Detection by Multi-View Multi-Scale Supervision
    Chen, Xinru
    Dong, Chengbo
    Ji, Jiaqi
    Cao, Juan
    Li, Xirong
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14165 - 14173
  • [6] Efficient Multi-Scale Feature Fusion for Image Manipulation Detection
    Zhang, Yuxue
    Feng, Guorui
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2022, E105D (05) : 1107 - 1111
  • [7] Image saliency detection via multi-scale iterative CNN
    Huang, Kun
    Gao, Shenghua
    [J]. VISUAL COMPUTER, 2020, 36 (07): : 1355 - 1367
  • [8] Image saliency detection via multi-scale iterative CNN
    Kun Huang
    Shenghua Gao
    [J]. The Visual Computer, 2020, 36 : 1355 - 1367
  • [9] Multi-scale noise-guided progressive network for image splicing detection and localization
    Zhang, Dengyong
    Jiang, Ningjing
    Li, Feng
    Chen, Jiaxin
    Liao, Xin
    Yang, Gaobo
    Ding, Xiangling
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 257
  • [10] Generic Image Manipulation Localization through the Lens of Multi-scale Spatial Inconsistence
    Gao, Zan
    Chen, Shenhao
    Guo, Yangyang
    Guan, Weili
    Nie, Jie
    Liu, Anan
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6146 - 6154