Multi-scale attention context-aware network for detection and localization of image splicing Efficient and robust identification network

被引:5
|
作者
Ren, Ruyong [1 ]
Niu, Shaozhang [1 ]
Jin, Junfeng [1 ]
Zhang, Jiwei [1 ]
Ren, Hua [1 ]
Zhao, Xiaojie [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing, Peoples R China
关键词
Image forensic systems; Information security; Splicing detection; Novel dataset;
D O I
10.1007/s10489-022-04421-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nowadays, advanced image editing tools and techniques produce more realistic tampered images, especially the addition of intelligent retouching technology makes the threshold of tampered operations lower and lower, which can easily evade image forensic systems and make it more difficult to verify the authenticity of images. The field of forensics has failed to achieve effective development due to the lack of high-quality splicing datasets. In this paper, we present the SMI20K-the first benchmark dataset for image splicing operations under intelligent tampered techniques, which contains a total of 20,000 splicing tampered images. By combining Seamless Cloning and image similarity search techniques, the tampered images have more hidden manipulation traces, making it difficult for the naked eye to distinguish the tampered targets. SMI20K brings a new challenge to the field of image forensics. Furthermore, we propose the novel Multi-scale Attention Context-aware Network (MAC-Net) to address the novel challenge of image tampered presently. Specifically, we propose a Multi-scale Multi-level Attention Module (MMAM) that not only effectively resolves feature inconsistencies at different scales, but also automatically adjusts the coefficients of the original input features to maintain detailed features. The fused features are then fed to the proposed Multi-Branch Global Context Module (MGCM), it has three different branches that not only enriches the contextual information but also maintains the detailed features of the target through automatic coefficient adjustment. Extensive experimental results on three public datasets and the proposed dataset show that the proposed model outperforms other state-of-the-art (SOTA) models in image forgery localization.
引用
收藏
页码:18219 / 18238
页数:20
相关论文
共 50 条
  • [41] Multi-Scale Feature Attention Fusion for Image Splicing Forgery Detection
    Liang, Enji
    Zhang, Kuiyuan
    Hua, Zhongyun
    Jia, Xiaohua
    [J]. ACM Transactions on Multimedia Computing, Communications and Applications, 2024, 21 (01)
  • [42] EMCENET: EFFICIENT MULTI-SCALE CONTEXT EXPLORATION NETWORK FOR SALIENT OBJECT DETECTION
    Sun, Yanguang
    Xia, Chenxing
    Gao, Xiuju
    Ge, Bin
    Zhang, Hanling
    Li, Kuan-Ching
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1066 - 1070
  • [43] Multi-scale attention in attention neural network for single image deblurring
    Lee, Ho Sub
    Cho, Sung In
    [J]. Displays, 2024, 85
  • [44] Low-light image dehazing network with aggregated context-aware attention
    Wang K.
    Cheng J.
    Huang S.
    Cai K.
    Wang W.
    Li Y.
    [J]. Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2023, 50 (02): : 23 - 32
  • [45] Context-aware and co-attention network based image captioning model
    Sharma, Himanshu
    Srivastava, Swati
    [J]. IMAGING SCIENCE JOURNAL, 2023, 71 (03): : 244 - 256
  • [46] Msap: multi-scale attention probabilistic network for underwater image enhancement network
    Chang, Baocai
    Li, Jinjiang
    Wang, Haiyang
    Li, Mengjun
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (SUPPL 1) : 653 - 661
  • [47] Multi-scale Context Enhancement Network for Object Detection
    Wang, Yanan
    Ma, Yingdong
    [J]. 2022 2ND IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND ARTIFICIAL INTELLIGENCE (SEAI 2022), 2022, : 6 - 11
  • [48] ParaLkResNet: an efficient multi-scale image classification network
    Yu, Tongshuai
    Liu, Ye
    Liu, Hao
    Chen, Ji
    Wang, Xing
    [J]. VISUAL COMPUTER, 2024, 40 (07): : 5057 - 5066
  • [49] A Context-aware Attention Network for Interactive Question Answering
    Li, Huayu
    Min, Martin Renqiang
    Ge, Yong
    Kadav, Asim
    [J]. KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, : 927 - 935
  • [50] Context-aware pyramid attention network for crowd counting
    Lingyu Gu
    Chen Pang
    Yanjun Zheng
    Chen Lyu
    Lei Lyu
    [J]. Applied Intelligence, 2022, 52 : 6164 - 6180