Multi-scale attention context-aware network for detection and localization of image splicing Efficient and robust identification network

被引:5
|
作者
Ren, Ruyong [1 ]
Niu, Shaozhang [1 ]
Jin, Junfeng [1 ]
Zhang, Jiwei [1 ]
Ren, Hua [1 ]
Zhao, Xiaojie [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing, Peoples R China
关键词
Image forensic systems; Information security; Splicing detection; Novel dataset;
D O I
10.1007/s10489-022-04421-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nowadays, advanced image editing tools and techniques produce more realistic tampered images, especially the addition of intelligent retouching technology makes the threshold of tampered operations lower and lower, which can easily evade image forensic systems and make it more difficult to verify the authenticity of images. The field of forensics has failed to achieve effective development due to the lack of high-quality splicing datasets. In this paper, we present the SMI20K-the first benchmark dataset for image splicing operations under intelligent tampered techniques, which contains a total of 20,000 splicing tampered images. By combining Seamless Cloning and image similarity search techniques, the tampered images have more hidden manipulation traces, making it difficult for the naked eye to distinguish the tampered targets. SMI20K brings a new challenge to the field of image forensics. Furthermore, we propose the novel Multi-scale Attention Context-aware Network (MAC-Net) to address the novel challenge of image tampered presently. Specifically, we propose a Multi-scale Multi-level Attention Module (MMAM) that not only effectively resolves feature inconsistencies at different scales, but also automatically adjusts the coefficients of the original input features to maintain detailed features. The fused features are then fed to the proposed Multi-Branch Global Context Module (MGCM), it has three different branches that not only enriches the contextual information but also maintains the detailed features of the target through automatic coefficient adjustment. Extensive experimental results on three public datasets and the proposed dataset show that the proposed model outperforms other state-of-the-art (SOTA) models in image forgery localization.
引用
收藏
页码:18219 / 18238
页数:20
相关论文
共 50 条
  • [1] Multi-scale attention context-aware network for detection and localization of image splicingEfficient and robust identification network
    Ruyong Ren
    Shaozhang Niu
    Junfeng Jin
    Jiwei Zhang
    Hua Ren
    Xiaojie Zhao
    [J]. Applied Intelligence, 2023, 53 : 18219 - 18238
  • [2] CONTEXT-AWARE HIERARCHICAL FEATURE ATTENTION NETWORK FOR MULTI-SCALE OBJECT DETECTION
    Xu, Xuelong
    Luo, Xiangfeng
    Ma, Liyan
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2011 - 2015
  • [3] Multi-scale Fusion with Context-aware Network for Object Detection
    Wang, Hanyuan
    Xu, Jie
    Li, Linke
    Tian, Ye
    Xu, Du
    Xu, Shizhong
    [J]. 2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 2486 - 2491
  • [4] MSA-Net: Multi-scale attention network for image splicing localization
    Caiping Yan
    Huajian Wei
    Zhi Lan
    Hong Li
    [J]. Multimedia Tools and Applications, 2024, 83 : 20587 - 20604
  • [5] MSA-Net: Multi-scale attention network for image splicing localization
    Yan, Caiping
    Wei, Huajian
    Lan, Zhi
    Li, Hong
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (07) : 20587 - 20604
  • [6] MSCANet: A multi-scale context-aware network for remote sensing object detection
    Zhou, Huaping
    Liu, Weidong
    Sun, Kelei
    Wu, Jin
    Wu, Tao
    [J]. EARTH SCIENCE INFORMATICS, 2024,
  • [7] Multi-Scale Context Attention Network for Image Retrieval
    Lou, Yihang
    Bai, Yan
    Wang, Shiqi
    Duan, Ling-Yu
    [J]. PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 1128 - 1136
  • [8] Context-aware attention network for image recognition
    Jiaxu Leng
    Ying Liu
    Shang Chen
    [J]. Neural Computing and Applications, 2019, 31 : 9295 - 9305
  • [9] Context-aware attention network for image recognition
    Leng, Jiaxu
    Liu, Ying
    Chen, Shang
    [J]. NEURAL COMPUTING & APPLICATIONS, 2019, 31 (12): : 9295 - 9305
  • [10] Global context-aware multi-scale features aggregative network for salient object detection
    Ullah, Inam
    Jian, Muwei
    Hussain, Sumaira
    Lian, Li
    Ali, Zafar
    Qureshi, Imran
    Guo, Jie
    Yin, Yilong
    [J]. NEUROCOMPUTING, 2021, 455 : 139 - 153