MSA-Net: Multi-scale attention network for image splicing localization

被引:0
|
作者
Yan, Caiping [1 ]
Wei, Huajian [1 ]
Lan, Zhi [1 ]
Li, Hong [2 ]
机构
[1] Hangzhou Normal Univ, Dept Comp Sci, Hangzhou 311121, Peoples R China
[2] Hangzhou InsVis Technol Co Ltd, Hangzhou 311121, Peoples R China
基金
中国国家自然科学基金;
关键词
Image forensics; Spatial-channel relationships; Multi-scale; Self-attention; Image splicing localization; FORGERY;
D O I
10.1007/s11042-023-16131-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we introduce the novel Multi-Scale Attention Network (MSA-Net) to address the challenge of locating diverse types and sizes of splicing forgery objects. Previous methods neglect crucial characteristics of global dependencies and size, resulting in imprecise localization on background tampering and small target tampering. To overcome this, we integrate a multi-scale self-attention mechanism to capture global dependencies and fully understand the relationships between spliced objects and untampered areas. Our approach involves inserting multi-scale attention modules that combine the position attention and channel attention modules between convolution layers for feature extraction. The position attention module emphasizes spatial interdependencies, capturing relationships between feature positions. Similarly, the channel attention module captures relationships between channel features. This allows for the preservation of intrinsic details while capturing long-range semantic dependencies, which is beneficial to the detection of splicing forgery objects. Meanwhile, by dividing the feature maps into multiple sub-regions or sub-channels, our attention modules can better preserve the details while capturing long-range semantic information dependencies. Experimental results show that the proposed MSA-Net outperforms several state-of-the-art algorithms with an F1-score of 60.5% and an IOU value of 58.8% on the CASIA dataset.
引用
收藏
页码:20587 / 20604
页数:18
相关论文
共 50 条
  • [41] MGTANet: Multi-Scale Guided Token Attention Network for Image Captioning
    Jia, Wenhao
    Wang, Ronggui
    Yang, Juan
    Xua, Lixia
    [J]. PROCEEDINGS OF 2024 3RD INTERNATIONAL CONFERENCE ON CYBER SECURITY, ARTIFICIAL INTELLIGENCE AND DIGITAL ECONOMY, CSAIDE 2024, 2024, : 237 - 245
  • [42] MSDANet: A multi-scale dilation attention network for medical image segmentation
    Zhang, Jinquan
    Luan, Zhuang
    Ni, Lina
    Qi, Liang
    Gong, Xu
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 90
  • [43] MSAANet: Multi-scale Axial Attention Network for medical image segmentation
    Zeng, Hao
    Shan, Xinxin
    Feng, Yu
    Wen, Ying
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2291 - 2296
  • [44] GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazing
    Liu, Xiaohong
    Ma, Yongrui
    Shi, Zhihao
    Chen, Jun
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7313 - 7322
  • [45] Multi-Scale Feature Fusion Network with Attention for Single Image Dehazing
    Hu, Bin
    [J]. PATTERN RECOGNITION AND IMAGE ANALYSIS, 2021, 31 (04) : 608 - 615
  • [46] Lightweight multi-scale generative adversarial network with attention for image denoising
    Hu, Xuegang
    Zhao, Wei
    [J]. MULTIMEDIA SYSTEMS, 2024, 30 (05)
  • [47] Multi-scale Underwater Image Enhancement Network Based on Attention Mechanism
    Fang Ming
    Liu Xiaohan
    Fu Feiran
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2021, 43 (12) : 3513 - 3521
  • [48] Attention based multi-scale nested network for biomedical image segmentation
    Cheng, Dapeng
    Deng, Jia
    Xiao, Jinjie
    Yanyan, Mao
    Kang, Jialong
    Gai, Jiale
    Zhang, Baosheng
    Zhao, Feng
    [J]. HELIYON, 2024, 10 (14)
  • [49] Multi-Scale Feature Fusion Network with Attention for Single Image Dehazing
    [J]. Pattern Recognition and Image Analysis, 2021, 31 : 608 - 615
  • [50] Multi-Scale Mixed Attention Network for CT and MRI Image Fusion
    Liu, Yang
    Yan, Binyu
    Zhang, Rongzhu
    Liu, Kai
    Jeon, Gwanggil
    Yang, Xiaoming
    [J]. ENTROPY, 2022, 24 (06)