MSA-Net: Multi-scale attention network for image splicing localization

被引:0
|
作者
Yan, Caiping [1 ]
Wei, Huajian [1 ]
Lan, Zhi [1 ]
Li, Hong [2 ]
机构
[1] Hangzhou Normal Univ, Dept Comp Sci, Hangzhou 311121, Peoples R China
[2] Hangzhou InsVis Technol Co Ltd, Hangzhou 311121, Peoples R China
基金
中国国家自然科学基金;
关键词
Image forensics; Spatial-channel relationships; Multi-scale; Self-attention; Image splicing localization; FORGERY;
D O I
10.1007/s11042-023-16131-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we introduce the novel Multi-Scale Attention Network (MSA-Net) to address the challenge of locating diverse types and sizes of splicing forgery objects. Previous methods neglect crucial characteristics of global dependencies and size, resulting in imprecise localization on background tampering and small target tampering. To overcome this, we integrate a multi-scale self-attention mechanism to capture global dependencies and fully understand the relationships between spliced objects and untampered areas. Our approach involves inserting multi-scale attention modules that combine the position attention and channel attention modules between convolution layers for feature extraction. The position attention module emphasizes spatial interdependencies, capturing relationships between feature positions. Similarly, the channel attention module captures relationships between channel features. This allows for the preservation of intrinsic details while capturing long-range semantic dependencies, which is beneficial to the detection of splicing forgery objects. Meanwhile, by dividing the feature maps into multiple sub-regions or sub-channels, our attention modules can better preserve the details while capturing long-range semantic information dependencies. Experimental results show that the proposed MSA-Net outperforms several state-of-the-art algorithms with an F1-score of 60.5% and an IOU value of 58.8% on the CASIA dataset.
引用
收藏
页码:20587 / 20604
页数:18
相关论文
共 50 条
  • [31] Multi-scale attention context-aware network for detection and localization of image splicingEfficient and robust identification network
    Ruyong Ren
    Shaozhang Niu
    Junfeng Jin
    Jiwei Zhang
    Hua Ren
    Xiaojie Zhao
    [J]. Applied Intelligence, 2023, 53 : 18219 - 18238
  • [32] Msap: multi-scale attention probabilistic network for underwater image enhancement network
    Chang, Baocai
    Li, Jinjiang
    Wang, Haiyang
    Li, Mengjun
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (SUPPL 1) : 653 - 661
  • [33] Multi-scale Multi-attention Network for Moire Document Image Binarization
    Guo, Yanqing
    Ji, Caijuan
    Zheng, Xin
    Wang, Qianyu
    Luo, Xiangyang
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 90
  • [34] MA-Net: A Multi-Scale Attention Network for Liver and Tumor Segmentation
    Fan, Tongle
    Wang, Guanglei
    Li, Yan
    Wang, Hongrui
    [J]. IEEE ACCESS, 2020, 8 : 179656 - 179665
  • [35] MAMA Net: Multi-Scale Attention Memory Autoencoder Network for Anomaly Detection
    Chen, Yurong
    Zhang, Hui
    Wang, Yaonan
    Yang, Yimin
    Zhou, Xianen
    Wu, Q. M. Jonathan
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (03) : 1032 - 1041
  • [36] MS3A-Net: multi-scale and spectral-spatial attention network for hyperspectral image classification
    Dai, Mengyun
    Sun, Qi
    Dai, Luanyan
    Lin, Yaohai
    Wei, Lifang
    Yang, Changcai
    Chen, Riqing
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (19-24) : 7139 - 7160
  • [37] DMAF-NET: Deep Multi-Scale Attention Fusion Network for Hyperspectral Image Classification with Limited Samples
    Guo, Hufeng
    Liu, Wenyi
    [J]. SENSORS, 2024, 24 (10)
  • [38] MRAU-net: Multi-scale residual attention U-shaped network for medical image segmentation
    Shu, Xin
    Li, Xiaotong
    Zhang, Xin
    Shao, Changbin
    Yan, Xi
    Huang, Shucheng
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2024, 118
  • [39] Multi-Scale Attention Feature Enhancement Network for Single Image Dehazing
    Dong, Weida
    Wang, Chunyan
    Sun, Hao
    Teng, Yunjie
    Xu, Xiping
    [J]. SENSORS, 2023, 23 (19)
  • [40] HYPERSPECTRAL IMAGE CLASSIFICATION VIA MULTI-SCALE RESIDUAL ATTENTION NETWORK
    Xie, Wen
    Wu, Qinzhe
    Ren, Wen
    Zhang, Yuzhuo
    [J]. IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 7649 - 7652