Dual-Stream Fusion and Multi-scale Analysis: Introducing the Synergistic Dual-Stream Network (SDS-Net) for Image Manipulation Segmentation

被引:0
|
作者
Song, Huaqing [1 ]
Lin, Baichuan [1 ]
Xie, Lanchi [1 ]
机构
[1] Minist Publ Secur, Inst Forens Sci, Beijing, Peoples R China
关键词
image forensics; multiscale spatial pyramid; stream fusion; tampering localization; FORGERIES;
D O I
10.1002/aisy.202300749
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article introduces the synergistic dual-stream network (SDS-Net), a novel neural network architecture that significantly enhances the detection of image manipulations. SDS-Net employs a unique dual-stream fusion strategy that processes both RGB image and the corresponding noise map. It innovatively combines features computation from the different blocks of dual backbones, and leverages a multi-scale spatial pyramid pooling (MSPP) module to expand the receptive fields of shallow features. This approach not only enriches the feature representation, but also ensures the precise localization of manipulated regions. Extensive experiments conducted on various public datasets demonstrate the superiority of SDS-Net over several state-of-the-art methods. Introducing synergistic dual-stream network (SDS-Net), a groundbreaking deep learning framework for image manipulation detection. This innovative system employs a dual-stream fusion strategy, enhancing feature extraction capabilities and ensures precise localization of tampered regions. SDS-Net's unique approach significantly outperforms existing methods, offering robust and accurate detection across different datasets.image (c) 2024 WILEY-VCH GmbH
引用
收藏
页数:11
相关论文
共 50 条
  • [1] DIRECT MULTI-SCALE DUAL-STREAM NETWORK FOR PEDESTRIAN DETECTION
    Jung, Sang-Il
    Hong, Ki-Sang
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 156 - 160
  • [2] CDS-Net: Cooperative dual-stream network for image manipulation detection
    Wang, Haoran
    Deng, Jiahao
    Lin, Xun
    Tang, Wenzhong
    Wang, Shuai
    [J]. PATTERN RECOGNITION LETTERS, 2023, 176 : 167 - 173
  • [3] CDS-Net: Cooperative dual-stream network for image manipulation detection
    Wang, Haoran
    Deng, Jiahao
    Lin, Xun
    Tang, Wenzhong
    Wang, Shuai
    [J]. PATTERN RECOGNITION LETTERS, 2023, 176 : 167 - 173
  • [4] Dual-Stream Intermediate Fusion Network for Image Forgery Localization
    Yan, Caiping
    Liu, Renhai
    Li, Hong
    Wu, Jinghui
    Pan, Haojie
    [J]. IEEE ACCESS, 2024, 12 : 90511 - 90524
  • [5] Dual-stream Representation Fusion Learning for accurate medical image segmentation
    Xu, Rongtao
    Wang, Changwei
    Xu, Shibiao
    Meng, Weiliang
    Zhang, Xiaopeng
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [6] DeepFake detection method based on multi-scale interactive dual-stream network
    Cheng, Ziyuan
    Wang, Yiyang
    Wan, Yongjing
    Jiang, Cuiling
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 104
  • [7] Multi-Scale Enhanced Dual-Stream Network for Facial Attribute Editing Localization
    Huang, Jinkun
    Luo, Weiqi
    Huang, Wenmin
    Xi, Ziyi
    Wei, Kangkang
    Huang, Jiwu
    [J]. DIGITAL FORENSICS AND WATERMARKING, IWDW 2023, 2024, 14511 : 151 - 165
  • [8] Dual-stream GNN fusion network for hyperspectral classification
    Weiming Li
    Qikang Liu
    Shuaishuai Fan
    Cong’an Xu
    Hongyang Bai
    [J]. Applied Intelligence, 2023, 53 : 26542 - 26567
  • [9] Dual-stream reinforcement network for few-shot image segmentation
    Tang, Mingwei
    Zhu, Lin
    Xu, Yangsheng
    Zhao, Mingfeng
    [J]. DIGITAL SIGNAL PROCESSING, 2023, 134
  • [10] HDNet: A dual-stream network with progressive fusion for image hazing detection
    Chen, Jiyou
    Yang, Gaobo
    Xia, Ming
    Guo, Zhiqing
    Huang, Tianqiang
    [J]. JOURNAL OF INFORMATION SECURITY AND APPLICATIONS, 2022, 69