Detecting Artificial Intelligence-Generated images via deep trace representations and interactive feature fusion

被引:0
|
作者
Xu, Qiang [1 ]
Jiang, Xinghao [1 ]
Sun, Tanfeng [1 ]
Wang, Hao [2 ]
Meng, Laijin [1 ]
Yan, Hong [3 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Coll Comp Sci & Technol, Chongqing 400065, Peoples R China
[3] City Univ Hong Kong, Ctr Intelligent Multidimens Data Anal, Dept Elect Engn, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Artificial Intelligence-Generated (AIG); Natural photographs; Global feature; Multi-scale feature; Feature fusion; NATURAL IMAGES; GRAPHICS; FORENSICS;
D O I
10.1016/j.inffus.2024.102578
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The detection of Artificial Intelligence-Generated (AIG) images plays an important role in verifying the authenticity and originality of digital images. However, recent advancements in state-of-the-art image generation methods have significantly challenged the ability to differentiate AIG images from natural photographs (NP). To address this issue, a novel approach based on deep trace representations and dual-branch interactive feature fusion is presented. Firstly, a global feature extraction module that leverages attention-based MobileViT (AT-MobileViT) is designed to learn the deep representations of the global trace information. Besides, we apply multiple enhanced residual blocks to extract discriminative multi-scale features. After that, a low-level feature extraction module incorporating a channel-spatial attention (CSA) block is also carefully employed to enhance the learning of trace representations. To facilitate the capture of complementary information between features, a dual-branch interactive feature fusion module is introduced by reshaping feature vectors into interactive matrices. By conducting experiments on both seen and unseen images, results demonstrate the better performance and robustness of the proposed method.
引用
收藏
页数:12
相关论文
共 19 条
  • [1] Human Versus Machine: A Comparative Analysis in Detecting Artificial Intelligence-Generated Images
    Maiano, Luca
    Benova, Alexandra
    Papa, Lorenzo
    Stockner, Mara
    Marchetti, Michela
    Convertino, Gianmarco
    Mazzoni, Giuliana
    Amerini, Irene
    [J]. IEEE SECURITY & PRIVACY, 2024, 22 (03) : 77 - 86
  • [2] Artificial Intelligence-Generated Facial Images for Medical Education
    Fan, Bingwen Eugene
    Chow, Minyang
    Winkler, Stefan
    [J]. MEDICAL SCIENCE EDUCATOR, 2024, 34 (01) : 5 - 7
  • [3] Artificial Intelligence-Generated Facial Images for Medical Education
    Bingwen Eugene Fan
    Minyang Chow
    Stefan Winkler
    [J]. Medical Science Educator, 2024, 34 : 5 - 7
  • [4] Making Use of Artificial Intelligence-Generated Synthetic Tympanic Membrane Images
    Suresh, Krish
    Cohen, Michael S.
    Hartnick, Christopher J.
    Bartholomew, Ryan A.
    Lee, Daniel J.
    Crowson, Matthew G.
    [J]. JAMA OTOLARYNGOLOGY-HEAD & NECK SURGERY, 2023, 149 (06) : 555 - 556
  • [5] Evaluating the Diversity and Representation of Artificial Intelligence-Generated Images of Radiologists: An Observational Study
    Onuh, Ifeanyi
    Yi, Paul H.
    Bui, Molinna
    Kuckelman, Ian J.
    Anderson, Jade A.
    Ross, Andrew B.
    [J]. JOURNAL OF THE AMERICAN COLLEGE OF RADIOLOGY, 2024, 21 (09) : 1497 - 1500
  • [6] Artificial intelligence-generated peripheral blood film images using generative adversarial networks and diffusion models
    Fan, Bingwen Eugene
    Kwok, Ngai Tung Eric
    Chen, David Tao Yi
    Kuperan, Ponnudurai
    Abdul Latiff, Siti Thuraiya Binte
    Wong, Moh Sim
    Ong, Yi Xiong
    Lim, Kian Guan Eric
    Wong, Wei Yong Kevin
    Lim, Shu Ping
    Yong, Bryan Song Jun
    Shanmugam, Hemalatha
    Neo, Yuan Shan
    Ong, Yi Pin Joshua
    Winkler, Stefan
    [J]. AMERICAN JOURNAL OF HEMATOLOGY, 2023, 98 (09) : 1499 - 1502
  • [7] Detecting Artificial Intelligence-Generated Personal Statements in Professional Physical Therapist Education Program Applications: A Lexical Analysis
    Hollman, John H.
    Cloud-Biebl, Beth A.
    Krause, David A.
    Calley, Darren Q.
    [J]. PHYSICAL THERAPY, 2024, 104 (04):
  • [8] Artificial Intelligence-Generated Terahertz Multi-Resonant Metasurfaces via Improved Transformer and CGAN Neural Networks
    Huang, Yangpeng
    Feng, Naixing
    Cai, Yijun
    [J]. JOURNAL OF LIGHTWAVE TECHNOLOGY, 2024, 42 (05) : 1518 - 1525
  • [9] Toward deep observation: A systematic survey on artificial intelligence techniques to monitor fetus via ultrasound images
    Alzubaidi, Mahmood
    Agus, Marco
    Alyafei, Khalid
    Althelaya, Khaled A.
    Shah, Uzair
    Abd-Alrazaq, Alaa
    Anbar, Mohammed
    Makhlouf, Michel
    Househ, Mowafa
    [J]. ISCIENCE, 2022, 25 (08)
  • [10] Change Detection in Heterogeneous Optical and SAR Remote Sensing Images Via Deep Homogeneous Feature Fusion
    Jiang, Xiao
    Li, Gang
    Liu, Yu
    Zhang, Xiao-Ping
    He, You
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 1551 - 1566