Image Inpainting Forensics Algorithm Based on Deep Neural Network

被引:4
|
作者
Zhu Xinshan [1 ,2 ]
Qian Yongjun [1 ]
Sun Biao [1 ]
Ren Chao [1 ]
Sun Ya [1 ]
Yao Siru [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Chinese Acad Sci, Inst Informat Engn, State Key Lab Informat Secur, Beijing 100093, Peoples R China
关键词
image processing; image inpainting forensics; deep neural network; encoder network; decoder network; robustness;
D O I
10.3788/AOS201838.1110005
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
A novel image inpainting forensics algorithm based on the deep neural network is proposed, in which the vestigial features can be automatically extracted by the encoder network, the category of each pixel is predicted by the decoder network, and thus whether or not the image is with inpainting and falsification as well as the inpainted and falsified regions can be distinguished. Simultaneously, the feature pyramid network (FPN) is used to supplement the feature map in the decoder network. The MIT Place dataset is used as the training set and the UCID dataset as the testing set. In addition, the different inpainting and falsification algorithms are adopted for the training set and the testing set, respectively. The experimental results show that, compared with the other inpainting forensics algorithms of images, the proposed algorithm has a more accurate inpainting area and a faster processing speed. Moreover, it has relatively good robustness and strong generalization ability against different inpainting forensics algorithms.
引用
收藏
页数:9
相关论文
共 25 条
  • [1] Bacchuwar KS, 2013, 2013 IEEE INTERNATIONAL MULTI CONFERENCE ON AUTOMATION, COMPUTING, COMMUNICATION, CONTROL AND COMPRESSED SENSING (IMAC4S), P723, DOI 10.1109/iMac4s.2013.6526502
  • [2] Blind inpainting using the fully convolutional neural network
    Cai, Nian
    Su, Zhenghang
    Lin, Zhineng
    Wang, Han
    Yang, Zhijing
    Ling, Bingo Wing-Kuen
    [J]. VISUAL COMPUTER, 2017, 33 (02): : 249 - 261
  • [3] A forgery detection algorithm for exemplar-based inpainting images using multi-region relation
    Chang, I-Cheng
    Yu, J. Cloud
    Chang, Chih-Chuan
    [J]. IMAGE AND VISION COMPUTING, 2013, 31 (01) : 57 - 71
  • [4] Median Filtering Forensics Based on Convolutional Neural Networks
    Chen, Jiansheng
    Kang, Xiangui
    Liu, Ye
    Wang, Z. Jane
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (11) : 1849 - 1853
  • [5] Structure-aware image inpainting using patch scale optimization
    Chen, Zhihua
    Dai, Chao
    Jiang, Lei
    Sheng, Bin
    Zhang, Jing
    Lin, Weiyao
    Yuan, Yubo
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2016, 40 : 312 - 323
  • [6] Region filling and object removal by exemplar-based image inpainting
    Criminisi, A
    Pérez, P
    Toyama, K
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (09) : 1200 - 1212
  • [7] Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA)
    Elad, M
    Starck, JL
    Querre, P
    Donoho, DL
    [J]. APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2005, 19 (03) : 340 - 358
  • [8] He K, 2017, 2017 IEEE INT C COMP, P2961, DOI DOI 10.1109/ICCV.2017.322
  • [9] Restoration of digital off-axis Fresnel hologram by exemplar and search based image inpainting with enhanced computing speed
    Jiao, A. S. M.
    Tsang, P. W. M.
    Poon, T. -C.
    [J]. COMPUTER PHYSICS COMMUNICATIONS, 2015, 193 : 30 - 37
  • [10] Keypoint-based copy-move detection scheme by adopting MSCRs and improved feature matching
    Li, Jingwei
    Yang, Fan
    Lu, Wei
    Sun, Wei
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (20) : 20483 - 20497