Image Error Concealment Based on Deep Neural Network

被引:1
|
作者
Zhang, Zhiqiang [1 ]
Huang, Rong [1 ,2 ]
Han, Fang [1 ,2 ]
Wang, Zhijie [1 ,2 ]
机构
[1] Donghua Univ, Coll Informat Sci & Technol, Shanghai 201620, Peoples R China
[2] Minist Educ, Engn Res Ctr Digitized Text & Apparel Technol, Shanghai 201620, Peoples R China
基金
中国国家自然科学基金;
关键词
image error concealment; deep neural network; local correlation and non-local self-similarity; adaptive scan order;
D O I
10.3390/a12040082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel spatial image error concealment (EC) method based on deep neural network. Considering that the natural images have local correlation and non-local self-similarity, we use the local information to predict the missing pixels and the non-local information to correct the predictions. The deep neural network we utilize can be divided into two parts: the prediction part and the auto-encoder (AE) part. The first part utilizes the local correlation among pixels to predict the missing ones. The second part extracts image features, which are used to collect similar samples from the whole image. In addition, a novel adaptive scan order based on the joint credibility of the support area and reconstruction is also proposed to alleviate the error propagation problem. The experimental results show that the proposed method can reconstruct corrupted images effectively and outperform the compared state-of-the-art methods in terms of objective and perceptual metrics.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] NEURAL NETWORK-BASED ERROR CONCEALMENT FOR VVC
    Benjak, Martin
    Samayoa, Yasser
    Ostermann, Joern
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2114 - 2118
  • [2] VIDEO ERROR CONCEALMENT USING DEEP NEURAL NETWORKS
    Sankisa, Arun
    Punjabi, Arjun
    Katsaggelos, Aggelos K.
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 380 - 384
  • [3] Error Concealment using Neural Networks for Block-Based Image Coding
    Pavlovicova, Jarmila
    Oravec, Milos
    Polec, Jaroslav
    Kelesi, Milan
    Mokos, Martin
    [J]. RADIOENGINEERING, 2006, 15 (02) : 30 - 36
  • [4] Image transmission with error concealment on a lossy packet network
    Srinivas, BS
    Azizoglu, M
    Riskin, EA
    Ladner, R
    [J]. 1996 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, CONFERENCE PROCEEDINGS, VOLS 1-6, 1996, : 2104 - 2107
  • [5] CECNN: A Convergent Error Concealment Neural Network for Videos
    Iqbal, Razib
    Khanal, Shashi
    Kazemi, Mohammad
    [J]. SIGMAP: PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND MULTIMEDIA APPLICATIONS, 2022, : 23 - 31
  • [6] Packet Loss Concealment Based on Phase Correction and Deep Neural Network
    Ji, Qiang
    Bao, Changchun
    Cui, Zihao
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (19):
  • [7] Neural Network-based Error Concealment for B-Frames in VVC
    Benjak, Martin
    Aust, Niklas
    Samayoa, Yasser
    Ostermann, Joern
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 511 - 515
  • [8] Deep neural network based image annotation
    Zhu, Songhao
    Shi, Zhe
    Sun, Chengjian
    Shen, Shuhan
    [J]. PATTERN RECOGNITION LETTERS, 2015, 65 : 103 - 108
  • [9] AN ERROR-BASED RECURSIVE FILLING ORDERING FOR IMAGE ERROR CONCEALMENT
    Koloda, Jan
    Seiler, Juergen
    Kaup, Andre
    Sanchez, Victoria
    Peinado, Antonio M.
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 2517 - 2521
  • [10] Error detection and concealment based on characteristic clustering of image
    Li, Guo-Bo
    Chen, Gang
    Wu, Bai-Feng
    [J]. Tongxin Xuebao/Journal on Communications, 2010, 31 (12): : 1 - 11