Error Concealment for Frame Losses in MVD Video Using Saliency

被引：0
|
作者：
Cui J.-P. [1 ]
Zhou Y. [1 ]
Yin H.-B. [1 ]
Huang X.-F. [1 ]
Lu Y. [1 ]
机构：
[1] School of Telecommunication Engineering, Hangzhou Dianzi University, Zhejiang, Hangzhou
来源：
Tien Tzu Hsueh Pao/Acta Electronica Sinica | 2022年 / 50卷 / 09期
关键词：
disparity compensation; error concealment; motion compensa⁃ tion; multiview video plus depth; visual saliency; whole frame loss;
D O I：
10.12263/DZXB.20210393
中图分类号：
学科分类号：
摘要：
The 3D video based on multiview video plus depth(MVD) format can provide users with immersive expe⁃ riences from different viewpoints. To solve the whole color frame losses in MVD video stream transmission, we propose a novel error concealment algorithm of whole-frames loss using visual saliency. Firstly, each region of the lost frame is classi⁃ fied into three different saliency levels. The low, medium and high saliency regions are recovered by direct temporal copy, adaptive pixel matching search between temporally and inter-view domains, and a new motion vector compensation, respec⁃ tively. Compared with the recent algorithms, the lost frame concealed by the proposed algorithm achieves significant im⁃ provements in the average PSNR and SSIM with approximate gains of 0.99~2.61 dB and 0.005~0.012, respectively. In addi⁃ tion, our concealed results have better visual quality than compared methods. © 2022 Chinese Institute of Electronics. All rights reserved.
引用
收藏
页码：2146 / 2154
页数：8
相关论文
共 24 条
  • [1] WANG T, LI F, QIAO X, Et al., Low-complexity error re⁃ silient HEVC video coding: a deep learning approach, IEEE Transactions on Image Processing, 30, 2, pp. 1245-1260, (2021)
  • [2] XIANG X, CHENG Y., A frame loss error concealment scheme for multi-view video coding, Proceedings of 2014 International Conference on Instrumentation, Mea⁃ surement, Computer, Communication and Control, pp. 857-861, (2014)
  • [3] KUAN Y K, LI G L, CHEN M J, Et al., Error concealment algorithm using inter-view correlation for multi-view video, EURASIP Journal on Image and Video Processing, 38, 1, pp. 1-11, (2014)
  • [4] ZHOU Y, XIANG W, WANG G., Frame loss concealment for multiview video transmission over wireless multimedia sensor networks, IEEE Sensors Journal, 15, 3, pp. 1892-1901, (2015)
  • [5] YU H, RAN M, LI P, Et al., A new hybrid error conceal⁃ ment for multi-view video, Proceedings of 2015 IEEE China Summit and International Conference on Signal and Information Processing, pp. 176-180, (2015)
  • [6] AHAMED Z G, SHARMA V K, JAIN A., Image error con⁃ cealment using robust data hiding technique, Proceed⁃ ings of 2020 International Conference on Innovative Mech⁃ anisms for Industry Applications, pp. 470-474, (2020)
  • [7] EL-SHAFAI W, EL-RABAIE S, EL-HALAWANY M M, Et al., Recursive Bayesian filtering-based error concealment scheme for 3D video communication over severely lossy wireless channels, Circuits, Systems, and Signal Process⁃ ing, 37, 11, pp. 4810-4841, (2018)
  • [8] YANG M, LAN X, ZHENG N, Et al., Depth-assisted tem⁃ poral error concealment for Intra frame slices in 3-D video, IEEE Transactions on Broadcasting, 60, 2, pp. 385-393, (2014)
  • [9] EL-SHAFAI W, EL-RABAIE S, EL-HALAWANY M, Et al., Encoder-independent decoder-dependent depth-assisted error concealment algorithm for wireless 3D video commu⁃ nication[J], Multimedia Tools and Applications, 77, 11, pp. 13145-13172, (2018)
  • [10] HUANG P C, LIN J R, LI G L, Et al., Improved depthasisted error concealment algorithm for 3D video trans⁃ mission[J], IEEE Transactions on Multimedia, 19, 11, pp. 2625-2632, (2017)
123