Video Inpainting Algorithm Using Spatio-Temporal Consistency

被引：0
|
作者：
Lee, Sang-Heon [2 ]
Lee, Soon-Young [2 ]
Heu, Jun-Hee [2 ]
Kim, Chang-Su [1 ]
Lee, Sang-Uk [2 ]
机构：
[1] Seoul Natl Univ, Sch Elect Engn, San 56-1, Seoul 151742, South Korea
[2] Seoul Natl Univ, Signal Proc Lab, Sch Elect Engn, Seoul 151, South Korea
来源：
COMPUTATIONAL IMAGING VII | 2009年 / 7246卷
关键词：
inpainting; restoration; optimization; video editing; spatio-temporal inpainting;
D O I：
10.1117/12.805892
中图分类号：
TH742 [显微镜];
学科分类号：
摘要：
A new video inpainting algorithm is proposed for removing unwanted or erroneous objects from video data. The proposed algorithm fills a mask region with source blocks from unmasked areas, while keeping spatio-temporal consistency. First, a 3-dimensional graph is constructed over consecutive frames. It defines a structure of nodes over which the source blocks are pasted. Then, we form temporal block bundles using the motion information. The best block bundles, which minimize an objective function, are arranged in the 3-dimensional graph. Extensive simulation results demonstrate that the proposed algorithm can yield visually pleasing video inpainting results even for dynamic sequences.
引用
收藏
页数：8
相关论文
共 50 条
  • [1] A Spatio-temporal Inpainting Method for Kinect Depth Video
    Zhang, Dongdong
    Yao, Ye
    Zang, Di
    Chen, Yanyu
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING APPLICATIONS (IEEE ICSIPA 2013), 2013, : 67 - 70
  • [2] Spatio-Temporal Inference Transformer Network for Video Inpainting
    Tudavekar, Gajanan
    Saraf, Santosh S.
    Patil, Sanjay R.
    [J]. INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2023, 23 (01)
  • [3] SPATIO-TEMPORAL CONSISTENCY IN VIDEO DISPARITY ESTIMATION
    Khoshabeh, Ramsin
    Chan, Stanley H.
    Nguyen, Truong Q.
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, : 885 - 888
  • [4] Spatio-Temporal Consistency in Depth Video Enhancement
    Li, Li
    Zhang, Caiming
    [J]. JOURNAL OF ADVANCED MECHANICAL DESIGN SYSTEMS AND MANUFACTURING, 2013, 7 (05): : 808 - 817
  • [5] SPATIO-TEMPORAL BINARY VIDEO INPAINTING VIA THRESHOLD DYNAMICS
    Oliver, M.
    Palomares, R. P.
    Ballester, C.
    Haro, G.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 1822 - 1826
  • [6] Spatio-temporal texture synthesis and image inpainting for video applications
    Kumar, S
    Biswas, M
    Belongie, SJ
    Nguyen, TQ
    [J]. 2005 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), VOLS 1-5, 2005, : 2317 - 2320
  • [7] Real time Video Fire Detection using Spatio-Temporal Consistency Energy
    Barmpoutis, Panagiotis
    Dimitropoulos, Kosmas
    Grammalidis, Nikos
    [J]. 2013 10TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS 2013), 2013, : 365 - 370
  • [8] A Novel Spatio-Temporal Video Object Segmentation Algorithm
    Zhu, Shiping
    Xia, Xi
    Zhang, Qingrong
    Belloulata, Kamel
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY, VOLS 1-5, 2008, : 1916 - +
  • [9] A spatio-temporal fuzzy interpolation algorithm for video deinterlacing
    Jeon, Gwanggil
    Jeong, Jechang
    Lee, Joohyun
    You, Jongmin
    Wu, Chengke
    [J]. 2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, : 1789 - +
  • [10] Video Shadow Detection via Spatio-Temporal Interpolation Consistency Training
    Lu, Xiao
    Cao, Yihong
    Liu, Sheng
    Long, Chengjiang
    Chen, Zipei
    Zhou, Xuanyu
    Yang, Yimin
    Xiao, Chunxia
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 3106 - 3115
12345