Temporally Consistent Semantic Video Editing

被引:7
|
作者
Xu, Yiran [1 ]
AlBahar, Badour [2 ]
Huang, Jia-Bin [1 ]
机构
[1] Univ Maryland, College Pk, MD 20742 USA
[2] Virginia Tech, Blacksburg, VA USA
来源
关键词
Video editing; GAN editing; Video consistency;
D O I
10.1007/978-3-031-19784-0_21
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generative adversarial networks (GANs) have demonstrated impressive image generation quality and semantic editing capability of real images, e.g., changing object classes, modifying attributes, or transferring styles. However, applying these GAN-based editing to a video independently for each frame inevitably results in temporal flickering artifacts. We present a simple yet effective method to facilitate temporally coherent video editing. Our core idea is to minimize the temporal photometric inconsistency by optimizing both the latent code and the pre-trained generator. We evaluate the quality of our editing on different domains and GAN inversion techniques and show favorable results against the baselines.
引用
收藏
页码:357 / 374
页数:18
相关论文
共 50 条
  • [21] Temporally Consistent Referring Video Object Segmentation with Hybrid Memory
    Miao B.
    Bennamoun M.
    Gao Y.
    Shah M.
    Mian A.
    IEEE Transactions on Circuits and Systems for Video Technology, 2024, 34 (11) : 1 - 1
  • [22] Facial Expression Editing in Video Using a Temporally-Smooth Factorization
    Yang, Fei
    Bourdev, Lubomir
    Shechtman, Eli
    Wang, Jue
    Metaxas, Dimitris
    2012 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2012, : 861 - 868
  • [23] TEMPORALLY CONSISTENT KEY FRAME SELECTION FROM VIDEO FOR FACE RECOGNITION
    Saeed, Usman
    Dugelay, Jean-Luc
    18TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO-2010), 2010, : 1311 - 1315
  • [24] Temporally Consistent Motion Segmentation From RGB-D Video
    Bertholet, P.
    Ichim, A. E.
    Zwicker, M.
    COMPUTER GRAPHICS FORUM, 2018, 37 (06) : 118 - 134
  • [25] Video completion via spatio-temporally consistent motion inpainting
    1600, Information Processing Society of Japan (06):
  • [26] VORNet: Spatio-temporally Consistent Video Inpainting for Object Removal
    Chang, Ya-Liang
    Liu, Zhe Yu
    Hsu, Winston
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1785 - 1794
  • [27] Temporally consistent depth video filter using temporal outlier reduction
    Sangbeom Lee
    Yo-Sung Ho
    Signal, Image and Video Processing, 2015, 9 : 1401 - 1408
  • [28] Spatio-temporally consistent video processing for local backlight dimming
    Muijs, Remo
    Langendijk, Erno
    Vossen, Frank
    2008 SID INTERNATIONAL SYMPOSIUM, DIGEST OF TECHNICAL PAPERS, VOL XXXIX, BOOKS I-III, 2008, 39 : 979 - 982
  • [29] Temporally consistent depth video filter using temporal outlier reduction
    Lee, Sangbeom
    Ho, Yo-Sung
    SIGNAL IMAGE AND VIDEO PROCESSING, 2015, 9 (06) : 1401 - 1408
  • [30] Region-based Temporally Consistent Video Post-processing
    Dong, Xuan
    Bonev, Boyan
    Zhu, Yu
    Yuille, Alan L.
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 714 - 722