Interactive Video Colorization Within a Variational Framework

被引:5
|
作者
Pierre, F. [1 ]
Aujol, J. -F. [2 ]
Bugeau, A. [3 ]
Ta, V. -T. [4 ,5 ]
机构
[1] Univ Bordeaux, CNRS, IMB, UMR 5251,LaBRI,UMR 5800, F-33400 Talence, France
[2] Univ Bordeaux, CNRS, IMB, UMR 5251, F-33400 Talence, France
[3] Univ Bordeaux, CNRS, LaBRI, UMR 5800, F-33400 Talence, France
[4] CNRS, LaBRI, UMR 5800, F-33400 Talence, France
[5] Bordeaux INP, LaBRI, UMR 5800, F-33402 Talence, France
来源
SIAM JOURNAL ON IMAGING SCIENCES | 2017年 / 10卷 / 04期
关键词
colorization; optimization; nonlocal methods; IMAGE; MINIMIZATION; ALGORITHM;
D O I
10.1137/16M1108625
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper deals with the difficult problem of video colorization. Methods in the literature are generally based on spatio-temporal video blocks or on frame-to-frame color propagation algorithms, each technique having its own advantages and drawbacks. In this paper, we present both a novel automatic frame-to-frame propagation approach and an interactive correction method within a variational framework. The proposed method propagates colors from an initial colorized frame to the whole grayscale video sequence. The automatic propagation results may be visually unsuitable in some cases. To overcome this limitation, a spatio-temporal functional with a user-guided correction is introduced. Two fast primal-dual algorithms are designed to solve the proposed variational models. Numerical results show the efficiency and the potentiality of the proposed approach in comparison with state-of-the-art methods.
引用
收藏
页码:2293 / 2325
页数:33
相关论文
共 50 条
  • [1] Video Colorization Based on Variational Autoencoder
    Zhang, Guangzi
    Hong, Xiaolin
    Liu, Yan
    Qian, Yulin
    Cai, Xingquan
    [J]. ELECTRONICS, 2024, 13 (12)
  • [2] A Practical Monochrome Video Colorization Framework for Broadcast Program Production
    Endo, Rei
    Kawai, Yoshihiko
    Mchizuki, Takahiro
    [J]. IEEE TRANSACTIONS ON BROADCASTING, 2021, 67 (01) : 225 - 237
  • [3] Video Colorization: A Survey
    Peng, Zhong-Zheng
    Yang, Yi-Xin
    Tang, Jin-Hui
    Pan, Jin-Shan
    [J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2024, 39 (03) : 487 - 508
  • [4] Video Colorization Dataset and Benchmark
    Abeysinghe, Chamath
    Wijesinghe, Thejan
    Wijayakoon, Chanuka
    Jayathilake, Lahiru
    Thayasivam, Uthayasanker
    [J]. 2019 MORATUWA ENGINEERING RESEARCH CONFERENCE (MERCON) / 5TH INTERNATIONAL MULTIDISCIPLINARY ENGINEERING RESEARCH CONFERENCE, 2019, : 37 - 42
  • [5] A 360 Video Editor Framework for Interactive Training
    Torres, Andrei
    Carmichael, Christopher
    Wang, William
    Paraskevakos, Matthew
    Uribe-Quevedo, Alvaro
    Giles, Paul
    Yawney, Jamie Lee
    [J]. 2020 IEEE 8TH INTERNATIONAL CONFERENCE ON SERIOUS GAMES AND APPLICATIONS FOR HEALTH (SEGAH 20), 2020,
  • [6] Variational Exemplar-Based Image Colorization
    Bugeau, Aurelie
    Vinh-Thong Ta
    Papadakis, Nicolas
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (01) : 298 - 307
  • [7] A fast colorization algorithm for infrared video
    He, Mengchi
    Gu, Xiaojing
    Gu, Xingsheng
    [J]. Communications in Computer and Information Science, 2014, 462 : 282 - 292
  • [8] A Fast Colorization Algorithm for Infrared Video
    He, Mengchi
    Gu, Xiaojing
    Gu, Xingsheng
    [J]. COMPUTATIONAL INTELLIGENCE, NETWORKED SYSTEMS AND THEIR APPLICATIONS, 2014, 462 : 282 - 292
  • [9] VIDEO COLORIZATION DIAGNOSTICS IN OPTICAL TELECOMMUNICATIONS
    PRESBY, HM
    CHANG, R
    [J]. BELL SYSTEM TECHNICAL JOURNAL, 1982, 61 (03): : 267 - 282
  • [10] A multi-camera framework for interactive video games
    Cuypers, Tom
    Vanaken, Cedric
    Francken, Yannick
    Van Reeth, Frank
    Bekaert, Philippe
    [J]. GRAPP 2008: PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON COMPUTER GRAPHICS THEORY AND APPLICATIONS, 2008, : 443 - 449