IMPROVING VIDEO COLORIZATION BY TEST-TIME TUNING

被引:3
|
作者
Zhao, Yaping [1 ,3 ]
Zheng, Haitian [2 ]
Luo, Jiebo [2 ]
Lam, Edmund Y. [1 ,3 ]
机构
[1] Univ Hong Kong, Pokfulam, Hong Kong, Peoples R China
[2] Univ Rochester, Rochester, NY 14627 USA
[3] ACCESS AI Chip Ctr Emerging Smart Syst, Hong Kong, Peoples R China
关键词
video colorization; video restoration; image processing;
D O I
10.1109/ICIP49359.2023.10222579
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the advancements in deep learning, video colorization by propagating color information from a colorized reference frame to a monochrome video sequence has been well explored. However, the existing approaches often suffer from overfitting the training dataset and sequentially lead to suboptimal performance on colorizing testing samples. To address this issue, we propose an effective method, which aims to enhance video colorization through test-time tuning. By exploiting the reference to construct additional training samples during testing, our approach achieves a performance boost of 1 similar to 3 dB in PSNR on average compared to the baseline. Code is available at: https://github.com/IndigoPurple/T3.
引用
收藏
页码:166 / 170
页数:5
相关论文
共 50 条
  • [31] Depth-aware Test-Time Training for Zero-shot Video Object Segmentation
    Li, Weihuang
    Shen, Xi
    Li, Haolun
    Bi, Xiuli
    Liu, Bo
    Pun, Chi-Man
    Cun, Xiaodong
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 19218 - 19227
  • [32] OST: Improving Generalization of DeepFake Detection via One-Shot Test-Time Training
    Chen, Liang
    Zhang, Yong
    Song, Yibing
    Wang, Jue
    Liu, Lingqiao
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [33] Robust Test-Time Adaptation in Dynamic Scenarios
    Yuan, Longhui
    Xie, Binhui
    Li, Shuang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 15922 - 15932
  • [34] Fully Test-Time Adaptation for Image Segmentation
    Hu, Minhao
    Song, Tao
    Gu, Yujun
    Luo, Xiangde
    Chen, Jieneng
    Chen, Yinan
    Zhang, Ya
    Zhang, Shaoting
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT III, 2021, 12903 : 251 - 260
  • [35] Test-Time Adaptation for Deformable Image Registration
    Sang, Y.
    McNitt-Gray, M.
    Yang, Y.
    Cao, M.
    Low, D.
    Ruan, D.
    MEDICAL PHYSICS, 2022, 49 (06) : E458 - E459
  • [36] A Probabilistic Framework for Lifelong Test-Time Adaptation
    Brahma, Dhanajit
    Rai, Piyush
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 3582 - 3591
  • [37] Improving Adversarial Robustness of Masked Autoencoders via Test-time Frequency-domain Prompting
    Huang, Qidong
    Dong, Xiaoyi
    Chen, Dongdong
    Chen, Yinpeng
    Yuan, Lu
    Hua, Gang
    Zhang, Weiming
    Yu, Nenghai
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1600 - 1610
  • [38] Test-Time Adaptation for Egocentric Action Recognition
    Plananamente, Mirco
    Plizzari, Chiara
    Caputo, Barbara
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT III, 2022, 13233 : 206 - 218
  • [39] Improved Test-Time Adaptation for Domain Generalization
    Chen, Liang
    Zhang, Yong
    Song, Yibing
    Shan, Ying
    Liu, Lingqiao
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 24172 - 24182
  • [40] Robust Text Classifier on Test-Time Budgets
    Parvez, Md Rizwan
    Bolukbasi, Tolga
    Chang, Kai-Wei
    Saligrama, Venkatesh
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 1167 - 1172