IMPROVING VIDEO COLORIZATION BY TEST-TIME TUNING

被引:3
|
作者
Zhao, Yaping [1 ,3 ]
Zheng, Haitian [2 ]
Luo, Jiebo [2 ]
Lam, Edmund Y. [1 ,3 ]
机构
[1] Univ Hong Kong, Pokfulam, Hong Kong, Peoples R China
[2] Univ Rochester, Rochester, NY 14627 USA
[3] ACCESS AI Chip Ctr Emerging Smart Syst, Hong Kong, Peoples R China
关键词
video colorization; video restoration; image processing;
D O I
10.1109/ICIP49359.2023.10222579
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the advancements in deep learning, video colorization by propagating color information from a colorized reference frame to a monochrome video sequence has been well explored. However, the existing approaches often suffer from overfitting the training dataset and sequentially lead to suboptimal performance on colorizing testing samples. To address this issue, we propose an effective method, which aims to enhance video colorization through test-time tuning. By exploiting the reference to construct additional training samples during testing, our approach achieves a performance boost of 1 similar to 3 dB in PSNR on average compared to the baseline. Code is available at: https://github.com/IndigoPurple/T3.
引用
收藏
页码:166 / 170
页数:5
相关论文
共 50 条
  • [1] Test-Time Training on Video Streams
    Wang, Renhao
    Sun, Yu
    Tandon, Arnuv
    Gandelsman, Yossi
    Chen, Xinlei
    Efros, Alexei A.
    Wang, Xiaolong
    JOURNAL OF MACHINE LEARNING RESEARCH, 2025, 26 : 1 - 29
  • [2] Video Test-Time Adaptation for Action Recognition
    Lin, Wei
    Mirza, Muhammad Jehanzeb
    Kozinski, Mateusz
    Possegger, Horst
    Kuchne, Hilde
    Bischof, Horst
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 22952 - 22961
  • [3] Exploring Motion Cues for Video Test-Time Adaptation
    Zeng, Runhao
    Deng, Qi
    Xu, Huixuan
    Niu, Shuaicheng
    Chen, Jian
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1840 - 1850
  • [4] Improving CNN classifiers by estimating test-time priors
    Sulc, Milan
    Matas, Jiri
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3220 - 3226
  • [5] Self-supervised Test-time Adaptation on Video Data
    Azimi, Fatemeh
    Palacio, Sebastian
    Raue, Federico
    Hees, Joern
    Bertinetto, Luca
    Dengel, Andreas
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 2603 - 2612
  • [6] Robust Test-Time Adaptation for Zero-Shot Prompt Tuning
    Zhang, Ding-Chu
    Zhou, Zhi
    Li, Yu-Feng
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16714 - 16722
  • [7] Diverse Data Augmentation with Diffusions for Effective Test-time Prompt Tuning
    Feng, Chun-Mei
    Yu, Kai
    Liu, Yong
    Khan, Salman
    Zuo, Wangmeng
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 2704 - 2714
  • [8] Test-Time Poisoning Attacks Against Test-Time Adaptation Models
    Cong, Tianshuo
    He, Xinlei
    Shen, Yun
    Zhang, Yang
    45TH IEEE SYMPOSIUM ON SECURITY AND PRIVACY, SP 2024, 2024, : 1306 - 1324
  • [9] Domain-Adaptive Video Deblurring via Test-Time Blurring
    He, Jin-Ting
    Tsai, Fu-Jen
    Wu, Jia-Hao
    Peng, Yan-Tsung
    Tsai, Chung-Chi
    Lin, Chia-Wen
    Lin, Yen-Yu
    COMPUTER VISION - ECCV 2024, PT XXX, 2025, 15088 : 125 - 142
  • [10] Test-time Training for Matching-based Video Object Segmentation
    Bertrand, Juliette
    Kordopatis-Zilos, Giorgos
    Kalantidis, Yannis
    Tolias, Giorgos
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,