IMPROVING VIDEO COLORIZATION BY TEST-TIME TUNING

被引:3
|
作者
Zhao, Yaping [1 ,3 ]
Zheng, Haitian [2 ]
Luo, Jiebo [2 ]
Lam, Edmund Y. [1 ,3 ]
机构
[1] Univ Hong Kong, Pokfulam, Hong Kong, Peoples R China
[2] Univ Rochester, Rochester, NY 14627 USA
[3] ACCESS AI Chip Ctr Emerging Smart Syst, Hong Kong, Peoples R China
关键词
video colorization; video restoration; image processing;
D O I
10.1109/ICIP49359.2023.10222579
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the advancements in deep learning, video colorization by propagating color information from a colorized reference frame to a monochrome video sequence has been well explored. However, the existing approaches often suffer from overfitting the training dataset and sequentially lead to suboptimal performance on colorizing testing samples. To address this issue, we propose an effective method, which aims to enhance video colorization through test-time tuning. By exploiting the reference to construct additional training samples during testing, our approach achieves a performance boost of 1 similar to 3 dB in PSNR on average compared to the baseline. Code is available at: https://github.com/IndigoPurple/T3.
引用
收藏
页码:166 / 170
页数:5
相关论文
共 50 条
  • [21] Adapting Vision-Language Models to Open Classes via Test-Time Prompt Tuning
    Gao, Zhengqing
    Ao, Xiang
    Zhang, Xu-Yao
    Liu, Cheng-Lin
    PATTERN RECOGNITION AND COMPUTER VISION, PT V, PRCV 2024, 2025, 15035 : 439 - 452
  • [22] Test-time Augmentation for Factual Probing
    Kamoda, Go
    Heinzerling, Benjamin
    Sakaguchi, Keisuke
    Inui, Kentaro
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 3650 - 3661
  • [23] Train/Test-Time Adaptation with Retrieval
    Zancato, Luca
    Achille, Alessandro
    Liu, Tian Yu
    Trager, Matthew
    Perera, Pramuditha
    Soatto, Stefano
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 15911 - 15921
  • [24] Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language Models
    Shu, Manli
    Nie, Weili
    Huang, De-An
    Yu, Zhiding
    Goldstein, Tom
    Anandkumar, Anima
    Xiao, Chaowei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [25] Better Aggregation in Test-Time Augmentation
    Shanmugam, Divya
    Blalock, Davis
    Balakrishnan, Guha
    Guttag, John
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 1194 - 1203
  • [26] TEA: Test-time Energy Adaptation
    Yuan, Yige
    Xu, Bingbing
    Hou, Liang
    Sun, Fei
    Shen, Huawei
    Cheng, Xueqi
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 23901 - 23911
  • [27] Learning Loss for Test-Time Augmentation
    Kim, Ildoo
    Kim, Younghoon
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [28] Test-Time Training with Masked Autoencoders
    Gandelsman, Yossi
    Sun, Yu
    Chen, Xinlei
    Efros, Alexei A.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [29] Continual Test-Time Domain Adaptation
    Wang, Qin
    Fink, Olga
    Van Gool, Luc
    Dai, Dengxin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7191 - 7201
  • [30] Cyclic Test-Time Adaptation on Monocular Video for 3D Human Mesh Reconstruction
    Nam, Hyeongjin
    Jung, Daniel Sungho
    Oh, Yeonguk
    Lee, Kyoung Mu
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14783 - 14793