IMPROVING VIDEO COLORIZATION BY TEST-TIME TUNING

被引:3
|
作者
Zhao, Yaping [1 ,3 ]
Zheng, Haitian [2 ]
Luo, Jiebo [2 ]
Lam, Edmund Y. [1 ,3 ]
机构
[1] Univ Hong Kong, Pokfulam, Hong Kong, Peoples R China
[2] Univ Rochester, Rochester, NY 14627 USA
[3] ACCESS AI Chip Ctr Emerging Smart Syst, Hong Kong, Peoples R China
关键词
video colorization; video restoration; image processing;
D O I
10.1109/ICIP49359.2023.10222579
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the advancements in deep learning, video colorization by propagating color information from a colorized reference frame to a monochrome video sequence has been well explored. However, the existing approaches often suffer from overfitting the training dataset and sequentially lead to suboptimal performance on colorizing testing samples. To address this issue, we propose an effective method, which aims to enhance video colorization through test-time tuning. By exploiting the reference to construct additional training samples during testing, our approach achieves a performance boost of 1 similar to 3 dB in PSNR on average compared to the baseline. Code is available at: https://github.com/IndigoPurple/T3.
引用
收藏
页码:166 / 170
页数:5
相关论文
共 50 条
  • [41] DomainAdaptor: A Novel Approach to Test-time Adaptation
    Zhang, Jian
    Qi, Lei
    Shi, Yinghuan
    Gao, Yang
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18925 - 18935
  • [42] Test-Time Augmentation for Traveling Salesperson Problem
    Ishiyama, Ryo
    Shirakawa, Takahiro
    Uchida, Seiichi
    Matsuo, Shinnosuke
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT I, 2024, 15016 : 194 - 208
  • [43] Self-Supervised Domain Adaptive Segmentation of Breast Cancer via Test-Time Fine-Tuning
    Lee, Kyungsu
    Lee, Haeyun
    El Fakhri, Georges
    Woo, Jonghye
    Hwang, Jae Youn
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT I, 2023, 14220 : 539 - 550
  • [44] Improving severity classification of Hebrew PET-CT pathology reports using test-time augmentation
    Cohen, Seffi
    Lior, Edo
    Bocher, Moshe
    Rokach, Lior
    JOURNAL OF BIOMEDICAL INFORMATICS, 2024, 149
  • [45] Improving Test-Time Adaptation Via Shift-Agnostic Weight Regularization and Nearest Source Prototypes
    Choi, Sungha
    Yang, Seunghan
    Choi, Seokeon
    Yun, Sungrack
    COMPUTER VISION - ECCV 2022, PT XXXIII, 2022, 13693 : 440 - 458
  • [46] Video Colorization: A Survey
    Peng, Zhong-Zheng
    Yang, Yi-Xin
    Tang, Jin-Hui
    Pan, Jin-Shan
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2024, 39 (03) : 487 - 508
  • [47] TTA-OOD: Test-Time Augmentation for Improving Out-of-Distribution Detection in Gastrointestinal Vision
    Pokhrel, Sandesh
    Bhandari, Sanjay
    Vazquez, Eduard
    Lambrou, Tryphon
    Gyawali, Prashnna
    Bhattarai, Binod
    DATA ENGINEERING IN MEDICAL IMAGING, DEMI 2024, 2025, 15265 : 33 - 42
  • [48] Contrastive Learning Enhanced Diffusion Model for Improving Tropical Cyclone Intensity Estimation with Test-Time Adaptation
    Zhou, Ziheng
    Zuo, Haojia
    Zhao, Ying
    Chen, Wenguang
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES-APPLIED DATA SCIENCE TRACK, PT IX, ECML PKDD 2024, 2024, 14949 : 418 - 434
  • [49] TTANAD: Test-Time Augmentation for Network Anomaly Detection
    Cohen, Seffi
    Goldshlager, Niv
    Shapira, Bracha
    Rokach, Lior
    ENTROPY, 2023, 25 (05)
  • [50] In Search of Lost Online Test-Time Adaptation: A Survey
    Wang, Zixin
    Luo, Yadan
    Zheng, Liang
    Chen, Zhuoxiao
    Wang, Sen
    Huang, Zi
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025, 133 (03) : 1106 - 1139