VHS to HDTV Video Translation Using Multi-task Adversarial Learning

被引:1
|
作者
Luo, Hongming [1 ,2 ,3 ,4 ]
Liao, Guangsen [1 ,2 ,3 ,4 ]
Hou, Xianxu [1 ,2 ,3 ,4 ]
Liu, Bozhi [1 ,2 ,3 ,4 ]
Zhou, Fei [1 ,2 ,3 ,4 ]
Qiu, Guoping [1 ,2 ,3 ,4 ,5 ]
机构
[1] Shenzhen Univ, Coll Elect & Informat Engn, Shenzhen, Peoples R China
[2] Guangdong Key Lab Intelligent Informat Proc, Shenzhen, Peoples R China
[3] Guangdong Lab Artificial Intelligence & Digital E, Shenzhen, Peoples R China
[4] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen, Peoples R China
[5] Univ Nottingham, Sch Comp Sci, Nottingham, England
来源
关键词
VHS; HDTV; Video translation; Multi-task learning; Unsupervised; GAN;
D O I
10.1007/978-3-030-37731-1_7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There are large amount of valuable video archives in Video Home System (VHS) format. However, due to the analog nature, their quality is often poor. Compared to High-definition television (HDTV), VHS video not only has a dull color appearance but also has a lower resolution and often appears blurry. In this paper, we focus on the problem of translating VHS video to HDTV video and have developed a solution based on a novel unsupervised multi-task adversarial learning model. Inspired by the success of generative adversarial network (GAN) and CycleGAN, we employ cycle consistency loss, adversarial loss and perceptual loss together to learn a translation model. An important innovation of our work is the incorporation of super-resolution model and color transfer model that can solve unsupervised multi-task problem. To our knowledge, this is the first work that dedicated to the study of the relation between VHS and HDTV and the first computational solution to translate VHS to HDTV. We present experimental results to demonstrate the effectiveness of our solution qualitatively and quantitatively.
引用
收藏
页码:77 / 86
页数:10
相关论文
共 50 条
  • [31] GENERATIVE ADVERSARIAL MULTI-TASK LEARNING FOR FACE SKETCH SYNTHESIS AND RECOGNITION
    Wan, Weiguo
    Lee, Hyo Jong
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 4065 - 4069
  • [32] Improving Robustness of Neural Machine Translation with Multi-task Learning
    Zhou, Shuyan
    Zeng, Xiangkai
    Zhou, Yingqi
    Anastasopoulos, Antonios
    Neubig, Graham
    [J]. FOURTH CONFERENCE ON MACHINE TRANSLATION (WMT 2019), 2019, : 565 - 571
  • [33] Multi-task and Generative Adversarial Learning for Robust and Sustainable Text Classification
    Breazzano, Claudia
    Croce, Danilo
    Basili, Roberto
    [J]. AIXIA 2021 - ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, 13196 : 228 - 244
  • [34] Multi-Task Adversarial Learning for Treatment Effect Estimation in Basket Trials
    Chu, Zhixuan
    Rathbun, Stephen L.
    Li, Sheng
    [J]. CONFERENCE ON HEALTH, INFERENCE, AND LEARNING, VOL 174, 2022, 174 : 79 - 91
  • [35] Adversarial Multi-task Learning for Efficient Chinese Named Entity Recognition
    Yan, Yibo
    Zhu, Peng
    Cheng, Dawei
    Yang, Fangzhou
    Luo, Yifeng
    [J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (07)
  • [36] Learning relationship-preserving representation for multi-task adversarial attacks
    Chen, Yong
    Wang, Xu
    Hu, Peng
    Yuan, Zhong
    Peng, Dezhong
    Li, Qilin
    [J]. NEUROCOMPUTING, 2023, 554
  • [37] Probabilistic Multi-Task Learning for Visual Saliency Estimation in Video
    Li, Jia
    Tian, Yonghong
    Huang, Tiejun
    Gao, Wen
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 90 (02) : 150 - 165
  • [38] Deep multi-task learning for image/video distortions identification
    Ameur, Zoubida
    Fezza, Sid Ahmed
    Hamidouche, Wassim
    [J]. Neural Computing and Applications, 2022, 34 (24) : 21607 - 21623
  • [39] Probabilistic Multi-Task Learning for Visual Saliency Estimation in Video
    Jia Li
    Yonghong Tian
    Tiejun Huang
    Wen Gao
    [J]. International Journal of Computer Vision, 2010, 90 : 150 - 165
  • [40] ONLINE MULTI-TASK LEARNING FOR SEMANTIC CONCEPT DETECTION IN VIDEO
    Markatopoulou, Foteini
    Mezaris, Vasileios
    Patras, Ioannis
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 186 - 190