VHS to HDTV Video Translation Using Multi-task Adversarial Learning

被引:1
|
作者
Luo, Hongming [1 ,2 ,3 ,4 ]
Liao, Guangsen [1 ,2 ,3 ,4 ]
Hou, Xianxu [1 ,2 ,3 ,4 ]
Liu, Bozhi [1 ,2 ,3 ,4 ]
Zhou, Fei [1 ,2 ,3 ,4 ]
Qiu, Guoping [1 ,2 ,3 ,4 ,5 ]
机构
[1] Shenzhen Univ, Coll Elect & Informat Engn, Shenzhen, Peoples R China
[2] Guangdong Key Lab Intelligent Informat Proc, Shenzhen, Peoples R China
[3] Guangdong Lab Artificial Intelligence & Digital E, Shenzhen, Peoples R China
[4] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen, Peoples R China
[5] Univ Nottingham, Sch Comp Sci, Nottingham, England
来源
关键词
VHS; HDTV; Video translation; Multi-task learning; Unsupervised; GAN;
D O I
10.1007/978-3-030-37731-1_7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There are large amount of valuable video archives in Video Home System (VHS) format. However, due to the analog nature, their quality is often poor. Compared to High-definition television (HDTV), VHS video not only has a dull color appearance but also has a lower resolution and often appears blurry. In this paper, we focus on the problem of translating VHS video to HDTV video and have developed a solution based on a novel unsupervised multi-task adversarial learning model. Inspired by the success of generative adversarial network (GAN) and CycleGAN, we employ cycle consistency loss, adversarial loss and perceptual loss together to learn a translation model. An important innovation of our work is the incorporation of super-resolution model and color transfer model that can solve unsupervised multi-task problem. To our knowledge, this is the first work that dedicated to the study of the relation between VHS and HDTV and the first computational solution to translate VHS to HDTV. We present experimental results to demonstrate the effectiveness of our solution qualitatively and quantitatively.
引用
收藏
页码:77 / 86
页数:10
相关论文
共 50 条
  • [1] Adversarial Multi-task Learning for Text Classification
    Liu, Pengfei
    Qiu, Xipeng
    Huang, Xuanjing
    [J]. PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, : 1 - 10
  • [2] Adversarial Online Multi-Task Reinforcement Learning
    Nguyen, Quan
    Mehta, Nishant A.
    [J]. INTERNATIONAL CONFERENCE ON ALGORITHMIC LEARNING THEORY, VOL 201, 2023, 201 : 1124 - 1165
  • [3] Speech Emotion Recognition in the Wild using Multi-task and Adversarial Learning
    Parry, Jack
    DeMattos, Eric
    Klementiev, Anita
    Ind, Axel
    Morse-Kopp, Daniela
    Clarke, Georgia
    Palaz, Dimitri
    [J]. INTERSPEECH 2022, 2022, : 1158 - 1162
  • [4] Multi-Task Learning for Multiple Language Translation
    Dong, Daxiang
    Wu, Hua
    He, Wei
    Yu, Dianhai
    Wang, Haifeng
    [J]. PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1, 2015, : 1723 - 1732
  • [5] Multi-task face analyses through adversarial learning
    Wang, Shangfei
    Yin, Shi
    Hao, Longfei
    Liang, Guang
    [J]. PATTERN RECOGNITION, 2021, 114
  • [6] Adversarial Learning Guided Task Relatedness Refinement for Multi-Task Deep Learning
    Fang, Yuchun
    Cai, Sirui
    Cao, Yiting
    Li, Zhengchen
    Zhang, Zhaoxiang
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 6946 - 6957
  • [7] Multi-Task Adversarial Network for Disentangled Feature Learning
    Liu, Yang
    Wang, Zhaowen
    Jin, Hailin
    Wassell, Ian
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3743 - 3751
  • [8] Adversarial Robustness in Multi-Task Learning: Promises and Illusions
    Ghamizi, Salah
    Cordy, Maxime
    Papadakis, Mike
    Le Traon, Yves
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 697 - 705
  • [9] Attribution of Adversarial Attacks via Multi-task Learning
    Guo, Zhongyi
    Han, Keji
    Ge, Yao
    Li, Yun
    Ji, Wei
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2023, PT II, 2024, 14448 : 81 - 94
  • [10] Multi-task Hierarchical Adversarial Inverse Reinforcement Learning
    Chen, Jiayu
    Tamboli, Dipesh
    Lan, Tian
    Aggarwal, Vaneet
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 202, 2023, 202