VHS to HDTV Video Translation Using Multi-task Adversarial Learning

被引:1
|
作者
Luo, Hongming [1 ,2 ,3 ,4 ]
Liao, Guangsen [1 ,2 ,3 ,4 ]
Hou, Xianxu [1 ,2 ,3 ,4 ]
Liu, Bozhi [1 ,2 ,3 ,4 ]
Zhou, Fei [1 ,2 ,3 ,4 ]
Qiu, Guoping [1 ,2 ,3 ,4 ,5 ]
机构
[1] Shenzhen Univ, Coll Elect & Informat Engn, Shenzhen, Peoples R China
[2] Guangdong Key Lab Intelligent Informat Proc, Shenzhen, Peoples R China
[3] Guangdong Lab Artificial Intelligence & Digital E, Shenzhen, Peoples R China
[4] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen, Peoples R China
[5] Univ Nottingham, Sch Comp Sci, Nottingham, England
来源
关键词
VHS; HDTV; Video translation; Multi-task learning; Unsupervised; GAN;
D O I
10.1007/978-3-030-37731-1_7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There are large amount of valuable video archives in Video Home System (VHS) format. However, due to the analog nature, their quality is often poor. Compared to High-definition television (HDTV), VHS video not only has a dull color appearance but also has a lower resolution and often appears blurry. In this paper, we focus on the problem of translating VHS video to HDTV video and have developed a solution based on a novel unsupervised multi-task adversarial learning model. Inspired by the success of generative adversarial network (GAN) and CycleGAN, we employ cycle consistency loss, adversarial loss and perceptual loss together to learn a translation model. An important innovation of our work is the incorporation of super-resolution model and color transfer model that can solve unsupervised multi-task problem. To our knowledge, this is the first work that dedicated to the study of the relation between VHS and HDTV and the first computational solution to translate VHS to HDTV. We present experimental results to demonstrate the effectiveness of our solution qualitatively and quantitatively.
引用
收藏
页码:77 / 86
页数:10
相关论文
共 50 条
  • [41] Probabilistic Multi-Task Learning for Visual Saliency Estimation in Video
    Jia Li
    Yonghong Tian
    Tiejun Huang
    Wen Gao
    [J]. International Journal of Computer Vision, 2010, 90 : 150 - 165
  • [42] ONLINE MULTI-TASK LEARNING FOR SEMANTIC CONCEPT DETECTION IN VIDEO
    Markatopoulou, Foteini
    Mezaris, Vasileios
    Patras, Ioannis
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 186 - 190
  • [43] Deep multi-task learning for image/video distortions identification
    Ameur, Zoubida
    Fezza, Sid Ahmed
    Hamidouche, Wassim
    [J]. NEURAL COMPUTING & APPLICATIONS, 2022, 34 (24): : 21607 - 21623
  • [44] MULTI-TASK LEARNING OF GENERALIZABLE REPRESENTATIONS FOR VIDEO ACTION RECOGNITION
    Yao, Zhiyu
    Wang, Yunbo
    Long, Mingsheng
    Wang, Jianmin
    Yu, Philip S.
    Sun, Jiaguang
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [45] Complex Question Answering on knowledge graphs using machine translation and multi-task learning
    Srivastava, Saurabh
    Patidar, Mayur
    Chowdhury, Sudip
    Agarwal, Puneet
    Bhattacharya, Indrajit
    Shroff, Gautam
    [J]. 16TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2021), 2021, : 3428 - 3439
  • [46] Multi-Task Learning Using Shared and Task Specific Information
    Srijith, P. K.
    Shevade, Shirish
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2012, PT III, 2012, 7665 : 125 - 132
  • [47] Detecting Adversarial Perturbations in Multi-Task Perception
    Klingner, Marvin
    Kumar, Varun Ravi
    Yogamani, Senthil
    Baer, Andreas
    Fingscheidt, Tim
    [J]. 2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 13050 - 13057
  • [48] Autocorrect in the Process of Translation- Multi-task Learning Improves Dialogue Machine Translation
    Wang, Tao
    Zhao, Chengqi
    Wang, Mingxuan
    Li, Lei
    Xiong, Deyi
    [J]. 2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, NAACL-HLT 2021, 2021, : 105 - 112
  • [49] Smart contracts vulnerability detection model based on adversarial multi-task learning
    Zhou, Kuo
    Huang, Jing
    Han, Honggui
    Gong, Bei
    Xiong, Ao
    Wang, Wei
    Wu, Qihui
    [J]. JOURNAL OF INFORMATION SECURITY AND APPLICATIONS, 2023, 77
  • [50] Adversarial Multi-Task Learning for Disentangling Timbre and Pitch in Singing Voice Synthesis
    Kim, Tae-Woo
    Kang, Min-Su
    Lee, Gyeong-Hoon
    [J]. INTERSPEECH 2022, 2022, : 3008 - 3012