VHS to HDTV Video Translation Using Multi-task Adversarial Learning

被引:1
|
作者
Luo, Hongming [1 ,2 ,3 ,4 ]
Liao, Guangsen [1 ,2 ,3 ,4 ]
Hou, Xianxu [1 ,2 ,3 ,4 ]
Liu, Bozhi [1 ,2 ,3 ,4 ]
Zhou, Fei [1 ,2 ,3 ,4 ]
Qiu, Guoping [1 ,2 ,3 ,4 ,5 ]
机构
[1] Shenzhen Univ, Coll Elect & Informat Engn, Shenzhen, Peoples R China
[2] Guangdong Key Lab Intelligent Informat Proc, Shenzhen, Peoples R China
[3] Guangdong Lab Artificial Intelligence & Digital E, Shenzhen, Peoples R China
[4] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen, Peoples R China
[5] Univ Nottingham, Sch Comp Sci, Nottingham, England
来源
关键词
VHS; HDTV; Video translation; Multi-task learning; Unsupervised; GAN;
D O I
10.1007/978-3-030-37731-1_7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There are large amount of valuable video archives in Video Home System (VHS) format. However, due to the analog nature, their quality is often poor. Compared to High-definition television (HDTV), VHS video not only has a dull color appearance but also has a lower resolution and often appears blurry. In this paper, we focus on the problem of translating VHS video to HDTV video and have developed a solution based on a novel unsupervised multi-task adversarial learning model. Inspired by the success of generative adversarial network (GAN) and CycleGAN, we employ cycle consistency loss, adversarial loss and perceptual loss together to learn a translation model. An important innovation of our work is the incorporation of super-resolution model and color transfer model that can solve unsupervised multi-task problem. To our knowledge, this is the first work that dedicated to the study of the relation between VHS and HDTV and the first computational solution to translate VHS to HDTV. We present experimental results to demonstrate the effectiveness of our solution qualitatively and quantitatively.
引用
收藏
页码:77 / 86
页数:10
相关论文
共 50 条
  • [21] Deep Multi-Task Learning with Adversarial-and-Cooperative Nets
    Yang, Pei
    Tan, Qi
    Ye, Jieping
    Tong, Hanghang
    He, Jingrui
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 4078 - 4084
  • [22] A Unified Multi-task Adversarial Learning Framework for Pharmacovigilance Mining
    Yadav, Shweta
    Ekbal, Asif
    Saha, Sriparna
    Bhattacharyya, Pushpak
    [J]. 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 5234 - 5245
  • [23] Adversarial Learning for Multi-Task Sequence Labeling With Attention Mechanism
    Wang, Yu
    Li, Yun
    Zhu, Ziye
    Tong, Hanghang
    Huang, Yue
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2020, 28 : 2476 - 2488
  • [24] Enhancing Relation Extraction via Adversarial Multi-task Learning
    Qin, Han
    Tian, Yuanhe
    Song, Yan
    [J]. LREC 2022: THIRTEEN INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2022, : 6190 - 6199
  • [25] ADVERSARIAL MULTI-TASK LEARNING FOR SPEAKER NORMALIZATION IN REPLAY DETECTION
    Suthokumar, Gajan
    Sethu, Vidhyasaharan
    Sriskandaraja, Kaavya
    Ambikairajah, Eliathamby
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 6609 - 6613
  • [26] Adversarial multi-task learning with inverse mapping for speech enhancement
    Qiu, Yuanhang
    Wang, Ruili
    Hou, Feng
    Singh, Satwinder
    Ma, Zhizhong
    Jia, Xiaoyun
    [J]. APPLIED SOFT COMPUTING, 2022, 120
  • [27] Multi-Task Learning for Video Surveillance with Limited Data
    Doshi, Keval
    Yilmaz, Yasin
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 3888 - 3898
  • [28] Multi-label emotion classification based on adversarial multi-task learning
    Lin, Nankai
    Fu, Sihui
    Lin, Xiaotian
    Wang, Lianxi
    [J]. INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (06)
  • [29] Multi-task gradient descent for multi-task learning
    Lu Bai
    Yew-Soon Ong
    Tiantian He
    Abhishek Gupta
    [J]. Memetic Computing, 2020, 12 : 355 - 369
  • [30] Multi-task gradient descent for multi-task learning
    Bai, Lu
    Ong, Yew-Soon
    He, Tiantian
    Gupta, Abhishek
    [J]. MEMETIC COMPUTING, 2020, 12 (04) : 355 - 369