Dual Adversarial Adaptation for Cross-Device Real-World Image Super-Resolution

被引:1
|
作者
Xu, Xiaoqian [1 ]
Wei, Pengxu [1 ]
Chen, Weikai [2 ]
Liu, Yang [1 ]
Mao, Mingzhi [1 ]
Lin, Liang [1 ]
Li, Guanbin [1 ]
机构
[1] Sun Yat Sen Univ, Guangzhou, Peoples R China
[2] Tencent Amer, Palo Alto, CA USA
关键词
D O I
10.1109/CVPR52688.2022.00558
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the sophisticated imaging process, an identical scene captured by different cameras could exhibit distinct imaging patterns, introducing distinct proficiency among the super-resolution (SR) models trained on images from different devices. In this paper, we investigate a novel and practical task coded cross-device SR, which strives to adapt a real-world SR model trained on the paired images captured by one camera to low-resolution (LR) images captured by arbitrary target devices. The proposed task is highly challenging due to the absence of paired data from various imaging devices. To address this issue, we propose an unsupervised domain adaptation mechanism for real-world SR, named Dual ADversarial Adaptation (DADA), which only requires LR images in the target domain with available real paired data from a source camera. DADA employs the Domain-Invariant Attention (DIA) module to establish the basis of target model training even without HR supervision. Furthermore, the dual framework of DADA facilitates an Inter-domain Adversarial Adaptation (InterAA) in one branch for two LR input images from two domains, and an Intra-domain Adversarial Adaptation (IntraAA) in two branches for an LR input image. InterAA and IntraAA together improve the model transferability from the source domain to the target. We empirically conduct experiments under six Real -> Real adaptation settings among three different cameras, and achieve superior performance compared with existing state-of-the-art approaches. We also evaluate the proposed DADA to address the adaptation to the video camera, which presents a promising research topic to promote the wide applications of real-world super-resolution. Our source code is publicly available at https://github.com/lonelyhope/DADA.
引用
收藏
页码:5657 / 5666
页数:10
相关论文
共 50 条
  • [1] Robust Real-World Image Super-Resolution against Adversarial Attacks
    Yue, Jiutao
    Li, Haofeng
    Wei, Pengxu
    Li, Guanbin
    Lin, Liang
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 5148 - 5157
  • [2] Real-World Image Super-Resolution by Exclusionary Dual-Learning
    Li, Hao
    Qin, Jinghui
    Yang, Zhijing
    Wei, Pengxu
    Pan, Jinshan
    Lin, Liang
    Shi, Yukai
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 4752 - 4763
  • [3] Real-World Thermal Image Super-Resolution
    Allahham, Moaaz
    Aakerberg, Andreas
    Nasrollahi, Kamal
    Moeslund, Thomas B.
    [J]. ADVANCES IN VISUAL COMPUTING (ISVC 2021), PT I, 2021, 13017 : 3 - 14
  • [4] Multiscale generative adversarial network for real-world super-resolution
    Sun, Ying
    Yang, Zhiwen
    Tao, Bo
    Jiang, Guozhang
    Hao, Zhiqiang
    Chen, Baojia
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (21):
  • [5] Generalized Real-World Super-Resolution through Adversarial Robustness
    Castillo, Angela
    Escobar, Maria
    Perez, Juan C.
    Romero, Andres
    Timofte, Radu
    Van Gool, Luc
    Arbelaez, Pablo
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 1855 - 1865
  • [6] Real-World Super-Resolution using Generative Adversarial Networks
    Ren, Haoyu
    Kheradmand, Amin
    El-Khamy, Mostafa
    Wang, Shuangquan
    Bai, Dongwoon
    Lee, Jungwon
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 1760 - 1768
  • [7] Unsupervised Real-World Super-Resolution: A Domain Adaptation Perspective
    Wang, Wei
    Zhang, Haochen
    Yuan, Zehuan
    Wang, Changhu
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4298 - 4307
  • [8] TSRGAN: Real-world text image super-resolution based on adversarial learning and triplet attention
    Fang, Chuantao
    Zhu, Yu
    Liao, Lei
    Ling, Xiaofeng
    [J]. NEUROCOMPUTING, 2021, 455 : 88 - 96
  • [9] Dynamic degradation learning for real-world image super-resolution
    Chunxiao Fan
    Qiong Wu
    Xiang Ye
    [J]. Signal, Image and Video Processing, 2023, 17 : 315 - 322
  • [10] Dynamic degradation learning for real-world image super-resolution
    Fan, Chunxiao
    Wu, Qiong
    Ye, Xiang
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (02) : 315 - 322