Few-shot Image Generation via Cross-domain Correspondence

被引:105
|
作者
Ojha, Utkarsh [1 ,2 ]
Li, Yijun [1 ]
Lu, Jingwan [1 ]
Efros, Alexei A. [1 ,3 ]
Lee, Yong Jae [2 ]
Shechtman, Eli [1 ]
Zhang, Richard [1 ]
机构
[1] Adobe Res, San Jose, CA 95110 USA
[2] Univ Calif Davis, Davis, CA 95616 USA
[3] Univ Calif Berkeley, Berkeley, CA USA
关键词
D O I
10.1109/CVPR46437.2021.01060
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Training generative models, such as GANs, on a target domain containing limited examples (e.g., 10) can easily result in overfitting. In this work, we seek to utilize a large source domain for pretraining and transfer the diversity information from source to target. We propose to preserve the relative similarities and differences between instances in the source via a novel cross-domain distance consistency loss. To further reduce overfitting, we present an anchor-based strategy to encourage different levels of realism over different regions in the latent space. With extensive results in both photorealistic and non-photorealistic domains, we demonstrate qualitatively and quantitatively that our few-shot model automatically discovers correspondences between source and target domains and generates more diverse and realistic images than previous methods.
引用
收藏
页码:10738 / 10747
页数:10
相关论文
共 50 条
  • [1] Rethinking cross-domain semantic relation for few-shot image generation
    Gou, Yao
    Li, Min
    Lv, Yilong
    Zhang, Yusen
    Xing, Yuhang
    He, Yujie
    [J]. APPLIED INTELLIGENCE, 2023, 53 (19) : 22391 - 22404
  • [2] Rethinking cross-domain semantic relation for few-shot image generation
    Yao Gou
    Min Li
    Yilong Lv
    Yusen Zhang
    Yuhang Xing
    Yujie He
    [J]. Applied Intelligence, 2023, 53 : 22391 - 22404
  • [3] Experiments in cross-domain few-shot learning for image classification
    Wang, Hongyu
    Gouk, Henry
    Fraser, Huon
    Frank, Eibe
    Pfahringer, Bernhard
    Mayo, Michael
    Holmes, Geoffrey
    [J]. JOURNAL OF THE ROYAL SOCIETY OF NEW ZEALAND, 2023, 53 (01) : 169 - 191
  • [4] Cross-Domain Few-Shot Graph Classification
    Hassani, Kaveh
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 6856 - 6864
  • [5] Cross-Domain Few-Shot Semantic Segmentation
    Lei, Shuo
    Zhang, Xuchao
    He, Jianfeng
    Chen, Fanglan
    Du, Bowen
    Lu, Chang-Tien
    [J]. COMPUTER VISION - ECCV 2022, PT XXX, 2022, 13690 : 73 - 90
  • [6] Understanding Cross-Domain Few-Shot Learning Based on Domain Similarity and Few-Shot Difficulty
    Oh, Jaehoon
    Kim, Sungnyun
    Ho, Namgyu
    Kim, Jin-Hwa
    Song, Hwanjun
    Yun, Se-Young
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [7] Deep Cross-Domain Few-Shot Learning for Hyperspectral Image Classification
    Li, Zhaokui
    Liu, Ming
    Chen, Yushi
    Xu, Yimin
    Li, Wei
    Du, Qian
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Cross-domain few-shot learning via adaptive transformer networks
    Paeedeh, Naeem
    Pratama, Mahardhika
    Ma'sum, Muhammad Anwar
    Mayer, Wolfgang
    Cao, Zehong
    Kowlczyk, Ryszard
    [J]. KNOWLEDGE-BASED SYSTEMS, 2024, 288
  • [9] Cross-Domain Few-Shot Classification via Adversarial Task Augmentation
    Wang, Haoqing
    Deng, Zhi-Hong
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1075 - 1081
  • [10] Cross-domain few-shot learning via adaptive transformer networks
    Paeedeh, Naeem
    Pratama, Mahardhika
    Ma'sum, Muhammad Anwar
    Mayer, Wolfgang
    Cao, Zehong
    Kowlczyk, Ryszard
    [J]. Knowledge-Based Systems, 2024, 288