Unsupervised Image-to-Image Translation: A Review

被引:0
|
作者
Hoyez, Henri [1 ,2 ]
Schockaert, Cedric [1 ]
Rambach, Jason [3 ]
Mirbach, Bruno [3 ]
Stricker, Didier [1 ,2 ]
机构
[1] Paul Wurth SA, L-1122 Luxembourg, Luxembourg
[2] Tech Univ Kaiserslautern, Dept Comp Sci, D-67663 Kaiserslautern, Germany
[3] German Res Ctr Artificial Intelligence DFKI, D-67663 Kaiserslautern, Germany
关键词
unsupervised image-to-image translation; machine learning; computer vision; deep learning; generative adversarial networks; review;
D O I
10.3390/s22218540
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Supervised image-to-image translation has been proven to generate realistic images with sharp details and to have good quantitative performance. Such methods are trained on a paired dataset, where an image from the source domain already has a corresponding translated image in the target domain. However, this paired dataset requirement imposes a huge practical constraint, requires domain knowledge or is even impossible to obtain in certain cases. Due to these problems, unsupervised image-to-image translation has been proposed, which does not require domain expertise and can take advantage of a large unlabeled dataset. Although such models perform well, they are hard to train due to the major constraints induced in their loss functions, which make training unstable. Since CycleGAN has been released, numerous methods have been proposed which try to address various problems from different perspectives. In this review, we firstly describe the general image-to-image translation framework and discuss the datasets and metrics involved in the topic. Furthermore, we revise the current state-of-the-art with a classification of existing works. This part is followed by a small quantitative evaluation, for which results were taken from papers.
引用
收藏
页数:27
相关论文
共 50 条
  • [41] Unsupervised Generative Adversarial Network for Plantar Pressure Image-to-Image Translation
    Ahmadian, Mona
    Beheshti, Mohammad T. H.
    Kalhor, Ahmad
    Shirian, Amir
    [J]. 2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 2580 - 2583
  • [42] Unsupervised image-to-image translation by semantics consistency and self-attention
    ZHANG Zhibin
    XUE Wanli
    FU Guokai
    [J]. Optoelectronics Letters, 2022, 18 (03) : 175 - 180
  • [43] Unsupervised image-to-image translation with multiscale attention generative adversarial network
    Wang, Fasheng
    Zhang, Qing
    Zhao, Qianyi
    Wang, Mengyin
    Sun, Fuming
    [J]. APPLIED INTELLIGENCE, 2024, 54 (08) : 6558 - 6578
  • [44] CR-UNIT: UNSUPERVISED IMAGE-TO-IMAGE TRANSLATION WITH CONTENT RECONSTRUCTION
    Shi, Xiao-Wen
    Wang, Yuan-Gen
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1165 - 1169
  • [45] Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation
    Tang, Hao
    Xu, Dan
    Sebel, Nicu
    Yan, Yan
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [46] Unsupervised Image-to-Image Translation with Stacked Cycle-Consistent Adversarial Networks
    Li, Minjun
    Huang, Haozhi
    Ma, Lin
    Liu, Wei
    Zhang, Tong
    Jiang, Yugang
    [J]. COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 : 186 - 201
  • [47] Conditional Image-to-Image translation
    Lin, Jianxin
    Xia, Yingce
    Qin, Tao
    Chen, Zhibo
    Liu, Tie-Yan
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 5524 - 5532
  • [48] Unsupervised image-to-image translation using intra-domain reconstruction loss
    Fan, Yuan
    Shao, Mingwen
    Zuo, Wangmeng
    Li, Qingyun
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2020, 11 (09) : 2077 - 2088
  • [49] Unsupervised Detection of Cancerous Regions in Histology Imagery using Image-to-Image Translation
    Stepec, Dejan
    Skocaj, Danijel
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 3780 - 3787
  • [50] AFF-UNIT: Adaptive feature fusion for unsupervised image-to-image translation
    Li, Yuqiang
    Meng, Haochen
    Lin, Hong
    Liu, Chun
    [J]. IET IMAGE PROCESSING, 2021, 15 (13) : 3172 - 3188