Enhanced Unpaired Image-to-Image Translation via Transformation in Saliency Domain

被引:0
|
作者
Shibasaki, Kei [1 ]
Ikehara, Masaaki [1 ]
机构
[1] Keio Univ, Fac Sci & Technol, Dept Elect & Informat Engn, Yokohama, Kanagawa 2238522, Japan
来源
IEEE ACCESS | 2023年 / 11卷
关键词
Computer vision; Generative adversarial networks; Saliency detection; deep learning; unpaired image to image translation; generative adversarial networks; saliency domain;
D O I
10.1109/ACCESS.2023.3338629
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unpaired image to image translation is the task of converting images in unpaired datasets. The primary goal of the task is to translate a source image into the image aligned with the target domain while keeping the fundamental content. Existing researches have introduced effective techniques to translate images with unpaired datasets, focusing on preserving the fundamental content. However, these techniques have limitations in dealing with significant shape changes and preserving backgrounds that should not be transformed. The proposed method attempts to address these problems by utilizing the saliency domain for translation and simultaneously learning the translation in the saliency domain as well as in the image domain. The saliency domain represents the shape and position of the main object. The explicit learning of transformations within the saliency domain improves network's ability to transform shapes while maintaining the background. Experimental results show that the proposed method successfully addresses the problems of unpaired image to image translation and achieves competitive metrics with existing methods.
引用
收藏
页码:137495 / 137505
页数:11
相关论文
共 50 条
  • [41] GAN-based unpaired image-to-image translation for maritime imagery
    Mediavilla, Chelsea
    Sato, Jonathan
    Manzanares, Mitch
    Dotter, Marissa
    Parameswaran, Shibin
    GEOSPATIAL INFORMATICS X, 2020, 11398
  • [42] Unpaired image-to-image translation with improved two-dimensional feature
    Tu, Hangyao
    Wang, Wanliang
    Chen, Jiachen
    Wu, Fei
    Li, Guoqing
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (30) : 43851 - 43872
  • [43] Trans-Cycle: Unpaired Image-to-Image Translation Network by Transformer
    Tian, Kai
    Pan, Mengze
    Lu, Zongqing
    Liao, Qingmin
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VI, 2023, 14259 : 576 - 587
  • [44] Background-focused contrastive learning for unpaired image-to-image translation
    Shao, Mingwen
    Han, Minggui
    Meng, Lingzhuang
    Liu, Fukang
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (04)
  • [45] UNPAIRED IMAGE-TO-IMAGE TRANSLATION WITH LIMITED DATA TO REVEAL SUBTLE PHENOTYPES
    Bourou, Anis
    Daupin, Kevin
    Dubreuil, Veronique
    De Thonel, Aurelie
    Mezger-Lallemand, Valerie
    Genovesio, Auguste
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [46] Exploring Double Cross Cyclic Interpolation in Unpaired Image-to-Image Translation
    Lopez, Jorge
    Mauricio, Antoni
    Camara, Guillermo
    2019 32ND SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2019, : 124 - 130
  • [47] Unpaired Image-to-Image Translation Using Negative Learning for Noisy Patches
    Hung, Yu-Hsiang
    Tan, Julianne
    Huang, Tai-Ming
    Hsu, Shang-Che
    Chen, Yi-Ling
    Hua, Kai-Lung
    IEEE MULTIMEDIA, 2022, 29 (04) : 59 - 68
  • [48] Learning Image-to-Image Translation Using Paired and Unpaired Training Samples
    Tripathy, Soumya
    Kannala, Juho
    Rahtu, Esa
    COMPUTER VISION - ACCV 2018, PT II, 2019, 11362 : 51 - 66
  • [49] Cross-Domain Infrared Image Classification via Image-to-Image Translation and Deep Domain Generalization
    Guo, Zhao-Rui
    Niu, Jia-Wei
    Liu, Zhun-Ga
    2022 17TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV), 2022, : 487 - 493
  • [50] Mutually Improved Endoscopic Image Synthesis and Landmark Detection in Unpaired Image-to-Image Translation
    Sharan, Lalith
    Romano, Gabriele
    Koehler, Sven
    Kelm, Halvar
    Karck, Matthias
    De Simone, Raffaele
    Engelhardt, Sandy
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (01) : 127 - 138