Enhanced Unpaired Image-to-Image Translation via Transformation in Saliency Domain

被引:0
|
作者
Shibasaki, Kei [1 ]
Ikehara, Masaaki [1 ]
机构
[1] Keio Univ, Fac Sci & Technol, Dept Elect & Informat Engn, Yokohama, Kanagawa 2238522, Japan
来源
IEEE ACCESS | 2023年 / 11卷
关键词
Computer vision; Generative adversarial networks; Saliency detection; deep learning; unpaired image to image translation; generative adversarial networks; saliency domain;
D O I
10.1109/ACCESS.2023.3338629
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unpaired image to image translation is the task of converting images in unpaired datasets. The primary goal of the task is to translate a source image into the image aligned with the target domain while keeping the fundamental content. Existing researches have introduced effective techniques to translate images with unpaired datasets, focusing on preserving the fundamental content. However, these techniques have limitations in dealing with significant shape changes and preserving backgrounds that should not be transformed. The proposed method attempts to address these problems by utilizing the saliency domain for translation and simultaneously learning the translation in the saliency domain as well as in the image domain. The saliency domain represents the shape and position of the main object. The explicit learning of transformations within the saliency domain improves network's ability to transform shapes while maintaining the background. Experimental results show that the proposed method successfully addresses the problems of unpaired image to image translation and achieves competitive metrics with existing methods.
引用
收藏
页码:137495 / 137505
页数:11
相关论文
共 50 条
  • [1] Underwater Image Dehazing via Unpaired Image-to-image Translation
    Cho, Younggun
    Jang, Hyesu
    Malav, Ramavtar
    Pandey, Gaurav
    Kim, Ayoung
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2020, 18 (03) : 605 - 614
  • [2] Underwater Image Dehazing via Unpaired Image-to-image Translation
    Younggun Cho
    Hyesu Jang
    Ramavtar Malav
    Gaurav Pandey
    Ayoung Kim
    International Journal of Control, Automation and Systems, 2020, 18 : 605 - 614
  • [3] Domain Bridge for Unpaired Image-to-Image Translation and Unsupervised Domain Adaptation
    Pizzati, Fabio
    de Charette, Raoul
    Zaccaria, Michela
    Cerri, Pietro
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2979 - 2987
  • [4] Cross-Domain Interpolation for Unpaired Image-to-Image Translation
    Lopez, Jorge
    Mauricio, Antoni
    Diaz, Jose
    Camara, Guillermo
    COMPUTER VISION SYSTEMS (ICVS 2019), 2019, 11754 : 542 - 551
  • [5] Holographic reconstruction enhancement via unpaired image-to-image translation
    Scherrer, Romane
    Selmaoui-folcher, Nazha
    Quiniou, Thomas
    Jauffrais, Thierry
    Lemonnier, Hugues
    Bonnet, Sophie
    APPLIED OPTICS, 2022, 61 (33) : 9807 - 9816
  • [6] Unpaired Image-to-Image Translation via Latent Energy Transport
    Zhao, Yang
    Chen, Changyou
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 16413 - 16422
  • [7] UNPAIRED IMAGE-TO-IMAGE TRANSLATION BASED DOMAIN ADAPTATION FOR POLYP SEGMENTATION
    Xiong, Xinyu
    Li, Siying
    Li, Guanbin
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [8] Random Reconstructed Unpaired Image-to-Image Translation
    Zhang, Xiaoqin
    Fan, Chenxiang
    Xiao, Zhiheng
    Zhao, Li
    Chen, Huiling
    Chang, Xiaojun
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (03) : 3144 - 3154
  • [9] Unpaired image-to-image translation of structural damage
    Varghese, Subin
    Hoskere, Vedhus
    ADVANCED ENGINEERING INFORMATICS, 2023, 56
  • [10] Avoiding Shortcuts in Unpaired Image-to-Image Translation
    Fontanini, Tomaso
    Botti, Filippo
    Bertozzi, Massimo
    Prati, Andrea
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT I, 2022, 13231 : 463 - 475