Unpaired image-to-image translation with improved two-dimensional feature

被引:0
|
作者
Hangyao Tu
Wanliang Wang
Jiachen Chen
Fei Wu
Guoqing Li
机构
[1] College of Computer Science and Technology,
[2] ZheJiang University of Technology,undefined
来源
关键词
Image translation; Generative adversarial network; Feature extraction; Feature fusion;
D O I
暂无
中图分类号
学科分类号
摘要
With the feature-level constraints, unpaired image translation is challenging in generating poor realistic images, which focuses on convolutional feature extraction, ignoring the SVD feature extraction. To address this limitation, the Unpaired Image-to-image Translation with Improved Two-dimensional Feature (UNTF) is proposed. Specifically, in our method the novel feature extraction module consists two part: the SVD feature extraction and the convolutional feature extraction. The SVD feature maps were built by Two-Dimensional Feature which transform 1-D features into 2-D features to cascade with convolutional features. In up-sampling module sub-pixel convolution is used to replace transposed convolution. What’s more, the proposed feature loss can stabilize the training process of generator. Finally, the proposed network was verified by ablation study and state-of-the-art methods. Experiments on image translation, image illustration, and image restoration show that both the image clarity index (EGF) and experts agree that the proposed method is superior to the existing methods.
引用
收藏
页码:43851 / 43872
页数:21
相关论文
共 50 条
  • [1] Unpaired image-to-image translation with improved two-dimensional feature
    Tu, Hangyao
    Wang, Wanliang
    Chen, Jiachen
    Wu, Fei
    Li, Guoqing
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (30) : 43851 - 43872
  • [2] Multi-feature contrastive learning for unpaired image-to-image translation
    Yao Gou
    Min Li
    Yu Song
    Yujie He
    Litao Wang
    [J]. Complex & Intelligent Systems, 2023, 9 : 4111 - 4122
  • [3] Multi-feature contrastive learning for unpaired image-to-image translation
    Gou, Yao
    Li, Min
    Song, Yu
    He, Yujie
    Wang, Litao
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (04) : 4111 - 4122
  • [4] Unpaired image-to-image translation of structural damage
    Varghese, Subin
    Hoskere, Vedhus
    [J]. ADVANCED ENGINEERING INFORMATICS, 2023, 56
  • [5] Avoiding Shortcuts in Unpaired Image-to-Image Translation
    Fontanini, Tomaso
    Botti, Filippo
    Bertozzi, Massimo
    Prati, Andrea
    [J]. IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT I, 2022, 13231 : 463 - 475
  • [6] Random Reconstructed Unpaired Image-to-Image Translation
    Zhang, Xiaoqin
    Fan, Chenxiang
    Xiao, Zhiheng
    Zhao, Li
    Chen, Huiling
    Chang, Xiaojun
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (03) : 3144 - 3154
  • [7] Asymmetric GAN for Unpaired Image-to-Image Translation
    Li, Yu
    Tang, Sheng
    Zhang, Rui
    Zhang, Yongdong
    Li, Jintao
    Yan, Shuicheng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (12) : 5881 - 5896
  • [8] Mutually Improved Endoscopic Image Synthesis and Landmark Detection in Unpaired Image-to-Image Translation
    Sharan, Lalith
    Romano, Gabriele
    Koehler, Sven
    Kelm, Halvar
    Karck, Matthias
    De Simone, Raffaele
    Engelhardt, Sandy
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (01) : 127 - 138
  • [9] Underwater Image Dehazing via Unpaired Image-to-image Translation
    Cho, Younggun
    Jang, Hyesu
    Malav, Ramavtar
    Pandey, Gaurav
    Kim, Ayoung
    [J]. INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2020, 18 (03) : 605 - 614
  • [10] Underwater Image Dehazing via Unpaired Image-to-image Translation
    Younggun Cho
    Hyesu Jang
    Ramavtar Malav
    Gaurav Pandey
    Ayoung Kim
    [J]. International Journal of Control, Automation and Systems, 2020, 18 : 605 - 614