Unpaired image-to-image translation with improved two-dimensional feature

被引:2
|
作者
Tu, Hangyao [1 ]
Wang, Wanliang [1 ]
Chen, Jiachen [1 ]
Wu, Fei [1 ]
Li, Guoqing [1 ]
机构
[1] ZheJiang Univ Technol, Coll Comp Sci & Technol, Hangzhou 310015, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Image translation; Generative adversarial network; Feature extraction; Feature fusion; CYCLEGAN; FUSION;
D O I
10.1007/s11042-022-13115-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the feature-level constraints, unpaired image translation is challenging in generating poor realistic images, which focuses on convolutional feature extraction, ignoring the SVD feature extraction. To address this limitation, the Unpaired Image-to-image Translation with Improved Two-dimensional Feature (UNTF) is proposed. Specifically, in our method the novel feature extraction module consists two part: the SVD feature extraction and the convolutional feature extraction. The SVD feature maps were built by Two-Dimensional Feature which transform 1-D features into 2-D features to cascade with convolutional features. In up-sampling module sub-pixel convolution is used to replace transposed convolution. What's more, the proposed feature loss can stabilize the training process of generator. Finally, the proposed network was verified by ablation study and state-of-the-art methods. Experiments on image translation, image illustration, and image restoration show that both the image clarity index (EGF) and experts agree that the proposed method is superior to the existing methods.
引用
收藏
页码:43851 / 43872
页数:22
相关论文
共 50 条
  • [1] Unpaired image-to-image translation with improved two-dimensional feature
    Hangyao Tu
    Wanliang Wang
    Jiachen Chen
    Fei Wu
    Guoqing Li
    [J]. Multimedia Tools and Applications, 2022, 81 : 43851 - 43872
  • [2] Multi-feature contrastive learning for unpaired image-to-image translation
    Yao Gou
    Min Li
    Yu Song
    Yujie He
    Litao Wang
    [J]. Complex & Intelligent Systems, 2023, 9 : 4111 - 4122
  • [3] Multi-feature contrastive learning for unpaired image-to-image translation
    Gou, Yao
    Li, Min
    Song, Yu
    He, Yujie
    Wang, Litao
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (04) : 4111 - 4122
  • [4] Random Reconstructed Unpaired Image-to-Image Translation
    Zhang, Xiaoqin
    Fan, Chenxiang
    Xiao, Zhiheng
    Zhao, Li
    Chen, Huiling
    Chang, Xiaojun
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (03) : 3144 - 3154
  • [5] Unpaired image-to-image translation of structural damage
    Varghese, Subin
    Hoskere, Vedhus
    [J]. ADVANCED ENGINEERING INFORMATICS, 2023, 56
  • [6] Avoiding Shortcuts in Unpaired Image-to-Image Translation
    Fontanini, Tomaso
    Botti, Filippo
    Bertozzi, Massimo
    Prati, Andrea
    [J]. IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT I, 2022, 13231 : 463 - 475
  • [7] Asymmetric GAN for Unpaired Image-to-Image Translation
    Li, Yu
    Tang, Sheng
    Zhang, Rui
    Zhang, Yongdong
    Li, Jintao
    Yan, Shuicheng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (12) : 5881 - 5896
  • [8] Mutually Improved Endoscopic Image Synthesis and Landmark Detection in Unpaired Image-to-Image Translation
    Sharan, Lalith
    Romano, Gabriele
    Koehler, Sven
    Kelm, Halvar
    Karck, Matthias
    De Simone, Raffaele
    Engelhardt, Sandy
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (01) : 127 - 138
  • [9] Underwater Image Dehazing via Unpaired Image-to-image Translation
    Cho, Younggun
    Jang, Hyesu
    Malav, Ramavtar
    Pandey, Gaurav
    Kim, Ayoung
    [J]. INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2020, 18 (03) : 605 - 614
  • [10] CycleSAR: SAR Image Despeckling as Unpaired Image-to-Image Translation
    Lattari, Francesco
    Santomarco, Vincenzo
    Santambrogio, Riccardo
    Rucci, Alessio
    Matteucci, Matteo
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,