Unpaired image-to-image translation with improved two-dimensional feature

被引:0
|
作者
Hangyao Tu
Wanliang Wang
Jiachen Chen
Fei Wu
Guoqing Li
机构
[1] College of Computer Science and Technology,
[2] ZheJiang University of Technology,undefined
来源
关键词
Image translation; Generative adversarial network; Feature extraction; Feature fusion;
D O I
暂无
中图分类号
学科分类号
摘要
With the feature-level constraints, unpaired image translation is challenging in generating poor realistic images, which focuses on convolutional feature extraction, ignoring the SVD feature extraction. To address this limitation, the Unpaired Image-to-image Translation with Improved Two-dimensional Feature (UNTF) is proposed. Specifically, in our method the novel feature extraction module consists two part: the SVD feature extraction and the convolutional feature extraction. The SVD feature maps were built by Two-Dimensional Feature which transform 1-D features into 2-D features to cascade with convolutional features. In up-sampling module sub-pixel convolution is used to replace transposed convolution. What’s more, the proposed feature loss can stabilize the training process of generator. Finally, the proposed network was verified by ablation study and state-of-the-art methods. Experiments on image translation, image illustration, and image restoration show that both the image clarity index (EGF) and experts agree that the proposed method is superior to the existing methods.
引用
收藏
页码:43851 / 43872
页数:21
相关论文
共 50 条
  • [21] UMGAN: Underwater Image Enhancement Network for Unpaired Image-to-Image Translation
    Sun, Boyang
    Mei, Yupeng
    Yan, Ni
    Chen, Yingyi
    [J]. JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (02)
  • [22] IMAGE DATA AUGMENTATION WITH UNPAIRED IMAGE-TO-IMAGE CAMERA MODEL TRANSLATION
    Foo, Chi Fa
    Winkler, Stefan
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 3246 - 3250
  • [23] UNPAIRED IMAGE-TO-IMAGE TRANSLATION FROM SHARED DEEP SPACE
    Wu, Xuehui
    Shao, Jie
    Gao, Lianli
    Shen, Heng Tao
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 2127 - 2131
  • [24] Augmented Cyclic Consistency Regularization for Unpaired Image-to-Image Translation
    Ohkawa, Takehiko
    Inoue, Naoto
    Kataoka, Hirokatsu
    Inoue, Nakamasa
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 362 - 369
  • [25] Holographic reconstruction enhancement via unpaired image-to-image translation
    Scherrer, Romane
    Selmaoui-folcher, Nazha
    Quiniou, Thomas
    Jauffrais, Thierry
    Lemonnier, Hugues
    Bonnet, Sophie
    [J]. APPLIED OPTICS, 2022, 61 (33) : 9807 - 9816
  • [26] Homomorphic Latent Space Interpolation for Unpaired Image-To-Image Translation
    Chen, Ying-Cong
    Xu, Xiaogang
    Tian, Zhuotao
    Jia, Jiaya
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2403 - 2411
  • [27] UNPAIRED IMAGE-TO-IMAGE SHAPE TRANSLATION ACROSS FASHION DATA
    Wang, Kaili
    Ma, Liqian
    Oramas, Jose M.
    Van Gool, Luc
    Tuytelaars, Tinne
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 206 - 210
  • [28] Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image Translation
    Lin, Yupei
    Zhang, Sen
    Chen, Tianshui
    Lu, Yongyi
    Li, Guangping
    Shi, Yukai
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1186 - 1194
  • [29] Rethinking the Paradigm of Content Constraints in Unpaired Image-to-Image Translation
    Cai, Xiuding
    Zhu, Yaoyao
    Miao, Dong
    Fu, Linjie
    Yao, Yu
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 891 - 899
  • [30] One-to-one Mapping for Unpaired Image-to-image Translation
    Shen, Zengming
    Chen, Yifan
    Huang, Thomas S.
    Zhou, S. Kevin
    Georgescu, Bogdan
    Liu, Xuqi
    [J]. 2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 1159 - 1168