Edge-guided Adversarial Network Based on Contrastive Learning for Image-to-Image Translation

被引:0
|
作者
Zhu, Chen [1 ]
Lai, Ru [1 ]
Bi, Luzheng [2 ]
Wang, Xuyang [1 ]
Du, Jiarong [1 ]
机构
[1] Beijing Inst Technol, Sch Automat, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Sch Mech Engn, Beijing 100081, Peoples R China
关键词
Generative adversarial network; Image-to-Image translation; Contrastive learning; Edge detection;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, generative adversarial networks have made great progress in image synthesis and image translation tasks in the field of image processing and computer vision. However, the quality of the generated image and the scalability over multiple datasets is still not satisfying. We briefly review some prior works and propose a method for image-to-image translation, which is learning a mapping between different visual domains. The network extracts edge feature from both domains of output and target, and minimizes the difference using a framework based on patchwise contrastive learning. We apply edge feature guidance in our method and select Sobel operator among several classical edge detection operators. We demonstrate that our method outperforms existing approaches in the task of unpaired image-to-image translation across datasets.
引用
收藏
页码:7949 / 7954
页数:6
相关论文
共 50 条
  • [1] Perceptual Contrastive Generative Adversarial Network based on image warping for unsupervised image-to-image translation
    Huang, Lin-Chieh
    Tsai, Hung-Hsu
    [J]. NEURAL NETWORKS, 2023, 166 : 313 - 325
  • [2] Edge-Guided Generative Adversarial Network for Image Inpainting
    Xu, Shunxin
    Liu, Dong
    Xiong, Zhiwei
    [J]. 2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2017,
  • [3] Contrastive learning for unsupervised image-to-image translation
    Lee, Hanbit
    Seol, Jinseok
    Lee, Sang-goo
    Park, Jaehui
    Shim, Junho
    [J]. APPLIED SOFT COMPUTING, 2024, 151
  • [4] Equivariant Adversarial Network for Image-to-image Translation
    Zareapoor, Masoumeh
    Yang, Jie
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (02)
  • [5] Segmentation Guided Image-to-Image Translation with Adversarial Networks
    Jiang, Songyao
    Tao, Zhiqiang
    Fu, Yun
    [J]. 2019 14TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2019), 2019, : 518 - 524
  • [6] Dual Contrastive Learning for Unsupervised Image-to-Image Translation
    Han, Junlin
    Shoeiby, Mehrdad
    Petersson, Lars
    Armin, Mohammad Ali
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 746 - 755
  • [7] Theoretical Analysis of Image-to-Image Translation with Adversarial Learning
    Pan, Xudong
    Zhang, Mi
    Ding, Daizong
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [8] Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image Translation
    Lin, Yupei
    Zhang, Sen
    Chen, Tianshui
    Lu, Yongyi
    Li, Guangping
    Shi, Yukai
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1186 - 1194
  • [9] Truly Unsupervised Image-to-Image Translation with Contrastive Representation Learning
    Hong, Zhiwei
    Feng, Jianxing
    Jiang, Tao
    [J]. COMPUTER VISION - ACCV 2022, PT III, 2023, 13843 : 239 - 255
  • [10] Knowledge Distillation Generative Adversarial Network for Image-to-Image Translation
    Sub-r-pa, Chayanon
    Chen, Rung-Ching
    [J]. JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2024, 15 (08) : 896 - 902