Image-to-Image Translation on Defined Highlighting Regions by Semi-Supervised Semantic Segmentation

被引:0
|
作者
Chang, Ching-Yu [1 ]
Ye, Chun-Ting [1 ]
Wei, Tzer-Jen [1 ]
机构
[1] Natl Yang Ming Chiao Tung Univ NYCU, Coll Artificial Intelligence, Tainan, Taiwan
关键词
D O I
10.1109/IJCNN54540.2023.10191189
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image-to-image translations made remarkable performance in Generative Adversarial Network (GAN). While recent advances are easily generated a high-quality synthesized images, it usually remains a problem to recognize complicated scenarios. We believe that a few human annotations can greatly reduce the problems. In this paper, we propose Highlight-IT, which generates synthesized images and its corresponding pixellevel semantic segmentation. In addition, segmentation can be viewed as a strong prior and guide our framework to focus on human-defined important regions. In evaluation, we experiment with various categories of unlabeled and labeled datasets. The results show that our method achieves the quality of images of the state-of-the-art framework and also the performance of the famous semantic segmentation framework. In the end, we demonstrate the qualitative results of our work and the approaches proposed by others.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Multimodal and Multiclass Semi-supervised Image-to-Image Translation
    Bai, Jing
    Chen, Ran
    Ji, Hui
    Li, Saisai
    [J]. IMAGE AND GRAPHICS, ICIG 2019, PT III, 2019, 11903 : 503 - 514
  • [2] Extremely Weak Supervised Image-to-Image Translation for Semantic Segmentation
    Shukla, Samarth
    Van Gool, Luc
    Timofte, Radu
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3368 - 3377
  • [3] Semi-Supervised Image-to-Image Translation for Lane Detection in Rain
    Wang, Jian-Gang
    Wan, Kong-Wah
    Pang, Chun-Ho
    Yau, Wei-Yun
    [J]. 2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 118 - 123
  • [4] Semi-supervised Learning for Few-shot Image-to-Image Translation
    Wang, Yaxing
    Khan, Salman
    Gonzalez-Garcia, Abel
    van de Weijer, Joost
    Khan, Fahad Shahbaz
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4452 - 4461
  • [5] A Semi-Supervised Image-to-Image Translation Framework for SAR-Optical Image Matching
    Du, Wen-Liang
    Zhou, Yong
    Zhu, Hancheng
    Zhao, Jiaqi
    Shao, Zhiwen
    Tian, Xiaolin
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [6] Scenimefy: Learning to Craft Anime Scene via Semi-Supervised Image-to-Image Translation
    Jiang, Yuxin
    Jiang, Liming
    Yang, Shuai
    Loy, Chen Change
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 7323 - 7333
  • [7] Semi-supervised Image Segmentation
    Lazarova, Gergana Angelova
    [J]. ARTIFICIAL INTELLIGENCE: METHODOLOGY, SYSTEMS, AND APPLICATIONS, 2014, 8722 : 59 - 68
  • [8] Linear semantic transformation for semi-supervised medical image segmentation
    Chen C.
    Chen Y.
    Li X.
    Ning H.
    Xiao R.
    [J]. Computers in Biology and Medicine, 2024, 173
  • [9] Joint task semi-supervised semantic segmentation for TRUS image
    Gao, Chao
    Shi, Yongtao
    Zhou, Chang
    Lei, Bangjun
    Mukondiwa, Daisy Thembelihle
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 88
  • [10] SemiStarGAN: Semi-supervised Generative Adversarial Networks for Multi-domain Image-to-Image Translation
    Hsu, Shu-Yu
    Yang, Chih-Yuan
    Huang, Chi-Chia
    Hsu, Jane Yung-jen
    [J]. COMPUTER VISION - ACCV 2018, PT IV, 2019, 11364 : 338 - 353