Text to Image Translation using Generative Adversarial Networks

被引:0
|
作者
Viswanathan, Adithya [1 ]
Mehta, Bhavin [1 ]
Bhavatarini, M. P. [1 ]
Mamatha, H. R. [2 ]
机构
[1] PES Inst Technol, Informat Sci & Engn, Bengaluru, India
[2] PES Univ, Comp Sci & Engn, Bengaluru, India
关键词
Generative Adversarial Networks; GANs; Convolutional Neural Networks; Recurrent Neural Networks; text to image; CNN Encoder; RNN Encoder; Discriminator; Generator;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The learning process becomes easier when one can visualize the things being spoken about or being described. To help a person visualize, the description in the form of text which the person gives can be translated to a set of images, this is achieved by a Generative-Adversarial Model. A novel implementation for translating description to images using Generative Adversarial networks is proposed in this paper. We propose a RNN-CNN text encoding along with the Generator and Discriminator network to take the text description of flowers as the input and the resultant output would be a set of unique images generated which match the description for the same. The dataset primarily used is the Oxford 102flowers dataset along with its captions procured from the Oxford University website. It has 102 categories of flowers with each category consisting of a minimum of 40 images.
引用
收藏
页码:1468 / 1474
页数:7
相关论文
共 50 条
  • [21] LEVERAGING IMAGE-TO-IMAGE TRANSLATION GENERATIVE ADVERSARIAL NETWORKS FOR FACE AGING
    Pantraki, Evangelia
    Kotropoulos, Constantine
    Lanitis, Andreas
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 8370 - 8374
  • [22] Generative Adversarial Text to Image Synthesis
    Reed, Scott
    Akata, Zeynep
    Yan, Xinchen
    Logeswaran, Lajanugen
    Schiele, Bernt
    Lee, Honglak
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [23] AttentionGAN: Unpaired Image-to-Image Translation Using Attention-Guided Generative Adversarial Networks
    Tang, Hao
    Liu, Hong
    Xu, Dan
    Torr, Philip H. S.
    Sebe, Nicu
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (04) : 1972 - 1987
  • [24] In2I: Unsupervised Multi-Image-to-Image Translation Using Generative Adversarial Networks
    Perera, Pramuditha
    Abavisani, Mahdi
    Patel, Vishal M.
    [J]. 2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 140 - 146
  • [25] Image-to-Image Translation using a Relativistic Generative Adversarial Network
    Xing, Xingrun
    Zhang, Dawei
    [J]. ELEVENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2019), 2019, 11179
  • [26] TIME: Text and Image Mutual-Translation Adversarial Networks
    Liu, Bingchen
    Song, Kunpeng
    Zhu, Yizhe
    de Melo, Gerard
    Elgammal, Ahmed
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2082 - 2090
  • [27] TextControlGAN: Text-to-Image Synthesis with Controllable Generative Adversarial Networks
    Ku, Hyeeun
    Lee, Minhyeok
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (08):
  • [28] Text to Realistic Image Generation with Attentional Concatenation Generative Adversarial Networks
    Li, Linyan
    Sun, Yu
    Hu, Fuyuan
    Zhou, Tao
    Xi, Xuefeng
    Ren, Jinchang
    [J]. DISCRETE DYNAMICS IN NATURE AND SOCIETY, 2020, 2020
  • [29] Lightweight Generative Adversarial Networks for Text-Guided Image Manipulation
    Li, Bowen
    Qi, Xiaojuan
    Torr, Philip H. S.
    Lukasiewicz, Thomas
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [30] A survey of generative adversarial networks and their application in text-to-image synthesis
    Zeng, Wu
    Zhu, Heng-liang
    Lin, Chuan
    Xiao, Zheng-ying
    [J]. ELECTRONIC RESEARCH ARCHIVE, 2023, 31 (12): : 7142 - 7181