Realistic River Image Synthesis Using Deep Generative Adversarial Networks

被引:18
|
作者
Gautam, Akshat [1 ]
Sit, Muhammed [2 ]
Demir, Ibrahim [3 ]
机构
[1] Columbia Univ, Sch Engn & Appl Sci, New York, NY USA
[2] Univ Iowa, Interdisciplinary Grad Program Informat, Iowa City, IA 52242 USA
[3] Univ Iowa, Dept Civil & Environm Engn, Iowa City, IA 52242 USA
来源
FRONTIERS IN WATER | 2022年 / 4卷
关键词
generative adversarial networks; deep learning; river image; imagery synthesis; hydrological datasets; SATELLITE IMAGERY; BIG DATA; FRAMEWORK; MEKONG;
D O I
10.3389/frwa.2022.784441
中图分类号
TV21 [水资源调查与水利规划];
学科分类号
081501 ;
摘要
In this paper, we demonstrated a practical application of realistic river image generation using deep learning. Specifically, we explored a generative adversarial network (GAN) model capable of generating high-resolution and realistic river images that can be used to support modeling and analysis in surface water estimation, river meandering, wetland loss, and other hydrological research studies. First, we have created an extensive repository of overhead river images to be used in training. Second, we incorporated the Progressive Growing GAN (PGGAN), a network architecture that iteratively trains smaller-resolution GANs to gradually build up to a very high resolution to generate high quality (i.e., 1,024 x 1,024) synthetic river imagery. With simpler GAN architectures, difficulties arose in terms of exponential increase of training time and vanishing/exploding gradient issues, which the PGGAN implementation seemed to significantly reduce. The results presented in this study show great promise in generating high-quality images and capturing the details of river structure and flow to support hydrological modeling and research.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Generate Realistic Traffic Sign Image Using Deep Convolutional Generative Adversarial Networks
    Liu, Yan-Ting
    Chen, Rung-Ching
    Dewi, Christine
    2021 IEEE CONFERENCE ON DEPENDABLE AND SECURE COMPUTING (DSC), 2021,
  • [2] DepthwiseGANs: Fast Training Generative Adversarial Networks for Realistic Image Synthesis
    Ngxande, Mkhuseli
    Tapamo, Jules-Raymond
    Burke, Michael
    2019 SOUTHERN AFRICAN UNIVERSITIES POWER ENGINEERING CONFERENCE/ROBOTICS AND MECHATRONICS/PATTERN RECOGNITION ASSOCIATION OF SOUTH AFRICA (SAUPEC/ROBMECH/PRASA), 2019, : 111 - 116
  • [3] Realistic Data Synthesis Using Enhanced Generative Adversarial Networks
    Baowaly, Mrinal Kanti
    Liu, Chao-Lin
    Chen, Kuan-Ta
    2019 IEEE SECOND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND KNOWLEDGE ENGINEERING (AIKE), 2019, : 289 - 292
  • [4] Breast Ultrasound Image Synthesis using Deep Convolutional Generative Adversarial Networks
    Fujioka, Tomoyuki
    Mori, Mio
    Kubota, Kazunori
    Kikuchi, Yuka
    Katsuta, Leona
    Adachi, Mio
    Oda, Goshi
    Nakagawa, Tsuyoshi
    Kitazume, Yoshio
    Tateishi, Ukihide
    DIAGNOSTICS, 2019, 9 (04)
  • [5] StackGAN plus plus : Realistic Image Synthesis with Stacked Generative Adversarial Networks
    Zhang, Han
    Xu, Tao
    Li, Hongsheng
    Zhang, Shaoting
    Wang, Xiaogang
    Huang, Xiaolei
    Metaxas, Dimitris N.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (08) : 1947 - 1962
  • [6] AttnGAN: Realistic Text-to-Image Synthesis with Attentional Generative Adversarial Networks
    Mathesul, Shubham
    Bhutkar, Ganesh
    Rambhad, Ayush
    SENSE, FEEL, DESIGN, INTERACT 2021, 2022, 13198 : 397 - 403
  • [7] Image synthesis of apparel stitching defects using deep convolutional generative adversarial networks
    ul-Huda, Noor
    Ahmad, Haseeb
    Banjar, Ameen
    Alzahrani, Ahmed Omar
    Ahmad, Ibrar
    Naeem, M. Salman
    HELIYON, 2024, 10 (04)
  • [8] Realistic image generation using adversarial generative networks combined with depth information
    Yu, Qi
    Yu, Lan
    Li, Guangju
    Jin, Dehu
    Qi, Meng
    DIGITAL SIGNAL PROCESSING, 2023, 143
  • [9] GENERATIVE ADVERSARIAL NETWORKS FOR REALISTIC SYNTHESIS OF HYPERSPECTRAL SAMPLES
    Audebert, Nicolas
    Le Saux, Bertrand
    Lefevre, Sebastien
    IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 4359 - 4362
  • [10] StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks
    Zhang, Han
    Xu, Tao
    Li, Hongsheng
    Zhang, Shaoting
    Wang, Xiaogang
    Huang, Xiaolei
    Metaxas, Dimitris
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 5908 - 5916