DESRGAN: Detail-enhanced generative adversarial networks for small sample single image super-resolution

被引:0
|
作者
Ma, Congcong [1 ,3 ]
Mi, Jiaqi [2 ]
Gao, Wanlin [1 ,3 ]
Tao, Sha [1 ,3 ]
机构
[1] China Agr Univ, Coll Informat & Elect Engn, Beijing 100083, Peoples R China
[2] Nankai Univ, Coll Artificial Intelligence, Tianjin 300350, Peoples R China
[3] China Agr Univ, Key Lab Agr Informatizat Standardizat, Minist Agr & Rural Affairs, Beijing 100083, Peoples R China
关键词
Generative adversarial networks; Small sample; Super-resolution; Artifacts; Edge details; Texture details; RECONSTRUCTION;
D O I
10.1016/j.neucom.2024.129121
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image super-resolution involves reconstructing a blurry, low-resolution image with limited information into a clear, high-resolution image containing more detailed information. The images generated by super-resolution reconstruction can enhance the performance of downstream computer vision tasks, and hold wide application prospects in fields such as industrial fault detection, plant phenotype parameter extraction, medical imaging, and more. High-frequency components in images, such as edges and texture details, typically require more attention. However, when the training samples are limited, effectively recovering clear high-frequency details of images becomes highly challenging. Therefore, this paper proposes a single-image super-resolution method based on generative adversarial networks, named DESRGAN. Compared to existing methods, DESRGAN achieves better reconstruction of image details even with a limited number of training samples. DESRGAN introduces several key innovations: a shallow generator structure to address overfitting issues in small sample scenarios, a dual-stream feature extraction network with dilated convolutions to capture multi-scale contextual information and expand the receptive field, and an artifact loss designed to eliminate artifacts and preserve the true high-frequency details of the super-resolved images. Extensive ablation experiments and comparative studies with multiple state-of-the-art models are conducted on two small sample datasets, "Root" and "Leaves," as well as five publicly available datasets. The results demonstrate that the proposed DESRGAN achieves superior performance in small sample single image super-resolution tasks, with improvements of 1.39 dB in PSNR and 0.013 in SSIM. The generated high-resolution images exhibit clear texture and edge structures, presenting favorable subjective visual effects. Moreover, the model displays strong generalization capabilities.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Detail-Enhanced Wavelet Residual Network for Single Image Super-Resolution
    Hsu, Wei-Yen
    Jian, Pei-Wen
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [2] Dtsr: detail-enhanced transformer for image super-resolution
    Huang, Xiaoqian
    Huang, Detian
    Huang, Qin
    Huang, Caixia
    Chen, Feiyang
    Xu, Zhengjun
    VISUAL COMPUTER, 2024, 40 (11): : 7667 - 7684
  • [3] Hierarchical Generative Adversarial Networks for Single Image Super-Resolution
    Chen, Weimin
    Ma, Yuqing
    Liu, Xianglong
    Yuan, Yi
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 355 - 364
  • [4] Generative Adversarial Networks with Enhanced Symmetric Residual Units for Single Image Super-Resolution
    Wu, Xianyu
    Li, Xiaojie
    He, Jia
    Wu, Xi
    Mumtaz, Imran
    MULTIMEDIA MODELING (MMM 2019), PT I, 2019, 11295 : 483 - 494
  • [5] Understanding Single Image Super-Resolution Techniques with Generative Adversarial Networks
    Adate, Amit
    Tripathy, B. K.
    SOFT COMPUTING FOR PROBLEM SOLVING, SOCPROS 2017, VOL 1, 2019, 816 : 833 - 840
  • [6] DSRGAN: Detail Prior-Assisted Perceptual Single Image Super-Resolution via Generative Adversarial Networks
    Liu, Ziyang
    Li, Zhengguo
    Wu, Xingming
    Liu, Zhong
    Chen, Weihai
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7418 - 7431
  • [7] A comparison of Generative Adversarial Networks for image super-resolution
    Cobelli, Patricia
    Nesmachnow, Sergio
    Toutouh, Jamal
    2022 IEEE LATIN AMERICAN CONFERENCE ON COMPUTATIONAL INTELLIGENCE (LA-CCI), 2022, : 30 - 35
  • [8] Generative Adversarial Networks for Medical Image Super-resolution
    Zhao, Min
    Naderian, Amirkhashayar
    Sanei, Saeid
    2021 INTERNATIONAL CONFERENCE ON E-HEALTH AND BIOENGINEERING (EHB 2021), 9TH EDITION, 2021,
  • [9] ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks
    Wang, Xintao
    Yu, Ke
    Wu, Shixiang
    Gu, Jinjin
    Liu, Yihao
    Dong, Chao
    Qiao, Yu
    Loy, Chen Change
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 63 - 79
  • [10] Single Face Image Super-resolution Reconstruction with Wasserstein Generative Adversarial Networks
    Gao, Yuquan
    Sun, Guoxi
    Zhao, Xinzhuo
    2024 IEEE 4TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND ARTIFICIAL INTELLIGENCE, SEAI 2024, 2024, : 63 - 67