Parametric regularization loss in super-resolution reconstruction

被引:3
|
作者
Viriyavisuthisakul, Supatta [1 ,2 ]
Kaothanthong, Natsuda [1 ]
Sanguansat, Parinya [3 ]
Le Nguyen, Minh [2 ]
Haruechaiyasak, Choochart [4 ]
机构
[1] Thammasat Univ, Sch Management Technol, Sirindhorn Int Inst Technol, Khlong Luang 12000, Pathum Thani, Thailand
[2] Japan Adv Inst Informat Technol, Sch Informat Sci, Nomi City, Ishikawa 9231211, Japan
[3] Panyapiwat Inst Management, Fac Engn & Technol, Nonthaburi 11120, Thailand
[4] Natl Elect & Comp Technol Ctr, Khlong Luang 10400, Pathum Thani, Thailand
关键词
Super-resolution; Image reconstruction; Generative adversarial network; Parametric; Regularization; Loss function; TRANSLATION; NETWORKS;
D O I
10.1007/s00138-022-01315-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A noise-enhanced super-resolution generative adversarial network plus (nESRGAN+) was proposed to improve the enhanced super-resolution GAN (ESRGAN). The contributions of nESRGAN+ generate an impressive reconstructed image with more texture details and greater sharpness. However, the perceptual quality of the output lacks hallucinated details and undesirable artifacts and takes a long time to converge. To address these problems, we propose four types of parametric regularization algorithms as loss functions of the model to enable the iterative weight adjustment of the network gradient. Several experiments were conducted to confirm that the generator can achieve a better-quality reconstructed image, including restoring the unseen texture. Our method accomplished the average peak signal-to-noise ratio (PSNR) of the reconstructed image at 27.96 dB, the average Structural Similarity Index Measure (SSIM) at 0.8303, and the average Learned Perceptual Image Patch Similarity (LPIPS) at 0.1949. It took seven times less training time than the state of the art. In addition to the better visual quality of the reconstructed result, the proposed loss functions allow the generator to converge faster.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Parametric regularization loss in super-resolution reconstruction
    Supatta Viriyavisuthisakul
    Natsuda Kaothanthong
    Parinya Sanguansat
    Minh Le Nguyen
    Choochart Haruechaiyasak
    [J]. Machine Vision and Applications, 2022, 33
  • [2] A Web Demo Interface for Super-Resolution Reconstruction with Parametric Regularization Loss
    Viriyavisuthisakul, Supatta
    Sanguansat, Parinya
    Yamasaki, Toshihiko
    [J]. PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 1251 - 1254
  • [3] Regularization for super-resolution image reconstruction
    Bannore, Vivek
    [J]. KNOWLEDGE-BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT 2, PROCEEDINGS, 2006, 4252 : 36 - 46
  • [4] AFOD Regularization for Super-resolution Reconstruction
    Huang, Shuying
    Yang, Yong
    Wang, Guoyu
    [J]. INTERNATIONAL CONFERENCE ON ADVANCES IN ENGINEERING 2011, 2011, 24 : 1 - 5
  • [5] Super-resolution reconstruction based on regularization
    School of Electronic Engineering and Optoelectronic Techniques, Nanjing University of Science and Technology, Nanjing 210094, China
    不详
    不详
    [J]. Dianzi Yu Xinxi Xuebao, 2007, 7 (1713-1716):
  • [6] Adaptive Regularization of Infrared Image Super-resolution Reconstruction
    Dai Shao-Sheng
    Xiang Hai-Yan
    Du Zhi-Hui
    Liu Jin-Song
    [J]. 2014 INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING TECHNOLOGIES (ICCCNT, 2014,
  • [7] Performance of reconstruction-based super-resolution with regularization
    Shen, Minmin
    Wang, Ci
    Xue, Ping
    Lin, Weisi
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2010, 21 (07) : 640 - 650
  • [8] Super-Resolution Image Reconstruction with Adaptive Regularization Parameter
    Shi Yan-xin
    Cheng Yong-mei
    [J]. INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS & STATISTICS, 2013, 39 (09): : 228 - 235
  • [9] An Adaptive Regularization Image Super-resolution Reconstruction Algorithm
    Zhao Xiao-qiang
    Jia Yun-xia
    [J]. 2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, : 7258 - 7262
  • [10] Super-resolution image reconstruction with adaptive regularization parameter
    Shi, Yan-Xin
    Cheng, Yong-Mei
    [J]. Shi, Y.-X. (shiyxx001@sina.com), 1600, CESER Publications, Post Box No. 113, Roorkee, 247667, India (39): : 227 - 235