Deep residual learning for denoising Monte Carlo renderings

被引:2
|
作者
Kin-Ming Wong [1 ]
Tien-Tsin Wong [2 ]
机构
[1] Artixels
[2] Department of Computer Science and Engineering, the Chinese University of Hong Kong
关键词
Monte Carlo rendering; denoising; deep learning; deep residual learning; filter-free denoising;
D O I
暂无
中图分类号
TP391.41 []; TP18 [人工智能理论];
学科分类号
080203 ; 081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learning-based techniques have recently been shown to be effective for denoising Monte Carlo rendering methods. However, there remains a quality gap to state-of-the-art handcrafted denoisers. In this paper, we propose a deep residual learning based method that outperforms both state-of-the-art handcrafted denoisers and learning-based denoisers.Unlike the indirect nature of existing learning-based methods(which e.g., estimate the parameters and kernel weights of an explicit feature based filter), we directly map the noisy input pixels to the smoothed output. Using this direct mapping formulation, we demonstrate that even a simple-and-standard ResNet and three common auxiliary features(depth, normal,and albedo) are sufficient to achieve high-quality denoising. This minimal requirement on auxiliary data simplifies both training and integration of our method into most production rendering pipelines. We have evaluated our method on unseen images created by a different renderer. Consistently superior quality denoising is obtained in all cases.
引用
收藏
页码:239 / 255
页数:17
相关论文
共 50 条
  • [1] Deep residual learning for denoising Monte Carlo renderings
    Kin-Ming Wong
    Tien-Tsin Wong
    [J]. Computational Visual Media, 2019, 5 : 239 - 255
  • [2] Deep residual learning for denoising Monte Carlo renderings
    Wong, Kin-Ming
    Wong, Tien-Tsin
    [J]. COMPUTATIONAL VISUAL MEDIA, 2019, 5 (03) : 239 - 255
  • [3] Denoising Deep Monte Carlo Renderings
    Vicini, D.
    Adler, D.
    Novak, J.
    Rousselle, F.
    Burley, B.
    [J]. COMPUTER GRAPHICS FORUM, 2019, 38 (01) : 316 - 327
  • [4] Neural Denoising for Deep-Z Monte Carlo Renderings
    Zhang, Xianyao
    Rothlin, Gerhard
    Zhu, Shilin
    Aydin, Tunc Ozan
    Salehi, Farnood
    Gross, Markus
    Papas, Marios
    [J]. COMPUTER GRAPHICS FORUM, 2024, 43 (02)
  • [5] Ensemble Denoising for Monte Carlo Renderings
    Zheng, Shaokun
    Zheng, Fengshi
    Xu, Kun
    Yan, Ling-Qi
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2021, 40 (06):
  • [6] Robust Deep Residual Denoising for Monte Carlo Rendering
    Wong, Kin-Ming
    Wong, Tien-Tsin
    [J]. SA'18: SIGGRAPH ASIA 2018 TECHNICAL BRIEFS, 2018,
  • [7] Neural Partitioning Pyramids for Denoising Monte Carlo Renderings
    Balint, Martin
    Wolski, Krzysztof
    Myszkowski, Karol
    Seidel, Hans-Peter
    Mantiuk, Rafal
    [J]. PROCEEDINGS OF SIGGRAPH 2023 CONFERENCE PAPERS, SIGGRAPH 2023, 2023,
  • [8] Denoising Monte Carlo renderings via a multi-scale featured dual-residual GAN
    Yifan Lu
    Siyuan Fu
    Xiao Hua Zhang
    Ning Xie
    [J]. The Visual Computer, 2021, 37 : 2513 - 2525
  • [9] Denoising Monte Carlo renderings via a multi-scale featured dual-residual GAN
    Lu, Yifan
    Fu, Siyuan
    Zhang, Xiao Hua
    Xie, Ning
    [J]. VISUAL COMPUTER, 2021, 37 (9-11): : 2513 - 2525
  • [10] Kernel-Predicting Convolutional Networks for Denoising Monte Carlo Renderings
    Bako, Steve
    Vogels, Thijs
    Mcwilliams, Brian
    Meyer, Mark
    Novak, Jan
    Harvill, Alex
    Sen, Pradeep
    Derose, Tony
    Rousselle, Fabrice
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):