Deep Adaptive Sampling and Reconstruction using Analytic Distributions

被引:5
|
作者
Salehi, Farnood [1 ]
Manzi, Marco [1 ]
Roethlin, Gerhard [1 ]
Weber, Romann [1 ]
Schroers, Christopher [1 ]
Papas, Marios [1 ]
机构
[1] Disney Res Studios, Zurich, Switzerland
来源
ACM TRANSACTIONS ON GRAPHICS | 2022年 / 41卷 / 06期
关键词
Adaptive sampling; denoising; path tracing;
D O I
10.1145/3550454.3555515
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We propose an adaptive sampling and reconstruction method for offline Monte Carlo rendering. Our method produces sampling maps constrained by a user-defined budget that minimize the expected future denoising error. Compared to other state-of-the-art methods, which produce the necessary training data on the fly by composing pre-rendered images, our method samples from analytic noise distributions instead. These distributions are compact and closely approximate the pixel value distributions stemming from Monte Carlo rendering. Our method can efficiently sample training data by leveraging only a few per-pixel statistics of the target distribution, which provides several benefits over the current state of the art. Most notably, our analytic distributions' modeling accuracy and sampling efficiency increase with sample count, essential for high-quality offline rendering. Although our distributions are approximate, our method supports joint end-to-end training of the sampling and denoising networks. Finally, we propose the addition of a global summary module to our architecture that accumulates valuable information from image regions outside of the network's receptive field. This information discourages sub-optimal decisions based on local information. Our evaluation against other state-of-the-art neural sampling methods demonstrates denoising quality and data efficiency improvements.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Adaptive Incident Radiance Field Sampling and Reconstruction Using Deep Reinforcement Learning
    Huo, Yuchi
    Wang, Rui
    Zheng, Ruzahng
    Xu, Hualin
    Bao, Hujun
    Yoon, Sung-Eui
    ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (01):
  • [2] Adaptive Sampling and Reconstruction using Greedy Error Minimization
    Rousselle, Fabrice
    Knaus, Claude
    Zwicker, Matthias
    ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (06):
  • [3] Adaptive Image Sampling Using Deep Learning and Its Application on X-Ray Fluorescence Image Reconstruction
    Dai, Qiqin
    Chopp, Henry
    Pouyet, Emeline
    Cossairt, Oliver
    Walton, Marc
    Katsaggelos, Aggelos K.
    IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (10) : 2564 - 2578
  • [4] A Pochhammer type sampling reconstruction of analytic functions
    Melas, A.
    Bagis, N.
    JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2011, 373 (01) : 214 - 226
  • [5] Irregular image sub-sampling and reconstruction by adaptive sampling
    LeFloch, H
    Labit, C
    INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, PROCEEDINGS - VOL III, 1996, : 379 - 382
  • [6] ASRL: An Adaptive GPS Sampling Method Using Deep Reinforcement Learning
    Qu, Boting
    Zhao, Mengjiao
    Feng, Jun
    Wang, Xin
    2022 23RD IEEE INTERNATIONAL CONFERENCE ON MOBILE DATA MANAGEMENT (MDM 2022), 2022, : 153 - 158
  • [7] Adaptive Importance Sampling for Deep Ritz
    Wan, Xiaoliang
    Zhou, Tao
    Zhou, Yuancheng
    COMMUNICATIONS ON APPLIED MATHEMATICS AND COMPUTATION, 2024, : 929 - 953
  • [8] Parallel adaptive sampling and reconstruction using multi-scale and directional analysis
    Liu, Xiao Dan
    Zheng, Chang Wen
    VISUAL COMPUTER, 2013, 29 (6-8): : 501 - 511
  • [9] Parallel adaptive sampling and reconstruction using multi-scale and directional analysis
    Xiao Dan Liu
    Chang Wen Zheng
    The Visual Computer, 2013, 29 : 501 - 511
  • [10] Multidimensional adaptive sampling and reconstruction for ray tracing
    Hachisuka, Toshiya
    Jarosz, Wojciech
    Weistroffert, Richard Peter
    Dale, Kevin
    Humphreys, Greg
    Zwicker, Matthias
    Jensen, Henrik Warm
    ACM TRANSACTIONS ON GRAPHICS, 2008, 27 (03):