DEMC: A Deep Dual-Encoder Network for Denoising Monte Carlo Rendering

被引:15
|
作者
Yang, Xin [1 ]
Wang, Dawei [2 ]
Hu, Wenbo [3 ]
Zhao, Li-Jing [1 ]
Yin, Bao-Cai [1 ]
Zhang, Qiang [1 ]
Wei, Xiao-Peng [1 ]
Fu, Hongbo [4 ]
机构
[1] Dalian Univ Technol, Dept Comp Sci & Technol, Dalian 116024, Peoples R China
[2] Univ Hong Kong, Dept Comp Sci, Pokfulam, Hong Kong, Peoples R China
[3] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Shatin, Hong Kong, Peoples R China
[4] City Univ Hong Kong, Sch Creat Media, Kowloon, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Monte Carlo rendering; Monte Carlo denoising; neural network; RECONSTRUCTION;
D O I
10.1007/s11390-019-1964-2
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we present DEMC, a deep dual-encoder network to remove Monte Carlo noise efficiently while preserving details. Denoising Monte Carlo rendering is different from natural image denoising since inexpensive by-products (feature buffers) can be extracted in the rendering stage. Most of them are noise-free and can provide sufficient details for image reconstruction. However, these feature buffers also contain redundant information. Hence, the main challenge of this topic is how to extract useful information and reconstruct clean images. To address this problem, we propose a novel network structure, dual-encoder network with a feature fusion sub-network, to fuse feature buffers firstly, then encode the fused feature buffers and a noisy image simultaneously, and finally reconstruct a clean image by a decoder network. Compared with the state-of-the-art methods, our model is more robust on a wide range of scenes, and is able to generate satisfactory results in a significantly faster way.
引用
收藏
页码:1123 / 1135
页数:13
相关论文
共 50 条
  • [1] DEMC: A Deep Dual-Encoder Network for Denoising Monte Carlo Rendering
    Xin Yang
    Dawei Wang
    Wenbo Hu
    Li-Jing Zhao
    Bao-Cai Yin
    Qiang Zhang
    Xiao-Peng Wei
    Hongbo Fu
    [J]. Journal of Computer Science and Technology, 2019, 34 : 1123 - 1135
  • [2] Fast Dual Deep Convolutional Autoencoder Network for Denoising Monte Carlo Rendering
    Alzbier, Ahmed Mustafa Taha
    Chen, Chunyi
    Shen, Zhongye
    Zhang, Ripei
    [J]. JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2023, 67 (03)
  • [3] Robust Deep Residual Denoising for Monte Carlo Rendering
    Wong, Kin-Ming
    Wong, Tien-Tsin
    [J]. SA'18: SIGGRAPH ASIA 2018 TECHNICAL BRIEFS, 2018,
  • [4] Deep Compositional Denoising for High-quality Monte Carlo Rendering
    Zhang, Xianyao
    Manzi, Marco
    Vogels, Thijs
    Dahlberg, Henrik
    Gross, Markus
    Papas, Marios
    [J]. COMPUTER GRAPHICS FORUM, 2021, 40 (04) : 1 - 13
  • [5] Bayesian Collaborative Denoising for Monte Carlo Rendering
    Boughida, Malik
    Boubekeur, Tamy
    [J]. COMPUTER GRAPHICS FORUM, 2017, 36 (04) : 137 - 153
  • [6] DEUNet: Dual-encoder UNet for simultaneous denoising and reconstruction of single HDR image
    Yao, Zhiping
    Bi, Jiang
    Deng, Wei
    He, Wenlin
    Wang, Zihan
    Kuang, Xu
    Zhou, Mi
    Gao, Qinquan
    Tong, Tong
    [J]. COMPUTERS & GRAPHICS-UK, 2024, 119
  • [7] Denoising Deep Monte Carlo Renderings
    Vicini, D.
    Adler, D.
    Novak, J.
    Rousselle, F.
    Burley, B.
    [J]. COMPUTER GRAPHICS FORUM, 2019, 38 (01) : 316 - 327
  • [8] Joint self-attention for denoising Monte Carlo rendering
    Oh, Geunwoo
    Moon, Bochang
    [J]. VISUAL COMPUTER, 2024, 40 (07): : 4623 - 4634
  • [9] Converging Algorithm-Agnostic Denoising for Monte Carlo Rendering
    Denisova, Elena
    Bocchi, Leonardo
    [J]. PROCEEDINGS OF THE ACM ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES, 2024, 7 (03)
  • [10] DETisSeg: A dual-encoder network for tissue semantic segmentation of histopathology image
    He, Penghui
    Qu, Aiping
    Xiao, Shuomin
    Ding, Meidan
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 87