Learning neural implicit representations with surface signal parameterizations

被引:4
|
作者
Guan, Yanran [1 ]
Chubarau, Andrei [2 ,3 ]
Rao, Ruby [3 ]
Nowrouzezahrai, Derek [2 ]
机构
[1] Carleton Univ, Ottawa, ON, Canada
[2] McGill Univ, Montreal, PQ, Canada
[3] Huawei Technol Canada, Markham, ON, Canada
来源
COMPUTERS & GRAPHICS-UK | 2023年 / 114卷
关键词
Neural implicit surfaces; Surface parameterization; Overfit digital content;
D O I
10.1016/j.cag.2023.06.013
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Neural implicit surface representations have recently emerged as popular alternative to explicit 3D object encodings, such as polygonal meshes, tabulated points, or voxels. While significant work has improved the geometric fidelity of these representations, much less attention is given to their final appearance. Traditional explicit object representations commonly couple the 3D shape data with auxiliary surface-mapped image data, such as diffuse color textures and fine-scale geometric details in normal maps that typically require a mapping of the 3D surface onto a plane, i.e., a surface parameterization; implicit representations, on the other hand, cannot be easily textured due to lack of configurable surface parameterization. Inspired by this digital content authoring methodology, we design a neural network architecture that implicitly encodes the underlying surface parameterization suitable for appearance data. As such, our model remains compatible with existing mesh-based digital content with appearance data. Motivated by recent work that overfits compact networks to individual 3D objects, we present a new weight-encoded neural implicit representation that extends the capability of neural implicit surfaces to enable various common and important applications of texture mapping. Our method outperforms reasonable baselines and state-of-the-art alternatives. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:257 / 264
页数:8
相关论文
共 50 条
  • [1] SIGNAL COMPRESSION VIA NEURAL IMPLICIT REPRESENTATIONS
    Pistilli, Francesca
    Valsesia, Diego
    Fracastoro, Giulia
    Magli, Enrico
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3733 - 3737
  • [2] Implicit Surface Representations as Layers in Neural Networks
    Michalkiewicz, Mateusz
    Pontes, Jhony K.
    Jack, Dominic
    Baktashmotlagh, Mahsa
    Eriksson, Anders
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 4742 - 4751
  • [3] Meta-learning Sparse Implicit Neural Representations
    Lee, Jaeho
    Tack, Jihoon
    Lee, Namhoon
    Shin, Jinwoo
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [4] NeRC: Rendering Planar Caustics by Learning Implicit Neural Representations
    Qiu, Jiaxiong
    Yin, Ze-Xin
    Cheng, Ming-Ming
    Ren, Bo
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (07) : 4339 - 4348
  • [5] On Quantizing Implicit Neural Representations
    Gordon, Cameron
    Chng, Shin-Fang
    MacDonald, Lachlan
    Lucey, Simon
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 341 - 350
  • [6] Implicit neural representations in light microscopy
    Hauser, Sophie Louise
    Brosig, Johanna
    Murthy, Bhargavi
    Attardo, Alessio
    Kist, Andreas M.
    [J]. BIOMEDICAL OPTICS EXPRESS, 2024, 15 (04): : 2175 - 2186
  • [7] Compression with Bayesian Implicit Neural Representations
    Guo, Zongyu
    Flamich, Gergely
    He, Jiajun
    Chen, Zhibo
    Hernandez-Lobato, Jose Miguel
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [8] Implicit Neural Representations for Image Compression
    Strumpler, Yannick
    Postels, Janis
    Yang, Ren
    Van Gool, Luc
    Tombari, Federico
    [J]. COMPUTER VISION, ECCV 2022, PT XXVI, 2022, 13686 : 74 - 91
  • [9] WIRE: Wavelet Implicit Neural Representations
    Saragadam, Vishwanath
    LeJeune, Daniel
    Tan, Jasper
    Balakrishnan, Guha
    Veeraraghavan, Ashok
    Baraniuk, Richard G.
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18507 - 18516
  • [10] On Representations and Parameterizations of Motion
    Marco Borri
    Lorenzo Trainelli
    Carlo L. Bottasso
    [J]. Multibody System Dynamics, 2000, 4 : 129 - 193