3D Multi-scene Stylization Based on Conditional Neural Radiance Fields

被引:0
|
作者
Zhang, Sijia [1 ]
Liu, Ting [1 ]
Li, Zhuoyuan [1 ]
Sun, Yi [1 ]
机构
[1] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian, Liaoning, Peoples R China
来源
关键词
Novel View Synthesis; Neural Radiance Fields; Style Transfer;
D O I
10.1007/978-981-97-4399-5_10
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural Radiation Field (NeRF) is a scene model capable of achieving high-quality view synthesis, optimized for each specific scene. In this paper, we propose a conditional neural radiation field based on multi-resolution hash coding, enabling high-quality synthesis of new views across multiple scenes. By employing multi-resolution hashing to encode 3D positional information, the multilayer perceptron is lightened, thereby reducing memory consumption. The model introduces two latent encodings: shape encoding and appearance encoding, which enhance our model's performance in new view synthesis and scene interpolation. Furthermore, after achieving a robust geometric reconstruction of multiple scenes, we fix the information affecting the scene geometry and utilize a hypernet to predict the parameters of the multilayer perceptron responsible for scene appearance information. This approach facilitates a generalized style transfer across multiple scenes while maintaining the three-dimensional consistency of the scenes.
引用
收藏
页码:103 / 112
页数:10
相关论文
共 50 条
  • [31] Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylization
    Zhang, Yuechen
    He, Zexin
    Xing, Jinbo
    Yao, Xufeng
    Jia, Jiaya
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 4242 - 4251
  • [32] Neural radiance fields-based multi-view endoscopic scene reconstruction for surgical simulation
    Qin, Zhibao
    Qian, Kai
    Liang, Shaojun
    Zheng, Qinhong
    Peng, Jun
    Tai, Yonghang
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2024, 19 (05) : 951 - 960
  • [33] Neural radiance fields-based multi-view endoscopic scene reconstruction for surgical simulation
    Zhibao Qin
    Kai Qian
    Shaojun Liang
    Qinhong Zheng
    Jun Peng
    Yonghang Tai
    International Journal of Computer Assisted Radiology and Surgery, 2024, 19 : 951 - 960
  • [34] DehazeNeRF: Multi-image Haze Removal and 3D Shape Reconstruction using Neural Radiance Fields
    Chen, Wei-Ting
    Yifan, Wang
    Kuo, Sy-Yen
    Wetzstein, Gordon
    2024 INTERNATIONAL CONFERENCE IN 3D VISION, 3DV 2024, 2024, : 247 - 256
  • [35] SatelliteRF: Accelerating 3D Reconstruction in Multi-View Satellite Images with Efficient Neural Radiance Fields
    Zhou, Xin
    Wang, Yang
    Lin, Daoyu
    Cao, Zehao
    Li, Biqing
    Liu, Junyi
    APPLIED SCIENCES-BASEL, 2024, 14 (07):
  • [36] The Potential of Neural Radiance Fields and 3D Gaussian Splatting for 3D Reconstruction from Aerial Imagery
    Haitz, Dennis
    Hermann, Max
    Roth, Aglaja Solana
    Weinmann, Michael
    Weinmann, Martin
    ISPRS ANNALS OF THE PHOTOGRAMMETRY, REMOTE SENSING AND SPATIAL INFORMATION SCIENCES: VOLUME X-2-2024, 2024, : 97 - 104
  • [37] SIGNeRF: Scene Integrated Generation for Neural Radiance Fields
    Dihlmann, Jan-Niklas
    Engelhardt, Andreas
    Lensch, Hendrik
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 6679 - 6688
  • [38] NeRF-Art: Text-Driven Neural Radiance Fields Stylization
    Wang, Can
    Jiang, Ruixiang
    Chai, Menglei
    He, Mingming
    Chen, Dongdong
    Liao, Jing
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (08) : 4983 - 4996
  • [39] WaSt-3D: Wasserstein-2 Distance for Scene-to-Scene Stylization on 3D Gaussians
    Kotovenko, Dmytro
    Grebenkova, Olga
    Sarafianos, Nikolaos
    Paliwal, Avinash
    Ma, Pingchuan
    Poursaeed, Omid
    Mohan, Sreyas
    Fang, Yuchen
    Li, Yilei
    Ranjan, Rakesh
    Ommer, Bjoern
    COMPUTER VISION - ECCV 2024, PT XXI, 2025, 15079 : 298 - 314
  • [40] Application of Neural Radiance Fields (NeRFs) for 3D Model Representation in the Industrial Metaverse
    Fabra, Lidia
    Solanes, J. Ernesto
    Munoz, Adolfo
    Marti-Teston, Ana
    Alabau, Alba
    Gracia, Luis
    APPLIED SCIENCES-BASEL, 2024, 14 (05):