3D Multi-scene Stylization Based on Conditional Neural Radiance Fields

被引:0
|
作者
Zhang, Sijia [1 ]
Liu, Ting [1 ]
Li, Zhuoyuan [1 ]
Sun, Yi [1 ]
机构
[1] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian, Liaoning, Peoples R China
来源
关键词
Novel View Synthesis; Neural Radiance Fields; Style Transfer;
D O I
10.1007/978-981-97-4399-5_10
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural Radiation Field (NeRF) is a scene model capable of achieving high-quality view synthesis, optimized for each specific scene. In this paper, we propose a conditional neural radiation field based on multi-resolution hash coding, enabling high-quality synthesis of new views across multiple scenes. By employing multi-resolution hashing to encode 3D positional information, the multilayer perceptron is lightened, thereby reducing memory consumption. The model introduces two latent encodings: shape encoding and appearance encoding, which enhance our model's performance in new view synthesis and scene interpolation. Furthermore, after achieving a robust geometric reconstruction of multiple scenes, we fix the information affecting the scene geometry and utilize a hypernet to predict the parameters of the multilayer perceptron responsible for scene appearance information. This approach facilitates a generalized style transfer across multiple scenes while maintaining the three-dimensional consistency of the scenes.
引用
收藏
页码:103 / 112
页数:10
相关论文
共 50 条
  • [41] Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesis
    Xu, Tianhan
    Fujita, Yasuhiro
    Matsumoto, Eiichi
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 15862 - 15871
  • [42] SuNeRF: 3D Reconstruction of the Solar EUV Corona Using Neural Radiance Fields
    Jarolim, Robert
    Tremblay, Benoit
    Munoz-Jaramillo, Andres
    Bintsi, Kyriaki-Margarita
    Jungbluth, Anna
    Santos, Miraflor
    Vourlidas, Angelos
    Mason, James P.
    Sundaresan, Sairam
    Downs, Cooper
    Caplan, Ronald M.
    ASTROPHYSICAL JOURNAL LETTERS, 2024, 961 (02)
  • [43] 3D Reconstructions of Brain from MRI Scans Using Neural Radiance Fields
    Iddrisu, Khadija
    Malec, Sylwia
    Crimi, Alessandro
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2023, PT II, 2023, 14126 : 207 - 218
  • [44] StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fields
    Liu, Kunhao
    Zhan, Fangneng
    Chen, Yiwen
    Zhang, Jiahui
    Yu, Yingchen
    El Saddik, Abdulmotaleb
    Lu, Shijian
    Xing, Eric
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8338 - 8348
  • [45] NeRFMeshing: Distilling Neural Radiance Fields into Geometrically-Accurate 3D Meshes
    Rakotosaona, Marie-Julie
    Manhardt, Fabian
    Arroyo, Diego Martin
    Niemeyer, Michael
    Kundu, Abhijit
    Tombari, Federico
    2024 INTERNATIONAL CONFERENCE IN 3D VISION, 3DV 2024, 2024, : 1156 - 1165
  • [46] Evaluating Neural Radiance Fields for 3D Plant Geometry Reconstruction in Field Conditions
    Arshad, Muhammad Arbab
    Jubery, Talukder
    Afful, James
    Jignasu, Anushrut
    Balu, Aditya
    Ganapathysubramanian, Baskar
    Sarkar, Soumik
    Krishnamurthy, Adarsh
    PLANT PHENOMICS, 2024, 6
  • [47] High-fidelity 3D reconstruction of plants using Neural Radiance Fields
    Hu, Kewei
    Ying, Wei
    Pan, Yaoqiang
    Kang, Hanwen
    Chen, Chao
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2024, 220
  • [48] Neural radiance fields for multi-scale constraint-free 3D reconstruction and rendering in orchard scenes
    Zhang, Jing
    Wang, Xin
    Ni, Xindong
    Dong, Fangru
    Tang, Longrunmiao
    Sun, Jiahui
    Wang, Ye
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2024, 217
  • [49] 3D Reconstruction and Rendering Based on Improved Neural Radiance Field
    Wan, Xiaona
    Xu, Ziyun
    Kang, Jian
    Feng, Xiaoyi
    2024 3RD INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND MEDIA COMPUTING, ICIPMC 2024, 2024, : 120 - 126
  • [50] 3D DENSITY-GRADIENT BASED EDGE DETECTION ON NEURAL RADIANCE FIELDS (NERFS) FOR GEOMETRIC RECONSTRUCTION
    Jaeger, Miriam
    Jutzi, Boris
    2ND GEOBENCH WORKSHOP ON EVALUATION AND BENCHMARKING OF SENSORS, SYSTEMS AND GEOSPATIAL DATA IN PHOTOGRAMMETRY AND REMOTE SENSING, VOL. 48-1, 2023, : 71 - 78