3D Multi-scene Stylization Based on Conditional Neural Radiance Fields

被引:0
|
作者
Zhang, Sijia [1 ]
Liu, Ting [1 ]
Li, Zhuoyuan [1 ]
Sun, Yi [1 ]
机构
[1] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian, Liaoning, Peoples R China
来源
关键词
Novel View Synthesis; Neural Radiance Fields; Style Transfer;
D O I
10.1007/978-981-97-4399-5_10
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural Radiation Field (NeRF) is a scene model capable of achieving high-quality view synthesis, optimized for each specific scene. In this paper, we propose a conditional neural radiation field based on multi-resolution hash coding, enabling high-quality synthesis of new views across multiple scenes. By employing multi-resolution hashing to encode 3D positional information, the multilayer perceptron is lightened, thereby reducing memory consumption. The model introduces two latent encodings: shape encoding and appearance encoding, which enhance our model's performance in new view synthesis and scene interpolation. Furthermore, after achieving a robust geometric reconstruction of multiple scenes, we fix the information affecting the scene geometry and utilize a hypernet to predict the parameters of the multilayer perceptron responsible for scene appearance information. This approach facilitates a generalized style transfer across multiple scenes while maintaining the three-dimensional consistency of the scenes.
引用
收藏
页码:103 / 112
页数:10
相关论文
共 50 条
  • [1] Arbitrary 3D stylization of radiance fields
    Zhang, Sijia
    Liu, Ting
    Li, Zhuoyuan
    Sun, Yi
    Image and Vision Computing, 2024, 145
  • [2] Arbitrary 3D stylization of radiance fields
    Zhang, Sijia
    Liu, Ting
    Li, Zhuoyuan
    Sun, Yi
    IMAGE AND VISION COMPUTING, 2024, 145
  • [3] Scene-Conditional 3D Object Stylization and Composition
    Zhou, Jinghao
    Jakab, Tomas
    Torr, Philip
    Rupprecht, Christian
    COMPUTER VISION - ECCV 2024, PT XXXVII, 2025, 15095 : 289 - 305
  • [4] Transforming Radiance Field with Lipschitz Network for Photorealistic 3D Scene Stylization
    Zhang, Zicheng
    Liu, Yinglu
    Han, Congying
    Pan, Yingwei
    Guo, Tiande
    Yao, Ting
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 20712 - 20721
  • [5] Monocular thermal SLAM with neural radiance fields for 3D scene reconstruction
    Wu, Yuzhen
    Wang, Lingxue
    Zhang, Lian
    Chen, Mingkun
    Zhao, Wenqu
    Zheng, Dezhi
    Cai, Yi
    NEUROCOMPUTING, 2025, 617
  • [6] GSNeRF: Generalizable Semantic Neural Radiance Fields with Enhanced 3D Scene Understanding
    Chou, Zi-Ting
    Huang, Sheng-Yu
    Liu, I-Jieh
    Wang, Yu-Chiang Frank
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 20806 - 20815
  • [7] UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scene
    Chen, Yaosen
    Yuan, Qi
    Li, Zhiqiang
    Liu, Yuegen
    Wang, Wei
    Xie, Chaoping
    Wen, Xuming
    Yu, Qien
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2025, 31 (04) : 2045 - 2057
  • [8] Research on 3D Visualization of Drone Scenes Based on Neural Radiance Fields
    Jin, Pengfei
    Yu, Zhuoyuan
    ELECTRONICS, 2024, 13 (09)
  • [9] PNeSM: Arbitrary 3D Scene Stylization via Prompt-Based Neural Style Mapping
    Chen, Jiafu
    Xing, Wei
    Sun, Jiakai
    Chu, Tianyi
    Huang, Yiling
    Ji, Boyan
    Zhao, Lei
    Lin, Huaizhong
    Chen, Haibo
    Wang, Zhizhong
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 1091 - 1099
  • [10] Neural Radiance Fields Explode on the Scene
    Dellaert, Frank
    COMMUNICATIONS OF THE ACM, 2022, 65 (01) : 98 - 98