Shell-Guided Compression of Voxel Radiance Fields

被引:0
|
作者
Yang, Peiqi [1 ,2 ]
Ni, Zhangkai [1 ,2 ]
Wang, Hanli [1 ,2 ]
Yang, Wenhan [3 ]
Wang, Shiqi [4 ]
Kwong, Sam [5 ]
机构
[1] Tongji Univ, Sch Comp Sci & Technol, Minist Educ, Shanghai 200092, Peoples R China
[2] Tongji Univ, Key Lab Embedded Syst & Serv Comp, Minist Educ, Shanghai 200092, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518066, Guangdong, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[5] Lingnan Univ, Sch Data Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Voxel grids; 3D reconstruction; surface distillation; model compression; pruning thresholds;
D O I
10.1109/TIP.2025.3538163
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we address the challenge of significant memory consumption and redundant components in large-scale voxel-based model, which are commonly encountered in real-world 3D reconstruction scenarios. We propose a novel method called Shell-guided compression of Voxel Radiance Fields (SVRF), aimed at optimizing voxel-based model into a shell-like structure to reduce storage costs while maintaining rendering accuracy. Specifically, we first introduce a Shell-like Constraint, operating in two main aspects: 1) enhancing the influence of voxels neighboring the surface in determining the rendering outcomes, and 2) expediting the elimination of redundant voxels both inside and outside the surface. Additionally, we introduce an Adaptive Thresholds to ensure appropriate pruning criteria for different scenes. To prevent the erroneous removal of essential object parts, we further employ a Dynamic Pruning Strategy to conduct smooth and precise model pruning during training. The compression method we propose does not necessitate the use of additional labels. It merely requires the guidance of self-supervised learning based on predicted depth. Furthermore, it can be seamlessly integrated into any voxel-grid-based method. Extensive experimental results demonstrate that our method achieves comparable rendering quality while compressing the original number of voxel grids by more than 70%. Our code will be available at: https://github.com/eezkni/SVRF
引用
收藏
页码:1179 / 1191
页数:13
相关论文
共 50 条
  • [31] Editing Conditional Radiance Fields
    Liu, Steven
    Zhang, Xiuming
    Zhang, Zhoutong
    Zhang, Richard
    Zhu, Jun-Yan
    Russell, Bryan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5753 - 5763
  • [32] Neural Transmitted Radiance Fields
    Zhu, Chengxuan
    Wan, Renjie
    Shi, Boxin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [33] Reconstructionless Airborne Radiance Fields
    Praschl, Christoph
    Boess, Leopold
    Schedl, David C.
    PROCEEDINGS OF THE SIGGRAPH 2024 POSTERS, 2024,
  • [34] Deforming Radiance Fields with Cages
    Xu, Tianhan
    Harada, Tatsuya
    COMPUTER VISION - ECCV 2022, PT XXXIII, 2022, 13693 : 159 - 175
  • [35] ARF: Artistic Radiance Fields
    Zhang, Kai
    Kolkin, Nick
    Bi, Sai
    Luan, Fujun
    Xu, Zexiang
    Shechtman, Eli
    Snavely, Noah
    COMPUTER VISION, ECCV 2022, PT XXXI, 2022, 13691 : 717 - 733
  • [36] ThermalNeRF: Thermal Radiance Fields
    Lin, Yvette Y.
    Pan, Xin-Yi
    Fridovich-Keil, Sara
    Wetzstein, Gordon
    2024 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY, ICCP 2024, 2024,
  • [37] TensoRF: Tensorial Radiance Fields
    Chen, Anpei
    Xu, Zexiang
    Geiger, Andreas
    Yu, Jingyi
    Su, Hao
    COMPUTER VISION - ECCV 2022, PT XXXII, 2022, 13692 : 333 - 350
  • [38] CVT-xRF: Contrastive In-Voxel Transformer for 3D Consistent Radiance Fields from Sparse Inputs
    Zhong, Yingji
    Hong, Lanqing
    Li, Zhenguo
    Xu, Dan
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 21466 - 21475
  • [39] Camera and LiDAR Fusion for Urban Scene Reconstruction and Novel View Synthesis via Voxel-Based Neural Radiance Fields
    Chen, Xuanzhu
    Song, Zhenbo
    Zhou, Jun
    Xie, Dong
    Lu, Jianfeng
    REMOTE SENSING, 2023, 15 (18)
  • [40] PW-NeRF: Progressive wavelet-mask guided neural radiance fields view synthesis
    Han, Xuefei
    Liu, Zheng
    Nan, Hai
    Zhao, Kai
    Zhao, Dongjie
    Jin, Xiaodan
    IMAGE AND VISION COMPUTING, 2024, 147