Shell-Guided Compression of Voxel Radiance Fields

被引:0
|
作者
Yang, Peiqi [1 ,2 ]
Ni, Zhangkai [1 ,2 ]
Wang, Hanli [1 ,2 ]
Yang, Wenhan [3 ]
Wang, Shiqi [4 ]
Kwong, Sam [5 ]
机构
[1] Tongji Univ, Sch Comp Sci & Technol, Minist Educ, Shanghai 200092, Peoples R China
[2] Tongji Univ, Key Lab Embedded Syst & Serv Comp, Minist Educ, Shanghai 200092, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518066, Guangdong, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[5] Lingnan Univ, Sch Data Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Voxel grids; 3D reconstruction; surface distillation; model compression; pruning thresholds;
D O I
10.1109/TIP.2025.3538163
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we address the challenge of significant memory consumption and redundant components in large-scale voxel-based model, which are commonly encountered in real-world 3D reconstruction scenarios. We propose a novel method called Shell-guided compression of Voxel Radiance Fields (SVRF), aimed at optimizing voxel-based model into a shell-like structure to reduce storage costs while maintaining rendering accuracy. Specifically, we first introduce a Shell-like Constraint, operating in two main aspects: 1) enhancing the influence of voxels neighboring the surface in determining the rendering outcomes, and 2) expediting the elimination of redundant voxels both inside and outside the surface. Additionally, we introduce an Adaptive Thresholds to ensure appropriate pruning criteria for different scenes. To prevent the erroneous removal of essential object parts, we further employ a Dynamic Pruning Strategy to conduct smooth and precise model pruning during training. The compression method we propose does not necessitate the use of additional labels. It merely requires the guidance of self-supervised learning based on predicted depth. Furthermore, it can be seamlessly integrated into any voxel-grid-based method. Extensive experimental results demonstrate that our method achieves comparable rendering quality while compressing the original number of voxel grids by more than 70%. Our code will be available at: https://github.com/eezkni/SVRF
引用
收藏
页码:1179 / 1191
页数:13
相关论文
共 50 条
  • [1] TinyNeRF: Towards 100x Compression of Voxel Radiance Fields
    Zhao, Tianli
    Chen, Jiayuan
    Leng, Cong
    Cheng, Jian
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 3588 - 3596
  • [2] DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes
    Liu, Jia-Wei
    Cao, Yan-Pei
    Mao, Weijia
    Zhang, Wenqiao
    Zhang, David Junhao
    Keppo, Jussi
    Shan, Ying
    Qie, Xiaohu
    Shou, Mike Zheng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [3] Depth Guided Fast Rendering Neural Radiance Fields
    Zhang, Tao
    Wang, Haoqian
    2024 3RD CONFERENCE ON FULLY ACTUATED SYSTEM THEORY AND APPLICATIONS, FASTA 2024, 2024, : 860 - 867
  • [4] Slot-guided Volumetric Object Radiance Fields
    Qi, Di
    Yang, Tong
    Zhang, Xiangyu
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [5] EGGS: Edge Guided Gaussian Splatting for Radiance Fields
    Gong, Yuanhao
    29TH INTERNATIONAL ACM CONFERENCE ON 3D WEB TECHNOLOGY, WEB3D 2024, 2024,
  • [6] Single-Mask Inpainting for Voxel-Based Neural Radiance Fields
    Chen, Jiafu
    Chu, Tianyi
    Sun, Jiakai
    Xing, Wei
    Zhao, Lei
    COMPUTER VISION-ECCV 2024, PT LVII, 2025, 15115 : 109 - 126
  • [7] Static-Scene Video Compression with Neural Radiance Fields
    Yang, Runyu
    Liu, Dong
    Wu, Feng
    Gao, Wen
    2024 DATA COMPRESSION CONFERENCE, DCC, 2024, : 598 - 598
  • [8] Reference-guided Controllable Inpainting of Neural Radiance Fields
    Mirzaei, Ashkan
    Aumentado-Armstrong, Tristan
    Brubaker, Marcus A.
    Kelly, Jonathan
    Levinshtein, Alex
    Derpanis, Konstantinos G.
    Gilitschenski, Igor
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 17769 - 17779
  • [9] Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction
    Sun, Cheng
    Sun, Min
    Chen, Hwann-Tzong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5449 - 5459
  • [10] Voxel Grid Performer: Efficient radiance fields generalization for human novel view synthesis
    Fan, Zhongyi
    Liu, Ming
    Zhao, Yuejin
    Dong, Liquan
    Hui, Mei
    Kong, Lingqin
    Yang, Qikun
    OPTICAL METROLOGY AND INSPECTION FOR INDUSTRIAL APPLICATIONS IX, 2022, 12319