Shell-Guided Compression of Voxel Radiance Fields

被引:0
|
作者
Yang, Peiqi [1 ,2 ]
Ni, Zhangkai [1 ,2 ]
Wang, Hanli [1 ,2 ]
Yang, Wenhan [3 ]
Wang, Shiqi [4 ]
Kwong, Sam [5 ]
机构
[1] Tongji Univ, Sch Comp Sci & Technol, Minist Educ, Shanghai 200092, Peoples R China
[2] Tongji Univ, Key Lab Embedded Syst & Serv Comp, Minist Educ, Shanghai 200092, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518066, Guangdong, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[5] Lingnan Univ, Sch Data Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Voxel grids; 3D reconstruction; surface distillation; model compression; pruning thresholds;
D O I
10.1109/TIP.2025.3538163
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we address the challenge of significant memory consumption and redundant components in large-scale voxel-based model, which are commonly encountered in real-world 3D reconstruction scenarios. We propose a novel method called Shell-guided compression of Voxel Radiance Fields (SVRF), aimed at optimizing voxel-based model into a shell-like structure to reduce storage costs while maintaining rendering accuracy. Specifically, we first introduce a Shell-like Constraint, operating in two main aspects: 1) enhancing the influence of voxels neighboring the surface in determining the rendering outcomes, and 2) expediting the elimination of redundant voxels both inside and outside the surface. Additionally, we introduce an Adaptive Thresholds to ensure appropriate pruning criteria for different scenes. To prevent the erroneous removal of essential object parts, we further employ a Dynamic Pruning Strategy to conduct smooth and precise model pruning during training. The compression method we propose does not necessitate the use of additional labels. It merely requires the guidance of self-supervised learning based on predicted depth. Furthermore, it can be seamlessly integrated into any voxel-grid-based method. Extensive experimental results demonstrate that our method achieves comparable rendering quality while compressing the original number of voxel grids by more than 70%. Our code will be available at: https://github.com/eezkni/SVRF
引用
收藏
页码:1179 / 1191
页数:13
相关论文
共 50 条
  • [21] PhD Forum: Distributed Radiance Fields for Edge Video Compression and Metaverse Integration in Autonomous Driving
    Dopiriak, Matus
    2024 IEEE INTERNATIONAL CONFERENCE ON SMART COMPUTING, SMARTCOMP 2024, 2024, : 262 - 263
  • [22] Robust Dynamic Radiance Fields
    Liu, Yu-Lun
    Gao, Chen
    Meuleman, Andreas
    Tseng, Hung-Yu
    Saraf, Ayush
    Kim, Changil
    Chuang, Yung-Yu
    Kopf, Johannes
    Huang, Jia-Bin
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 13 - 23
  • [23] SG-NeRF: Semantic-guided Point-based Neural Radiance Fields
    Qu, Yansong
    Wang, Yuze
    Qi, Yue
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 570 - 575
  • [24] SLOTLIFTER: Slot-Guided Feature Lifting for Learning Object-Centric Radiance Fields
    Liu, Yu
    Jia, Baoxiong
    Chen, Yixin
    Huang, Siyuan
    COMPUTER VISION - ECCV 2024, PT IX, 2025, 15067 : 270 - 288
  • [25] Interactive Segmentation of Radiance Fields
    Goel, Rahul
    Sirikonda, Dhawal
    Saini, Saurabh
    Narayanan, P. J.
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 4201 - 4211
  • [26] Colorizing Monochromatic Radiance Fields
    Cheng, Yean
    Wan, Renjie
    Weng, Shuchen
    Zhu, Chengxuan
    Chang, Yakun
    Shi, Boxin
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 1317 - 1325
  • [27] SlimmeRF: Slimmable Radiance Fields
    Yuan, Shiran
    Zhao, Hao
    2024 INTERNATIONAL CONFERENCE IN 3D VISION, 3DV 2024, 2024, : 64 - 74
  • [28] Enhancing View Synthesis with Depth-Guided Neural Radiance Fields and Improved Depth Completion
    Wang, Bojun
    Zhang, Danhong
    Su, Yixin
    Zhang, Huajun
    SENSORS, 2024, 24 (06)
  • [29] Depth-Guided Optimization of Neural Radiance Fields for Indoor Multi-View Stereo
    Wei, Yi
    Liu, Shaohui
    Zhou, Jie
    Lu, Jiwen
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (09) : 10835 - 10849
  • [30] DeRF: Decomposed Radiance Fields
    Rebain, Daniel
    Jiang, Wei
    Yazdani, Soroosh
    Li, Ke
    Yi, Kwang Moo
    Tagliasacchi, Andrea
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 14148 - 14156