Shell-Guided Compression of Voxel Radiance Fields

被引:0
|
作者
Yang, Peiqi [1 ,2 ]
Ni, Zhangkai [1 ,2 ]
Wang, Hanli [1 ,2 ]
Yang, Wenhan [3 ]
Wang, Shiqi [4 ]
Kwong, Sam [5 ]
机构
[1] Tongji Univ, Sch Comp Sci & Technol, Minist Educ, Shanghai 200092, Peoples R China
[2] Tongji Univ, Key Lab Embedded Syst & Serv Comp, Minist Educ, Shanghai 200092, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518066, Guangdong, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[5] Lingnan Univ, Sch Data Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Voxel grids; 3D reconstruction; surface distillation; model compression; pruning thresholds;
D O I
10.1109/TIP.2025.3538163
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we address the challenge of significant memory consumption and redundant components in large-scale voxel-based model, which are commonly encountered in real-world 3D reconstruction scenarios. We propose a novel method called Shell-guided compression of Voxel Radiance Fields (SVRF), aimed at optimizing voxel-based model into a shell-like structure to reduce storage costs while maintaining rendering accuracy. Specifically, we first introduce a Shell-like Constraint, operating in two main aspects: 1) enhancing the influence of voxels neighboring the surface in determining the rendering outcomes, and 2) expediting the elimination of redundant voxels both inside and outside the surface. Additionally, we introduce an Adaptive Thresholds to ensure appropriate pruning criteria for different scenes. To prevent the erroneous removal of essential object parts, we further employ a Dynamic Pruning Strategy to conduct smooth and precise model pruning during training. The compression method we propose does not necessitate the use of additional labels. It merely requires the guidance of self-supervised learning based on predicted depth. Furthermore, it can be seamlessly integrated into any voxel-grid-based method. Extensive experimental results demonstrate that our method achieves comparable rendering quality while compressing the original number of voxel grids by more than 70%. Our code will be available at: https://github.com/eezkni/SVRF
引用
收藏
页码:1179 / 1191
页数:13
相关论文
共 50 条
  • [41] Neural Sparse Voxel Fields
    Liu, Lingjie
    Gu, Jiatao
    Lin, Kyaw Zaw
    Chua, Tat-Seng
    Theobalt, Christian
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [42] Bilateral Guided Radiance Field Processing
    Wang, Yuehao
    Wang, Chaoyi
    Gong, Bingchen
    Xue, Tianfan
    ACM TRANSACTIONS ON GRAPHICS, 2024, 43 (04):
  • [43] Uncertainty Guided Policy for Active Robotic 3D Reconstruction Using Neural Radiance Fields
    Lee, Soomin
    Chen, Le
    Wang, Jiahao
    Liniger, Alexander
    Kumar, Suryansh
    Yu, Fisher
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04): : 12070 - 12077
  • [44] ID-NeRF: Indirect diffusion-guided neural radiance fields for generalizable view synthesis
    Li, Yaokun
    Wang, Shuaixian
    Tan, Guang
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 266
  • [45] gCoRF: Generative Compositional Radiance Fields
    Mallikarjun, B. R.
    Tewari, Ayush
    Pan, Xingang
    Elgharib, Mohamed
    Theobalt, Christian
    2022 INTERNATIONAL CONFERENCE ON 3D VISION, 3DV, 2022, : 567 - 576
  • [46] GARField: Group Anything with Radiance Fields
    Kim, Chung Min
    Wu, Mingxuan
    Kerr, Justin
    Goldberg, Ken
    Tancik, Matthew
    Kanazawa, Angjoo
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 21530 - 21539
  • [47] NeRFReN: Neural Radiance Fields with Reflections
    Guo, Yuan-Chen
    Kang, Di
    Bao, Linchao
    He, Yu
    Zhang, Song-Hai
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18388 - 18397
  • [48] Neural Radiance Fields with LiDAR Maps
    Chang, Ming-Fang
    Sharma, Akash
    Kaess, Michael
    Lucey, Simon
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 17868 - 17877
  • [49] Locally Stylized Neural Radiance Fields
    Pang, Hong-Wing
    Hua, Binh-Son
    Yeung, Sai-Kit
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 307 - 316
  • [50] CoNeRF: Controllable Neural Radiance Fields
    Kania, Kacper
    Yi, Kwang Moo
    Kowalski, Marek
    Trzciniski, Tomasz
    Tagliasacchi, Andrea
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18602 - 18611