Depth-NeuS: Neural Implicit Surfaces Learning for Multi-view Reconstruction Based on Depth Information Optimization

被引:0
|
作者
Wen, Siqi [1 ]
Jiang, Hanqi [1 ]
Zeng, Cheng [1 ]
Chen, Runnan [1 ]
Yuan, Jidong [1 ]
Liang, Shuai [2 ]
Han, Yinhe [2 ]
机构
[1] Beijing Jiaotong Univ, Beijing 100044, Peoples R China
[2] Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
关键词
Neural Implicit Surface Representation; Depth Information Optimization; Multi-View Reconstruction;
D O I
10.1007/978-981-97-5594-3_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, the representation and rendering methods of learning neural implicit surfaces through volume rendering have become more and more popular and have made excellent progress rapidly. However, these methods still face some challenges that existing methods only use surface normal to represent implicit surfaces lack a direct representation of depth information, which makes object reconstruction unrestricted by geometric features, resulting in undesirable reconstruction of objects with texture and color features. In order to solve these problems, we propose a neural implicit surface learning method called Depth-NeuS. To address the deficiencies in the reconstruction of objects with color and texture characteristics, and to enhance the depiction of intricate surface features, we introduce depth loss to explicitly constrain Signed Distance Field (SDF) regression to achieve deep information optimization. Additionally, we integrate photometric loss and geometric loss into loss function as geometric consistency loss to achieve geometric constraints. Empirical experiments have showcased the superior performance of Depth-NeuS over existing technologies across various scenarios. Moreover, it resolves the inadequacies present in current reconstruction methods based on implicit neural representation, particularly in the reconstruction of objects with complex texture and color attributes. Ultimately, Depth-NeuS delivers exceptional quality in surface reconstruction.
引用
收藏
页码:47 / 58
页数:12
相关论文
共 50 条
  • [31] Depth map-based disparity estimation technique using multi-view and depth camera
    Um, Gi-Mun
    Kim, Seung-Man
    Hur, Namho
    Lee, Kwan Hang
    Lee, Soo In
    STEREOSCOPIC DISPLAYS AND VIRTUAL REALITY SYSTEMS XIII, 2006, 6055
  • [32] Segmentation-based view synthesis for multi-view video plus depth
    Loghman, Maziar
    Kim, Joohee
    MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (05) : 1611 - 1625
  • [33] Segmentation-based view synthesis for multi-view video plus depth
    Maziar Loghman
    Joohee Kim
    Multimedia Tools and Applications, 2015, 74 : 1611 - 1625
  • [34] An Immersive Media Recognition Method Using Depth Information of Multi-View Videos
    Yoo, Injae
    Lee, Jaechung
    Jang, Seyoung
    Park, Byeongchan
    Kim, Cheong Ghil
    Kim, Seok-Yoon
    Kim, Youngmo
    HCI INTERNATIONAL 2023 LATE BREAKING PAPERS, HCII 2023, PT V, 2023, 14058 : 235 - 243
  • [35] Removing foreground objects by using depth information from multi-view images
    Lee, Jaeho
    Kim, Changick
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XXX, PTS 1 AND 2, 2007, 6696
  • [36] NR-MVSNet: Learning Multi-View Stereo Based on Normal Consistency and Depth Refinement
    Li, Jingliang
    Lu, Zhengda
    Wang, Yiqun
    Xiao, Jun
    Wang, Ying
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 2649 - 2662
  • [37] 3D hierarchical optimization for multi-view depth map coding
    Maceira Duch, Marc
    Varas, David
    Morros Rubio, Josep Ramon
    Ruiz-Hidalgo, Javier
    Marques, Ferran
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (15) : 19869 - 19894
  • [38] Deep learning based multi-view dense matching with joint depth and surface normal estimation
    Liu, Jin
    Ji, Shunping
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2025, 53 (12): : 2391 - 2403
  • [39] 3D hierarchical optimization for multi-view depth map coding
    Marc Maceira Duch
    David Varas
    Josep Ramon Morros Rubió
    Javier Ruiz-Hidalgo
    Ferran Marques
    Multimedia Tools and Applications, 2018, 77 : 19869 - 19894
  • [40] Multi-view stereo for large-scale scene reconstruction with MRF-based depth inference
    Sun, Shang
    Xu, Dan
    Wu, Hao
    Ying, Haocong
    Mou, Yurui
    COMPUTERS & GRAPHICS-UK, 2022, 106 : 248 - 258