Depth-NeuS: Neural Implicit Surfaces Learning for Multi-view Reconstruction Based on Depth Information Optimization

被引:0
|
作者
Wen, Siqi [1 ]
Jiang, Hanqi [1 ]
Zeng, Cheng [1 ]
Chen, Runnan [1 ]
Yuan, Jidong [1 ]
Liang, Shuai [2 ]
Han, Yinhe [2 ]
机构
[1] Beijing Jiaotong Univ, Beijing 100044, Peoples R China
[2] Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
关键词
Neural Implicit Surface Representation; Depth Information Optimization; Multi-View Reconstruction;
D O I
10.1007/978-981-97-5594-3_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, the representation and rendering methods of learning neural implicit surfaces through volume rendering have become more and more popular and have made excellent progress rapidly. However, these methods still face some challenges that existing methods only use surface normal to represent implicit surfaces lack a direct representation of depth information, which makes object reconstruction unrestricted by geometric features, resulting in undesirable reconstruction of objects with texture and color features. In order to solve these problems, we propose a neural implicit surface learning method called Depth-NeuS. To address the deficiencies in the reconstruction of objects with color and texture characteristics, and to enhance the depiction of intricate surface features, we introduce depth loss to explicitly constrain Signed Distance Field (SDF) regression to achieve deep information optimization. Additionally, we integrate photometric loss and geometric loss into loss function as geometric consistency loss to achieve geometric constraints. Empirical experiments have showcased the superior performance of Depth-NeuS over existing technologies across various scenarios. Moreover, it resolves the inadequacies present in current reconstruction methods based on implicit neural representation, particularly in the reconstruction of objects with complex texture and color attributes. Ultimately, Depth-NeuS delivers exceptional quality in surface reconstruction.
引用
收藏
页码:47 / 58
页数:12
相关论文
共 50 条
  • [21] Multi-view depth estimation based on multi-feature aggregation for 3D reconstruction
    Zhang, Chi
    Liang, Lingyu
    Zhou, Jijun
    Xu, Yong
    COMPUTERS & GRAPHICS-UK, 2024, 122
  • [22] A Novel Depth Information-Guided Multi-View 3D Curve Reconstruction Method
    Fang, Tong
    Chen, Min
    Li, Wen
    Ge, Xuming
    Hu, Han
    Zhu, Qing
    Xu, Bo
    Ouyang, Wenyi
    PHOTOGRAMMETRIC RECORD, 2025, 40 (189):
  • [23] A Joint Learning-Based Method for Multi-View Depth Map Super Resolution
    Li, Jing
    Lu, Zhichao
    Zeng, Gang
    Gan, Rui
    Wang, Long
    Zha, Hongbin
    2013 SECOND IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR 2013), 2013, : 456 - 460
  • [24] Depth Estimation in Multi-View Stereo Based on Image Pyramid
    Xu, Hanfei
    Cai, Yangang
    Wang, Ronggang
    PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE (CSAI 2018) / 2018 THE 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND MULTIMEDIA TECHNOLOGY (ICIMT 2018), 2018, : 345 - 349
  • [25] Efficient compression of multi-view depth data based on MVC
    Merkle, Philipp
    Smolic, Aljoscha
    Mueller, Karsten
    Wiegand, Thomas
    2007 3DTV CONFERENCE, 2007, : 249 - 252
  • [26] Layered Depth Image Based HEVC Multi-view Codec
    Kirshanthan, S.
    Lajanugen, L.
    Panagoda, P. N. D.
    Wijesinghe, L. P.
    De Silva, D. V. S. X.
    Pasqual, A. A.
    ADVANCES IN VISUAL COMPUTING (ISVC 2014), PT II, 2014, 8888 : 376 - 385
  • [27] PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Lattices
    Rosu, Radu Alexandru
    Behnke, Sven
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8466 - 8475
  • [28] Self-supervised Learning of Depth Inference for Multi-view Stereo
    Yang, Jiayu
    Alvarez, Jose M.
    Liu, Miaomiao
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 7522 - 7530
  • [29] Representation Learning with Depth and Breadth for Recommendation Using Multi-view Data
    Han, Xiaotian
    Shi, Chuan
    Zheng, Lei
    Yu, Philip S.
    Li, Jianxin
    Lu, Yuanfu
    WEB AND BIG DATA (APWEB-WAIM 2018), PT I, 2018, 10987 : 181 - 188
  • [30] Non-parametric Depth Distribution Modelling based Depth Inference for Multi-view Stereo
    Yang, Jiayu
    Alvarez, Jose M.
    Liu, Miaomiao
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 8616 - 8624