Depth-NeuS: Neural Implicit Surfaces Learning for Multi-view Reconstruction Based on Depth Information Optimization

被引:0
|
作者
Wen, Siqi [1 ]
Jiang, Hanqi [1 ]
Zeng, Cheng [1 ]
Chen, Runnan [1 ]
Yuan, Jidong [1 ]
Liang, Shuai [2 ]
Han, Yinhe [2 ]
机构
[1] Beijing Jiaotong Univ, Beijing 100044, Peoples R China
[2] Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
关键词
Neural Implicit Surface Representation; Depth Information Optimization; Multi-View Reconstruction;
D O I
10.1007/978-981-97-5594-3_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, the representation and rendering methods of learning neural implicit surfaces through volume rendering have become more and more popular and have made excellent progress rapidly. However, these methods still face some challenges that existing methods only use surface normal to represent implicit surfaces lack a direct representation of depth information, which makes object reconstruction unrestricted by geometric features, resulting in undesirable reconstruction of objects with texture and color features. In order to solve these problems, we propose a neural implicit surface learning method called Depth-NeuS. To address the deficiencies in the reconstruction of objects with color and texture characteristics, and to enhance the depiction of intricate surface features, we introduce depth loss to explicitly constrain Signed Distance Field (SDF) regression to achieve deep information optimization. Additionally, we integrate photometric loss and geometric loss into loss function as geometric consistency loss to achieve geometric constraints. Empirical experiments have showcased the superior performance of Depth-NeuS over existing technologies across various scenarios. Moreover, it resolves the inadequacies present in current reconstruction methods based on implicit neural representation, particularly in the reconstruction of objects with complex texture and color attributes. Ultimately, Depth-NeuS delivers exceptional quality in surface reconstruction.
引用
收藏
页码:47 / 58
页数:12
相关论文
共 50 条
  • [1] NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction
    Wang, Peng
    Liu, Lingjie
    Liu, Yuan
    Theobalt, Christian
    Komura, Taku
    Wang, Wenping
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [2] NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstruction
    Wang, Yiming
    Han, Qin
    Habermann, Marc
    Daniilidis, Kostas
    Theobalt, Christian
    Liu, Lingjie
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 3272 - 3283
  • [3] Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstruction
    Fu, Qiancheng
    Xu, Qingshan
    Ong, Yew-Soon
    Tao, Wenbing
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [4] Res-NeuS: Deep Residuals and Neural Implicit Surface Learning for Multi-View Reconstruction
    Wang, Wei
    Gao, Fengjiao
    Shen, Yongliang
    SENSORS, 2024, 24 (03)
  • [5] Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflection
    Ge, Wenhang
    Hu, Tao
    Zhao, Haoyu
    Liu, Shu
    Chen, Ying-Cong
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 4228 - 4237
  • [6] Sat-Mesh: Learning Neural Implicit Surfaces for Multi-View Satellite Reconstruction
    Qu, Yingjie
    Deng, Fei
    REMOTE SENSING, 2023, 15 (17)
  • [7] UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction
    Oechsle, Michael
    Peng, Songyou
    Geiger, Andreas
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5569 - 5579
  • [8] Better Together: Shading Cues and Multi-View Stereo for Reconstruction Depth Optimization
    Liang, Zhe
    Xu, Chao
    Hu, Jing
    Li, Yushi
    Meng, Zhaopeng
    IEEE ACCESS, 2020, 8 : 112348 - 112356
  • [9] ACCURATE MULTI-VIEW DEPTH RECONSTRUCTION WITH OCCLUSIONS HANDLING
    Niquin, Cedric
    Prevost, Stephanie
    Remion, Yannick
    2009 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO, 2009, : 101 - 104
  • [10] Learning Depth for Multi-View Stereo with Adversarial Training
    Wang, Liang
    Fan, Deqiao
    Li, Jianshu
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 1674 - 1679