Depth-NeuS: Neural Implicit Surfaces Learning for Multi-view Reconstruction Based on Depth Information Optimization

被引:0
|
作者
Wen, Siqi [1 ]
Jiang, Hanqi [1 ]
Zeng, Cheng [1 ]
Chen, Runnan [1 ]
Yuan, Jidong [1 ]
Liang, Shuai [2 ]
Han, Yinhe [2 ]
机构
[1] Beijing Jiaotong Univ, Beijing 100044, Peoples R China
[2] Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
关键词
Neural Implicit Surface Representation; Depth Information Optimization; Multi-View Reconstruction;
D O I
10.1007/978-981-97-5594-3_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, the representation and rendering methods of learning neural implicit surfaces through volume rendering have become more and more popular and have made excellent progress rapidly. However, these methods still face some challenges that existing methods only use surface normal to represent implicit surfaces lack a direct representation of depth information, which makes object reconstruction unrestricted by geometric features, resulting in undesirable reconstruction of objects with texture and color features. In order to solve these problems, we propose a neural implicit surface learning method called Depth-NeuS. To address the deficiencies in the reconstruction of objects with color and texture characteristics, and to enhance the depiction of intricate surface features, we introduce depth loss to explicitly constrain Signed Distance Field (SDF) regression to achieve deep information optimization. Additionally, we integrate photometric loss and geometric loss into loss function as geometric consistency loss to achieve geometric constraints. Empirical experiments have showcased the superior performance of Depth-NeuS over existing technologies across various scenarios. Moreover, it resolves the inadequacies present in current reconstruction methods based on implicit neural representation, particularly in the reconstruction of objects with complex texture and color attributes. Ultimately, Depth-NeuS delivers exceptional quality in surface reconstruction.
引用
收藏
页码:47 / 58
页数:12
相关论文
共 50 条
  • [41] Indoor scene reconstruction using a projection-based registration technique of multi-view depth images
    Kim, S
    Woo, W
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2005, PT 2, 2005, 3768 : 759 - 771
  • [42] Inverse Depth Adaptive Weighting Based Multi-View Triangulation Method
    Fang W.
    Yang K.
    Fang, Wei (fangwei@bupt.edu.cn), 1600, Science Press (47):
  • [43] Inverse Depth Adaptive Weighting Based Multi-View Triangulation Method
    Fang Wei
    Yang Kui
    CHINESE JOURNAL OF LASERS-ZHONGGUO JIGUANG, 2020, 47 (12):
  • [44] Gradient-domain-based enhancement of multi-view depth video
    Liu, Qiong
    Zha, Zhengjun
    Yang, Yang
    INFORMATION SCIENCES, 2014, 281 : 750 - 761
  • [45] Cost Volume Pyramid Based Depth Inference for Multi-View Stereo
    Yang, Jiayu
    Mao, Wei
    Alvarez, Jose M.
    Liu, Miaomiao
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4876 - 4885
  • [46] Cost Volume Pyramid Based Depth Inference for Multi-View Stereo
    Yang, Jiayu
    Mao, Wei
    Alvarez, Jose
    Liu, Miaomiao
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 4748 - 4760
  • [47] A Color Correction Algorithm of Multi-view Video Based on Depth Segmentation
    Fei, Yue
    Yu, Mei
    Shao, Feng
    Jiang, Gangyi
    ISCSCT 2008: INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE AND COMPUTATIONAL TECHNOLOGY, VOL 2, PROCEEDINGS, 2008, : 206 - 209
  • [48] DEPTH BASED REGION OF INTEREST EXTRACTION FOR MULTI-VIEW VIDEO CODING
    Zhang, Yun
    Yu, Mei
    Jiang, Gang-Yi
    PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 2221 - 2227
  • [49] Edge-Based Algorithm for Multi-view Depth Map Generation
    Zuo, Yifan
    An, Ping
    Zhang, Zhaoyang
    ADVANCES ON DIGITAL TELEVISION AND WIRELESS MULTIMEDIA COMMUNICATIONS, 2012, 331 : 485 - 491
  • [50] Expansion-Based Depth Map Estimation for Multi-View Stereo
    Song, Peng
    Wu, Xiaojun
    Wang, Michael Yu
    Wu, Jianhuang
    IEEE/RSJ 2010 INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2010), 2010, : 3213 - 3218