Depth Estimation in Multi-View Stereo Based on Image Pyramid

被引:1
|
作者
Xu, Hanfei [1 ]
Cai, Yangang [1 ]
Wang, Ronggang [1 ]
机构
[1] Peking Univ, Shenzhen Grad Sch, Shenzhen, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
3D reconstruction; Multi-View Stereo; image pyramid; SILHOUETTE;
D O I
10.1145/3297156.3297238
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D reconstruction using Struct-from-Motion(SFM) and Multi-View Stereo(MVS), along with image-based rendering (IBR), has been applied to the synthesis of the virtual-viewpoint images. We have investigated the latest works, and we find that the underlying 3D reconstruction methods are quite efficient for buildings and regular structure. However, for scenes with weakly textured or discontinuous-depth regions, these methods do not work well. Such regions do not contain reliable or dense 3D information, and as a result, biases will occur in the procedure of synthesizing point clouds. In this paper, we propose a new method using the image pyramid in the depth-map merging based MVS framework. In this method, we use multi-scale image information to estimate depth. Our method can capture more 3D information in weakly textured or discontinuous-depth regions, and finally obtain the better visible effect in the virtual-viewpoint images.
引用
收藏
页码:345 / 349
页数:5
相关论文
共 50 条
  • [1] Adaptive depth estimation for pyramid multi-view stereo
    Liao, Jie
    Fu, Yanping
    Yan, Qingan
    Luo, Fei
    Xiao, Chunxia
    [J]. COMPUTERS & GRAPHICS-UK, 2021, 97 : 268 - 278
  • [2] Cost Volume Pyramid Based Depth Inference for Multi-View Stereo
    Yang, Jiayu
    Mao, Wei
    Alvarez, Jose
    Liu, Miaomiao
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 4748 - 4760
  • [3] Cost Volume Pyramid Based Depth Inference for Multi-View Stereo
    Yang, Jiayu
    Mao, Wei
    Alvarez, Jose M.
    Liu, Miaomiao
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4876 - 4885
  • [4] Continuous Depth Estimation for Multi-view Stereo
    Liu, Yebin
    Cao, Xun
    Dai, Qionghai
    Xu, Wenli
    [J]. CVPR: 2009 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-4, 2009, : 2121 - 2128
  • [5] Recurrent Multi-view Stereo Depth Inference with Pyramid of Images
    Wang, Xiaobao
    Dong, Enzeng
    Tong, Jigang
    Sun, Zhe
    Li, Wenyu
    Duan, Feng
    [J]. PROCEEDINGS OF 2022 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (IEEE ICMA 2022), 2022, : 259 - 263
  • [6] REVISED DEPTH MAP ESTIMATION FOR MULTI-VIEW STEREO
    Yao, Yao
    Zhu, Hao
    Nie, Yongming
    Ji, Xiaoli
    Cao, Xun
    [J]. 2014 INTERNATIONAL CONFERENCE ON 3D IMAGING (IC3D), 2014,
  • [7] Expansion-Based Depth Map Estimation for Multi-View Stereo
    Song, Peng
    Wu, Xiaojun
    Wang, Michael Yu
    Wu, Jianhuang
    [J]. IEEE/RSJ 2010 INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2010), 2010, : 3213 - 3218
  • [8] Unsupervised multi-view stereo network based on multi-stage depth estimation
    Qi, Shuai
    Sang, Xinzhu
    Yan, Binbin
    Wang, Peng
    Chen, Duo
    Wang, Huachun
    Ye, Xiaoqian
    [J]. IMAGE AND VISION COMPUTING, 2022, 122
  • [9] Rethinking Depth Estimation for Multi-View Stereo: A Unified Representation
    Peng, Rui
    Wang, Rongjie
    Wang, Zhenyu
    Lai, Yawen
    Wang, Ronggang
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 8635 - 8644
  • [10] Uncertainty Guided Multi-View Stereo Network for Depth Estimation
    Su, Wanjuan
    Xu, Qingshan
    Tao, Wenbing
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7796 - 7808