Depth Estimation From Light Field Using Graph-Based Structure-Aware Analysis

被引:25
|
作者
Zhang, Yuchen [1 ]
Dai, Wenrui [2 ]
Xu, Mingxing [1 ]
Zou, Junni [2 ]
Zhang, Xiaopeng [3 ]
Xiong, Hongkai [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[3] Huawei Technol Co Ltd, Noahs Ark Lab, Shanghai 201206, Peoples R China
基金
中国国家自然科学基金;
关键词
Light field; depth map; graph spectral analysis; graph Laplacian matrix; FOURIER-TRANSFORM;
D O I
10.1109/TCSVT.2019.2954948
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Existing light field depth map estimation approaches only utilize partial angular views in occlusion areas and local spatial dependencies in the optimization. This paper proposes a novel two-stage light field depth estimation method via graph spectral analysis to exploit the complete correlations and dependencies within angular patches and spatial images. The initial depth map estimation leverages the undirected graph to jointly consider occluded and unoccluded views within each angular patch. The estimated depth minimizes the structural incoherence of its corresponding angular patch with the focused one by evaluating the highest graph frequency component. Subsequently, depth map refinement optimizes the initial depth map with the color consistency and smoothness formulated by weighted adjacency matrix. The structural constraints are efficiently employed using low-pass graph filtering with Chebyshev polynomial approximation. Experimental results demonstrate that the proposed method improves the depth map estimation, especially in the edge regions.
引用
收藏
页码:4269 / 4283
页数:15
相关论文
共 50 条
  • [1] SGNet: Structure-Aware Graph-Based Network for Airway Semantic Segmentation
    Tan, Zimeng
    Feng, Jianjiang
    Zhou, Jie
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT I, 2021, 12901 : 153 - 163
  • [2] Structure-aware Priority Belief Propagation for Depth Estimation
    Ju, Kuanyu
    Wang, Botao
    Xiong, Hongkai
    [J]. 2015 VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2015,
  • [3] GRAPH-BASED MULTIVIEW DEPTH ESTIMATION USING SEGMENTATION
    Mieloch, Dawid
    Dziembowski, Adrian
    Grzelka, Adam
    Stankiewicz, Olgierd
    Domanski, Marek
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 217 - 222
  • [4] Structure-Aware Residual Pyramid Network for Monocular Depth Estimation
    Chen, Xiaotian
    Chen, Xuejin
    Zha, Zheng-Jun
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 694 - 700
  • [5] Robust Structure-Aware Graph-based Semi-Supervised Learning: Batch and Recursive Processing
    Chen, Xu
    [J]. ACM Transactions on Intelligent Systems and Technology, 2024, 15 (04)
  • [6] Light field depth estimation using occlusion-aware consistency analysis
    Xuechun Wang
    Wentao Chao
    Liang Wang
    Fuqing Duan
    [J]. The Visual Computer, 2023, 39 : 3441 - 3454
  • [7] Light field depth estimation using occlusion-aware consistency analysis
    Wang, Xuechun
    Chao, Wentao
    Wang, Liang
    Duan, Fuqing
    [J]. VISUAL COMPUTER, 2023, 39 (08): : 3441 - 3454
  • [8] Structure-aware human pose estimation with graph convolutional networks
    Bin, Yanrui
    Chen, Zhao-Min
    Wei, Xiu-Shen
    Chen, Xinya
    Gao, Changxin
    Sang, Nong
    [J]. PATTERN RECOGNITION, 2020, 106
  • [9] Segment-Based Depth Estimation in Light Field Using Graph Cut
    Shao, Wenjie
    Sheng, Hao
    Li, Chao
    [J]. KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2015, 2015, 9403 : 248 - 259
  • [10] Multi-Graph Learning Based on Structure-Aware
    Fu, Dong-Lai
    Gao, Ze-An
    [J]. Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2024, 52 (07): : 2407 - 2417