Fast Light-field Disparity Estimation with Multi-disparity-scale Cost Aggregation

被引:17
|
作者
Huang, Zhicong [1 ,2 ]
Hu, Xuemei [1 ]
Xue, Zhou [2 ]
Xu, Weizhu [1 ]
Yue, Tao [1 ]
机构
[1] Nanjing Univ, Sch Elect Sci & Engn, Nanjing, Peoples R China
[2] ByteDance Inc, Beijing, Peoples R China
关键词
D O I
10.1109/ICCV48922.2021.00626
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Light field images contain both angular and spatial information of captured light rays. The rich information of light fields enables straightforward disparity recovery capability but demands high computational cost as well. In this paper, we design a lightweight disparity estimation model with physical-based multi-disparity-scale cost volume aggregation for fast disparity estimation. By introducing a sub-network of edge guidance, we significantly improve the recovery of geometric details near edges and improve the overall performance. We test the proposed model extensively on both synthetic and real-captured datasets, which provide both densely and sparsely sampled light fields. Finally, we significantly reduce computation cost and GPU memory consumption, while achieving comparable performance with state-of-the-art disparity estimation methods for light fields.
引用
收藏
页码:6300 / 6309
页数:10
相关论文
共 50 条
  • [41] Regularising disparity estimation via multi task learning with structured light reconstruction
    Weld, Alistair
    Cartucho, Joao
    Xu, Chi
    Davids, Joseph
    Giannarou, Stamatia
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, 2023, 11 (04): : 1206 - 1214
  • [42] Adaptive matching norm based disparity estimation from light field data
    Liu, Chang
    Shi, Ligen
    Zhao, Xing
    Qiu, Jun
    SIGNAL PROCESSING, 2023, 209
  • [43] A LIGHT FIELD FDL-HSIFT FEATURE IN SCALE-DISPARITY SPACE
    Xiao, Zhaolin
    Zhang, Meng
    Jin, Haiyan
    Guillemot, Christine
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1549 - 1553
  • [44] Learning Sub-Pixel Disparity Distribution for Light Field Depth Estimation
    Chao, Wentao
    Wang, Xuechun
    Wang, Yingqian
    Wang, Guanghui
    Duan, Fuqing
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2023, 9 : 1126 - 1138
  • [45] OPAL: Occlusion Pattern Aware Loss for Unsupervised Light Field Disparity Estimation
    Li, Peng
    Zhao, Jiayin
    Wu, Jingyao
    Deng, Chao
    Han, Yuqi
    Wang, Haoqian
    Yu, Tao
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (02) : 681 - 694
  • [46] Morphology-Based Disparity Estimation and Rendering Algorithm for Light Field Images
    Ding, Jian-Jiun
    Wang, Neng-Chien
    Chuang, Shih-Chang
    Chang, Ronald Y.
    2016 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS-TAIWAN (ICCE-TW), 2016, : 325 - 326
  • [47] A Light Field FDL-HCGH Feature in Scale-Disparity Space
    Zhang, Meng
    Jin, Haiyan
    Xiao, Zhaolin
    Guillemot, Christine
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6164 - 6174
  • [48] Block Based Dense Stereo Matching Using Adaptive Cost Aggregation and Limited Disparity Estimation
    Yang, Xiao
    Chen, Xiaobo
    Xi, Juntong
    2017 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC), 2017, : 1892 - 1897
  • [49] Cascade light field disparity estimation network based on unsupervised deep learning
    Liu, Bo
    Chen, Jing
    Leng, Zhen
    Tong, Yanfeng
    Wang, Yongtian
    OPTICS EXPRESS, 2022, 30 (14) : 25130 - 25146
  • [50] Scene Disparity Reconstruction from Light Field Based on Fourier Disparity Layer Representation
    Fei, Wei
    Chang, Liu
    Jun, Qiu
    ACTA OPTICA SINICA, 2022, 42 (16)