Fast Light-field Disparity Estimation with Multi-disparity-scale Cost Aggregation

被引:17
|
作者
Huang, Zhicong [1 ,2 ]
Hu, Xuemei [1 ]
Xue, Zhou [2 ]
Xu, Weizhu [1 ]
Yue, Tao [1 ]
机构
[1] Nanjing Univ, Sch Elect Sci & Engn, Nanjing, Peoples R China
[2] ByteDance Inc, Beijing, Peoples R China
关键词
D O I
10.1109/ICCV48922.2021.00626
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Light field images contain both angular and spatial information of captured light rays. The rich information of light fields enables straightforward disparity recovery capability but demands high computational cost as well. In this paper, we design a lightweight disparity estimation model with physical-based multi-disparity-scale cost volume aggregation for fast disparity estimation. By introducing a sub-network of edge guidance, we significantly improve the recovery of geometric details near edges and improve the overall performance. We test the proposed model extensively on both synthetic and real-captured datasets, which provide both densely and sparsely sampled light fields. Finally, we significantly reduce computation cost and GPU memory consumption, while achieving comparable performance with state-of-the-art disparity estimation methods for light fields.
引用
收藏
页码:6300 / 6309
页数:10
相关论文
共 50 条
  • [1] QUADRATIC FORMULATION OF DISPARITY ESTIMATION PROBLEM FOR LIGHT-FIELD CAMERA
    Tulyakov, Stepan
    Lee, TaeHee
    Han, Heechul
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 2063 - 2067
  • [2] GVLD: A Fast and Accurate GPU-Based Variational Light-Field Disparity Estimation Approach
    Tran, Trung-Hieu
    Mammadov, Gasim
    Simon, Sven
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (07) : 2562 - 2574
  • [3] Fast Light Field Disparity Estimation via a Parallel Filtered Cost Volume Approach
    Stacey, Adam
    Maddern, Will
    Singh, Surya
    COMPUTER VISION - ACCV 2018, PT II, 2019, 11362 : 256 - 268
  • [4] Attention-Based View Selection Networks for Light-Field Disparity Estimation
    Tsai, Yu-Ju
    Liu, Yu-Lun
    Ouhyoung, Ming
    Chuang, Yung-Yu
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12095 - 12103
  • [5] Disparity Estimation for Focused Light Field Camera Using Cost Aggregation in Micro-Images
    Ding, Zhiyu
    Liu, Qian
    Wang, Qing
    2017 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION (ICVRV 2017), 2017, : 366 - 371
  • [6] Light-field spectral decomposition with a spatial–angular consistency prior for disparity estimation
    Liu C.
    Qiu J.
    Wei F.
    Hao Z.
    Optik, 2023, 295
  • [7] Fast and Efficient Neural Network for Light Field Disparity Estimation
    Ma, Dizhi
    Lumsdaine, Andrew
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2920 - 2926
  • [8] Light-Weight EPINET Architecture for Fast Light Field Disparity Estimation
    Hassan, Ali
    Sjostrom, Marten
    Zhang, Tingting
    Egiazarian, Karen
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [9] Fast Disparity Estimation from a Single Compressed Light Field Measurement
    Martinez, Emmanuel
    Vargas, Edwin
    Arguello, Henry
    2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022), 2022, : 1991 - 1995
  • [10] Adaptive EPI-Matching Cost for Light Field Disparity Estimation
    Wang, Tun
    Sheng, Hao
    Chen, Rongshan
    Cong, Ruixuan
    Zhao, Mingyuan
    Cui, Zhenglong
    IEEE Transactions on Instrumentation and Measurement, 2024, 73