Unsupervised light field disparity estimation using confidence weight and occlusion-aware

被引:0
|
作者
Xiao, Bo [1 ]
Gao, Xiujing [2 ,3 ]
Zheng, Huadong [4 ]
Yang, Huibao [5 ]
Huang, Hongwu [1 ,2 ,3 ,5 ]
机构
[1] Hunan Univ, State Key Lab Adv Design & Mfg Vehicle Body, 2 Lushan South Rd, Changsha 410082, Peoples R China
[2] Fujian Univ Technol, Sch Smart Marine Sci & Engn, 69 Xuefu South Rd, Fuzhou 350118, Peoples R China
[3] Fujian Prov Key Lab Marine Smart Equipment, 69 Xuefu South Rd, Fuzhou 350118, Peoples R China
[4] Shanghai Univ, Dept Precis Mech Engn, 99 Shangda Rd, Shanghai 200444, Peoples R China
[5] Xiamen Univ, Sch Aerosp Engn, 4221-134 Xiangan North Rd, Xiamen 361102, Peoples R China
关键词
DEPTH; NETWORK; CAMERA; FUSION;
D O I
10.1016/j.optlaseng.2025.108928
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Light field disparity estimation is a crucial topic in computer vision. Currently, deep learning methods have shown significantly improved performance compared to traditional methods, especially supervised learning approaches. However, the high cost of obtaining real-world depth/disparity data for training greatly limits the generalization ability of supervised learning methods. In this paper, we propose an unsupervised learning method for light field depth estimation by utilizing confidence weights to evaluate the reliability of disparity features. First, during the disparity estimation and inference process, we introduce confidence weights to assess the reliability of disparity features, assigning higher weights to non-occluded and low-noise areas to effectively handle errors caused by occlusion and noise. Second, we design an occlusion-aware network to predict occluded regions in the views, which addresses the interference of occluded regions when computing unsupervised loss during training, thus enhancing the overall estimation accuracy. Extensive experimental results show that our method outperforms traditional methods and some of the latest unsupervised learning methods.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Beyond Photometric Consistency: Geometry-Based Occlusion-Aware Unsupervised Light Field Disparity Estimation
    Zhou, Wenhui
    Lin, Lili
    Hong, Yongjie
    Li, Qiujian
    Shen, Xingfa
    Kuruoglu, Ercan Engin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 15660 - 15674
  • [2] Beyond Photometric Consistency: Geometry-Based Occlusion-Aware Unsupervised Light Field Disparity Estimation
    Zhou, Wenhui
    Lin, Lili
    Hong, Yongjie
    Li, Qiujian
    Shen, Xingfa
    Kuruoglu, Ercan Engin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 15660 - 15674
  • [3] OPAL: Occlusion Pattern Aware Loss for Unsupervised Light Field Disparity Estimation
    Li, Peng
    Zhao, Jiayin
    Wu, Jingyao
    Deng, Chao
    Han, Yuqi
    Wang, Haoqian
    Yu, Tao
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (02) : 681 - 694
  • [4] Occlusion-Aware Depth Estimation Using Sparse Light Field Coding
    Johannsen, Ole
    Sulc, Antonin
    Goldluecke, Bastian
    PATTERN RECOGNITION, GCPR 2016, 2016, 9796 : 207 - 218
  • [5] Occlusion-aware Depth Estimation Using Light-field Cameras
    Wang, Ting-Chun
    Efros, Alexei A.
    Ramamoorthi, Ravi
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 3487 - 3495
  • [6] Light field depth estimation using occlusion-aware consistency analysis
    Wang, Xuechun
    Chao, Wentao
    Wang, Liang
    Duan, Fuqing
    VISUAL COMPUTER, 2023, 39 (08): : 3441 - 3454
  • [7] Light field depth estimation using occlusion-aware consistency analysis
    Xuechun Wang
    Wentao Chao
    Liang Wang
    Fuqing Duan
    The Visual Computer, 2023, 39 : 3441 - 3454
  • [8] Occlusion-Aware Unsupervised Light Field Depth Estimation Based on Multi-Scale GANs
    Yan, Wenbin
    Zhang, Xiaogang
    Chen, Hua
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 6318 - 6333
  • [9] Unsupervised Occlusion-Aware Stereo Matching With Directed Disparity Smoothing
    Li, Ang
    Yuan, Zejian
    Ling, Yonggen
    Chi, Wanchao
    Zhang, Shenghao
    Zhang, Chong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 7457 - 7468
  • [10] Occlusion-aware light field depth estimation with view attention
    Wang, Xucheng
    Tao, Chenning
    Zheng, Zhenrong
    OPTICS AND LASERS IN ENGINEERING, 2023, 160