Unsupervised light field disparity estimation using confidence weight and occlusion-aware

被引:0
|
作者
Xiao, Bo [1 ]
Gao, Xiujing [2 ,3 ]
Zheng, Huadong [4 ]
Yang, Huibao [5 ]
Huang, Hongwu [1 ,2 ,3 ,5 ]
机构
[1] Hunan Univ, State Key Lab Adv Design & Mfg Vehicle Body, 2 Lushan South Rd, Changsha 410082, Peoples R China
[2] Fujian Univ Technol, Sch Smart Marine Sci & Engn, 69 Xuefu South Rd, Fuzhou 350118, Peoples R China
[3] Fujian Prov Key Lab Marine Smart Equipment, 69 Xuefu South Rd, Fuzhou 350118, Peoples R China
[4] Shanghai Univ, Dept Precis Mech Engn, 99 Shangda Rd, Shanghai 200444, Peoples R China
[5] Xiamen Univ, Sch Aerosp Engn, 4221-134 Xiangan North Rd, Xiamen 361102, Peoples R China
关键词
DEPTH; NETWORK; CAMERA; FUSION;
D O I
10.1016/j.optlaseng.2025.108928
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Light field disparity estimation is a crucial topic in computer vision. Currently, deep learning methods have shown significantly improved performance compared to traditional methods, especially supervised learning approaches. However, the high cost of obtaining real-world depth/disparity data for training greatly limits the generalization ability of supervised learning methods. In this paper, we propose an unsupervised learning method for light field depth estimation by utilizing confidence weights to evaluate the reliability of disparity features. First, during the disparity estimation and inference process, we introduce confidence weights to assess the reliability of disparity features, assigning higher weights to non-occluded and low-noise areas to effectively handle errors caused by occlusion and noise. Second, we design an occlusion-aware network to predict occluded regions in the views, which addresses the interference of occluded regions when computing unsupervised loss during training, thus enhancing the overall estimation accuracy. Extensive experimental results show that our method outperforms traditional methods and some of the latest unsupervised learning methods.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Occlusion-Aware Crowd Navigation Using People as Sensors
    Mun, Ye-Ji
    Itkina, Masha
    Liu, Shuijing
    Driggs-Campbell, Katherine
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 12031 - 12037
  • [32] Cascade light field disparity estimation network based on unsupervised deep learning
    Liu, Bo
    Chen, Jing
    Leng, Zhen
    Tong, Yanfeng
    Wang, Yongtian
    OPTICS EXPRESS, 2022, 30 (14) : 25130 - 25146
  • [33] Light-Weight EPINET Architecture for Fast Light Field Disparity Estimation
    Hassan, Ali
    Sjostrom, Marten
    Zhang, Tingting
    Egiazarian, Karen
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [34] Robust, Occlusion-aware Pose Estimation for Objects Grasped by Adaptive Hands
    Wen, Bowen
    Mitash, Chaitanya
    Soorian, Sruthi
    Kimmel, Andrew
    Sintov, Avishai
    Bekris, Kostas E.
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 6210 - 6217
  • [35] Torso Orientation: A New Clue for Occlusion-Aware Human Pose Estimation
    Yu, Yang
    Yang, Baoyao
    Yuen, Pong C.
    2016 24TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2016, : 908 - 912
  • [36] Unsupervised disparity estimation from light field using plug-and-play weighted warping loss
    Iwatsuki, Taisei
    Takahashi, Keita
    Fujii, Toshiaki
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 107
  • [37] CONet: Crowd and occlusion-aware network for occluded human pose estimation
    Bai, Xiuxiu
    Wei, Xing
    Wang, Zengying
    Zhang, Miao
    NEURAL NETWORKS, 2024, 172
  • [38] Robust Local Light Field Synthesis via Occlusion-aware Sampling and Deep Visual Feature Fusion
    Wenpeng Xing
    Jie Chen
    Yike Guo
    Machine Intelligence Research, 2023, 20 : 408 - 420
  • [39] Robust Local Light Field Synthesis via Occlusion-aware Sampling and Deep Visual Feature Fusion
    Xing, Wenpeng
    Chen, Jie
    Guo, Yike
    MACHINE INTELLIGENCE RESEARCH, 2023, 20 (03) : 408 - 420
  • [40] Depth from Defocus with Learned Optics for Imaging and Occlusion-aware Depth Estimation
    Ikoma, Hayato
    Nguyen, Cindy M.
    Metzler, Christopher A.
    Peng, Yifan
    Wetzstein, Gordon
    2021 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2021,