Unsupervised light field disparity estimation using confidence weight and occlusion-aware

被引:0
|
作者
Xiao, Bo [1 ]
Gao, Xiujing [2 ,3 ]
Zheng, Huadong [4 ]
Yang, Huibao [5 ]
Huang, Hongwu [1 ,2 ,3 ,5 ]
机构
[1] Hunan Univ, State Key Lab Adv Design & Mfg Vehicle Body, 2 Lushan South Rd, Changsha 410082, Peoples R China
[2] Fujian Univ Technol, Sch Smart Marine Sci & Engn, 69 Xuefu South Rd, Fuzhou 350118, Peoples R China
[3] Fujian Prov Key Lab Marine Smart Equipment, 69 Xuefu South Rd, Fuzhou 350118, Peoples R China
[4] Shanghai Univ, Dept Precis Mech Engn, 99 Shangda Rd, Shanghai 200444, Peoples R China
[5] Xiamen Univ, Sch Aerosp Engn, 4221-134 Xiangan North Rd, Xiamen 361102, Peoples R China
关键词
DEPTH; NETWORK; CAMERA; FUSION;
D O I
10.1016/j.optlaseng.2025.108928
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Light field disparity estimation is a crucial topic in computer vision. Currently, deep learning methods have shown significantly improved performance compared to traditional methods, especially supervised learning approaches. However, the high cost of obtaining real-world depth/disparity data for training greatly limits the generalization ability of supervised learning methods. In this paper, we propose an unsupervised learning method for light field depth estimation by utilizing confidence weights to evaluate the reliability of disparity features. First, during the disparity estimation and inference process, we introduce confidence weights to assess the reliability of disparity features, assigning higher weights to non-occluded and low-noise areas to effectively handle errors caused by occlusion and noise. Second, we design an occlusion-aware network to predict occluded regions in the views, which addresses the interference of occluded regions when computing unsupervised loss during training, thus enhancing the overall estimation accuracy. Extensive experimental results show that our method outperforms traditional methods and some of the latest unsupervised learning methods.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Occlusion-Aware Unsupervised Learning of Monocular Depth, Optical Flow and Camera Pose with Geometric Constraints
    Teng, Qianru
    Chen, Yimin
    Huang, Chen
    FUTURE INTERNET, 2018, 10 (10)
  • [42] Robust Light Field Depth Estimation Using Occlusion-Noise Aware Data Costs
    Williem
    Park, In Kyu
    Lee, Kyoung Mu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (10) : 2484 - 2497
  • [43] Pedestrian Emergence Estimation and Occlusion-Aware Risk Assessment for Urban Autonomous Driving
    Koc, Mert
    Yurtsever, Ekim
    Redmill, Keith
    Ozguner, Umit
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 292 - 297
  • [44] Towards Precise Pose Estimation in Robotic Surgery: Introducing Occlusion-Aware Loss
    Park, Jihun
    Hong, Jiuk
    Yoon, Jihun
    Park, Bokyung
    Choi, Min-Kook
    Jung, Heechul
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VI, 2024, 15006 : 639 - 648
  • [45] Occlusion-Aware Networks for 3D Human Pose Estimation in Video
    Cheng, Yu
    Yang, Bo
    Wang, Bo
    Yan, Wending
    Tan, Robby T.
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 723 - 732
  • [46] An Occlusion-aware Edge-Based Method for Monocular 3D Object Tracking using Edge Confidence
    Huang, Hong
    Zhong, Fan
    Sun, Yuqing
    Qin, Xueying
    COMPUTER GRAPHICS FORUM, 2020, 39 (07) : 399 - 409
  • [47] Occlusion-aware Dynamic Human Emotion Recognition Using Landmark Detection
    Engoor, Smitha
    Sendhilkumar, S.
    Sharon, Hepsibah C.
    Mahalakshmi, G. S.
    2020 6TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING AND COMMUNICATION SYSTEMS (ICACCS), 2020, : 795 - 799
  • [48] Enhancing accuracy and sharpness of motion field with adaptive scheme and occlusion-aware filter
    Duc Dung Nguyen
    Jeon, Jae Wook
    IET IMAGE PROCESSING, 2013, 7 (02) : 144 - 153
  • [49] Flow-based frame interpolation networks combined with occlusion-aware mask estimation
    Zhang, Dacheng
    Lei, Weimin
    Zhang, Wei
    Chen, Xinyi
    IET IMAGE PROCESSING, 2020, 14 (17) : 4579 - 4587
  • [50] Occlusion-aware Visual Tracker using Spatial Structural Information and Dominant Features
    Cai, Rongtai
    Zhu, Peng
    INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, 2021, 18 (02) : 191 - 198