Attention-based Multi-Level Fusion Network for Light Field Depth Estimation

被引:0
|
作者
Chen, Jiaxin [1 ,2 ]
Zhang, Shuo [1 ,2 ,3 ]
Lin, Youfang [1 ,2 ,3 ,4 ]
机构
[1] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing, Peoples R China
[2] Beijing Key Lab Traff Data Anal & Min, Beijing, Peoples R China
[3] CAAC Key Lab Intelligent Passenger Serv Civil Avi, Beijing, Peoples R China
[4] Key Lab Transport Ind Big Data Appalicat Technol, Beijing, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Depth estimation from Light Field (LF) images is a crucial basis for LF related applications. Since multiple views with abundant information are available, how to effectively fuse features of these views is a key point for accurate LF depth estimation. In this paper, we propose a novel attention-based multi-level fusion network. Combining with the four-branch structure, we design intra-branch fusion strategy and inter-branch fusion strategy to hierarchically fuse effective features from different views. By introducing the attention mechanism, features of views with less occlusions and richer textures are selected inside and between these branches to provide more effective information for depth estimation. The depth maps are finally estimated after further aggregation. Experimental results show the proposed method achieves state-of-the-art performance in both quantitative and qualitative evaluation, which also ranks first in the commonly used HCI 4D Light Field Benchmark.
引用
收藏
页码:1009 / 1017
页数:9
相关论文
共 50 条
  • [1] Estimation of Light Field Depth Based on Multi-Level Network Optimization
    Xiang Sen
    Huang Nanting
    Deng Huiping
    Wu Jin
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (10)
  • [2] Decoupled and Reparameterized Compound Attention-Based Light Field Depth Estimation Network
    Liao, Wan
    Bai, Xiaoqi
    Zhang, Qian
    Cao, Jie
    Fu, Haoyu
    Wei, Wei
    Wang, Bin
    Yan, Tao
    [J]. IEEE ACCESS, 2023, 11 : 130119 - 130130
  • [3] A Mutual Guidance Attention-Based Multi-Level Fusion Network for Hyperspectral and LiDAR Classification
    Zhang, Tongzhen
    Xiao, Song
    Dong, Wenqian
    Qu, Jiahui
    Yang, Yufei
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [4] MLDA-Net: Multi-Level Dual Attention-Based Network for Self-Supervised Monocular Depth Estimation
    Song, Xibin
    Li, Wei
    Zhou, Dingfu
    Dai, Yuchao
    Fang, Jin
    Li, Hongdong
    Zhang, Liangjun
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4691 - 4705
  • [5] Attention-based Multi-level Feature Fusion for Named Entity Recognition
    Yang, Zhiwei
    Chen, Hechang
    Zhang, Jiawei
    Ma, Jing
    Chang, Yi
    [J]. PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 3594 - 3600
  • [6] A dual-structure attention-based multi-level feature fusion network for automatic surface defect detection
    Xiaoyu Zhang
    Jinping Zhang
    Jiusheng Chen
    Runxia Guo
    Jun Wu
    [J]. The Visual Computer, 2024, 40 : 2713 - 2732
  • [7] Facial image inpainting using attention-based multi-level generative network
    Liu, Jie
    Jung, Cheolkon
    [J]. NEUROCOMPUTING, 2021, 437 : 95 - 106
  • [8] A dual-structure attention-based multi-level feature fusion network for automatic surface defect detection
    Zhang, Xiaoyu
    Zhang, Jinping
    Chen, Jiusheng
    Guo, Runxia
    Wu, Jun
    [J]. VISUAL COMPUTER, 2024, 40 (04): : 2713 - 2732
  • [9] Multi-level Attention-based Domain Disentanglement for BCDR
    Zhang, Xinyue
    Li, Jingjing
    Su, Hongzu
    Zhu, Lei
    Shen, Heng Tao
    [J]. ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2023, 41 (04)
  • [10] Attention-Based Multi-Level Feature Fusion for Object Detection in Remote Sensing Images
    Dong, Xiaohu
    Qin, Yao
    Gao, Yinghui
    Fu, Ruigang
    Liu, Songlin
    Ye, Yuanxin
    [J]. REMOTE SENSING, 2022, 14 (15)