Light Field Image Super-Resolution Based on Feature Interaction Fusion and Attention Mechanism

被引:3
|
作者
Xu, Xinyi [1 ,2 ]
Deng, Huiping [1 ,2 ]
Sen, Xiang [1 ,2 ]
Jin, Wu [1 ,2 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Informat Sci & Engn, Wuhan 430081, Hubei, Peoples R China
[2] Wuhan Univ Sci & Technol, Engn Res Ctr Met Automat & Measurement Technol, Minist Educ, Wuhan 430081, Hubei, Peoples R China
关键词
image processing; super-resolution; deep learning; light field image; attention mechanism;
D O I
10.3788/LOP221911
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Light field images contain rich spatial and angle information and are, therefore, widely used in three-dimensional reconstruction and virtual reality; however, the limited spatial resolution of light field pictures, notably the blurring of the image edge area, prevents their application and development due to the inherent constraints of light field cameras. A light field image super-resolution network based on feature interactive fusion and attention is proposed here because the spatial information in a light field subaperture image contains rich texture and high-frequency details and the angle information corresponds to the correlation between different views. Here, the feature extraction and feature interactive fusion modules completely fuse the spatial and angle information of the light field; the feature channel attention module refines high-frequency aspects of the images by adaptively learning effective information and suppressing redundant information; and the optical field structure consistency module preserves the parallax structure between optical field pictures. The performance of the proposed network is typically superior to that of the compared super-resolution network, according to the experimental results from five light field datasets.
引用
收藏
页数:5
相关论文
共 27 条
  • [1] Alain M, 2018, IEEE IMAGE PROC, P2501, DOI 10.1109/ICIP.2018.8451162
  • [2] Deep Spatial-Angular Regularization for Light Field Imaging, Denoising, and Super-Resolution
    Guo, Mantang
    Hou, Junhui
    Jin, Jing
    Chen, Jie
    Chau, Lap-Pui
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 6094 - 6110
  • [3] A Dataset and Evaluation Methodology for Depth Estimation on 4D Light Fields
    Honauer, Katrin
    Johannsen, Ole
    Kondermann, Daniel
    Goldluecke, Bastian
    [J]. COMPUTER VISION - ACCV 2016, PT III, 2017, 10113 : 19 - 34
  • [4] Squeeze-and-Excitation Networks
    Hu, Jie
    Shen, Li
    Albanie, Samuel
    Sun, Gang
    Wu, Enhua
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (08) : 2011 - 2023
  • [5] Light Field Spatial Super-resolution via Deep Combinatorial Geometry Embedding and Structural Consistency Regularization
    Jin, Jing
    Hou, Junhui
    Chen, Jie
    Kwong, Sam
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2257 - 2266
  • [6] Kim J, 2016, PROC CVPR IEEE, P1637, DOI [10.1109/CVPR.2016.181, 10.1109/CVPR.2016.182]
  • [7] Light Field Inpainting Propagation via Low Rank Matrix Completion
    Le Pendu, Mikael
    Jiang, Xiaoran
    Guillemot, Christine
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) : 1981 - 1993
  • [8] Enhanced Deep Residual Networks for Single Image Super-Resolution
    Lim, Bee
    Son, Sanghyun
    Kim, Heewon
    Nah, Seungjun
    Lee, Kyoung Mu
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1132 - 1140
  • [9] Mei YQ, 2020, Arxiv, DOI [arXiv:2004.13824, DOI 10.48550/ARXIV.2004.13824]
  • [10] Optimization of Image Semantic Segmentation Algorithms Based on Deeplab v3+
    Meng Junxi
    Zhang Li
    Cao Yang
    Zhang Letian
    Song Qian
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (16)