Multiview Light Field Angular Super-Resolution Based on View Alignment and Frequency Attention

被引:0
|
作者
Liu, Deyang [1 ,3 ,4 ]
Mao, Yifan [2 ]
Zhang, Youzhi [3 ]
Zheng, Xin [3 ]
Zuo, Yifan [1 ]
Fang, Yuming [1 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang, Jiangxi, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai, Peoples R China
[3] Anqing Normal Univ, Sch Comp & Informat, Anqing, Peoples R China
[4] Anhui Normal Univ, Anhui Prov Key Lab Network & Informat Secur, Wuhu 240002, Peoples R China
基金
中国国家自然科学基金;
关键词
Multiview light field image; Angular super-resolution; Frequency attention; View alignment;
D O I
10.1007/978-981-97-8508-7_24
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Light Field (LF) camera, renowned for its ability to capture both the intensity and directional aspects of light rays simultaneously, has garnered widespread attention. However, the plenoptic LF camera encounters a constraint in its field of view due to sensor limitations. To address this challenge, this paper introduces a multiview LF angular super-resolution method based on view alignment and frequency attention. Specifically, we first propose an alignment paradigm to acquire the targeted sparse LF image by warping its adjacent two sparse LF views to their target positions. Moreover, an angular frequency attention block is introduced to meticulously discern global high-frequency details within LF images. Subsequently, the structural information is extracted through the application of a gradient-guided method to guarantee the geometric consistency. Comprehensive experiments verify the effectiveness of our proposed method in both single LF angular reconstruction and multiview LF reconstruction tasks.
引用
收藏
页码:343 / 356
页数:14
相关论文
共 50 条
  • [41] View position prior-supervised light field angular super-resolution network with asymmetric feature extraction and spatial-angular interaction
    Cao, Yanlong
    Wang, Lingyu
    Ren, Lifei
    Yang, Jiangxin
    Cao, Yanpeng
    NEUROCOMPUTING, 2023, 518 : 206 - 218
  • [42] Light Field Angular Super-Resolution using Convolutional Neural Network with Residual Network
    Kim, Dong-Myung
    Kang, Hyun-Soo
    Hong, Jang-Eui
    Suh, Jae-Won
    2019 ELEVENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS (ICUFN 2019), 2019, : 595 - 597
  • [43] Adaptive pixel aggregation for joint spatial and angular super-resolution of light field images
    Liu, Gaosheng
    Yue, Huanjing
    Li, Kun
    Yang, Jingyu
    INFORMATION FUSION, 2024, 104
  • [44] Hierarchical spatial-angular integration for lightweight light field image super-resolution
    Li, Meng
    Ma, Bo
    Wang, Shunzhou
    KNOWLEDGE-BASED SYSTEMS, 2025, 315
  • [45] A Coarse-to-Fine Convolutional Neural Network for Light Field Angular Super-Resolution
    Liu, Gaosheng
    Yue, Huanjing
    Yang, Jingyu
    ARTIFICIAL INTELLIGENCE, CICAI 2022, PT I, 2022, 13604 : 268 - 279
  • [46] Deep Spatial-Angular Regularization for Light Field Imaging, Denoising, and Super-Resolution
    Guo, Mantang
    Hou, Junhui
    Jin, Jing
    Chen, Jie
    Chau, Lap-Pui
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 6094 - 6110
  • [47] Learning Light Field Angular Super-Resolution via a Geometry-Aware Network
    Jin, Jing
    Hou, Junhui
    Yuan, Hui
    Kwong, Sam
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11141 - 11148
  • [48] LFC-SASR: LIGHT FIELD CODING USING SPATIAL AND ANGULAR SUPER-RESOLUTION
    Cetinkaya, Ekrem
    Amirpour, Hadi
    Timmerer, Christian
    2022 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (IEEE ICMEW 2022), 2022,
  • [49] Full field of view super-resolution imaging based on two static gratings and white light illumination
    Garcia, Javier
    Mico, Vicente
    Cojoc, Dan
    Zalevsky, Zeev
    APPLIED OPTICS, 2008, 47 (17) : 3080 - 3087
  • [50] Cross-View Recurrence-Based Self-Supervised Super-Resolution of Light Field
    Sheng, Hao
    Wang, Sizhe
    Yang, Da
    Cong, Ruixuan
    Cui, Zhenglong
    Chen, Rongshan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (12) : 7252 - 7266