Multiview Light Field Angular Super-Resolution Based on View Alignment and Frequency Attention

被引:0
|
作者
Liu, Deyang [1 ,3 ,4 ]
Mao, Yifan [2 ]
Zhang, Youzhi [3 ]
Zheng, Xin [3 ]
Zuo, Yifan [1 ]
Fang, Yuming [1 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang, Jiangxi, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai, Peoples R China
[3] Anqing Normal Univ, Sch Comp & Informat, Anqing, Peoples R China
[4] Anhui Normal Univ, Anhui Prov Key Lab Network & Informat Secur, Wuhu 240002, Peoples R China
基金
中国国家自然科学基金;
关键词
Multiview light field image; Angular super-resolution; Frequency attention; View alignment;
D O I
10.1007/978-981-97-8508-7_24
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Light Field (LF) camera, renowned for its ability to capture both the intensity and directional aspects of light rays simultaneously, has garnered widespread attention. However, the plenoptic LF camera encounters a constraint in its field of view due to sensor limitations. To address this challenge, this paper introduces a multiview LF angular super-resolution method based on view alignment and frequency attention. Specifically, we first propose an alignment paradigm to acquire the targeted sparse LF image by warping its adjacent two sparse LF views to their target positions. Moreover, an angular frequency attention block is introduced to meticulously discern global high-frequency details within LF images. Subsequently, the structural information is extracted through the application of a gradient-guided method to guarantee the geometric consistency. Comprehensive experiments verify the effectiveness of our proposed method in both single LF angular reconstruction and multiview LF reconstruction tasks.
引用
收藏
页码:343 / 356
页数:14
相关论文
共 50 条
  • [1] Light Field Super-Resolution Based on Spatial and Angular Attention
    Li, Donglin
    Yang, Da
    Wang, Sizhe
    Sheng, Hao
    WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, WASA 2021, PT I, 2021, 12937 : 314 - 325
  • [2] Light field angular super-resolution by view-specific queries
    Wang, Shunzhou
    Lu, Yao
    Xia, Wang
    Xia, Peiqi
    Wang, Ziqi
    Gao, Wei
    VISUAL COMPUTER, 2024, : 3565 - 3580
  • [3] Light field super-resolution using complementary-view feature attention
    Zhang, Wei
    Ke, Wei
    Yang, Da
    Sheng, Hao
    Xiong, Zhang
    COMPUTATIONAL VISUAL MEDIA, 2023, 9 (04) : 843 - 858
  • [4] Light field super-resolution using complementary-view feature attention
    Wei Zhang
    Wei Ke
    Da Yang
    Hao Sheng
    Zhang Xiong
    Computational Visual Media, 2023, 9 : 843 - 858
  • [5] Light field angular super-resolution based on structure and scene information
    Jiangxin Yang
    Lingyu Wang
    Lifei Ren
    Yanpeng Cao
    Yanlong Cao
    Applied Intelligence, 2023, 53 : 4767 - 4783
  • [6] Light field angular super-resolution based on structure and scene information
    Yang, Jiangxin
    Wang, Lingyu
    Ren, Lifei
    Cao, Yanpeng
    Cao, Yanlong
    APPLIED INTELLIGENCE, 2023, 53 (04) : 4767 - 4783
  • [7] Light field angular super-resolution based on intrinsic and geometric information
    Wang, Lingyu
    Ren, Lifei
    Wei, Xiaoyao
    Yang, Jiangxin
    Cao, Yanlong
    Cao, Yanpeng
    KNOWLEDGE-BASED SYSTEMS, 2023, 270
  • [8] Disparity Enhancement-Based Light Field Angular Super-Resolution
    Cai, Dongjun
    Chen, Yilei
    Huang, Xinpeng
    An, Ping
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 81 - 85
  • [9] Learning a Multilevel Cooperative View Reconstruction Network for Light Field Angular Super-Resolution
    Liu, Deyang
    Mao, Yifan
    Zhou, Xiaofei
    An, Ping
    Fang, Yuming
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1271 - 1276
  • [10] Neural Radiance Field-Based Light Field Super-Resolution in Angular Domain
    Yuan, Miao
    Chang, Liu
    Jun, Qiu
    ACTA OPTICA SINICA, 2023, 43 (14)