Multiview Light Field Angular Super-Resolution Based on View Alignment and Frequency Attention

被引:0
|
作者
Liu, Deyang [1 ,3 ,4 ]
Mao, Yifan [2 ]
Zhang, Youzhi [3 ]
Zheng, Xin [3 ]
Zuo, Yifan [1 ]
Fang, Yuming [1 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang, Jiangxi, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai, Peoples R China
[3] Anqing Normal Univ, Sch Comp & Informat, Anqing, Peoples R China
[4] Anhui Normal Univ, Anhui Prov Key Lab Network & Informat Secur, Wuhu 240002, Peoples R China
基金
中国国家自然科学基金;
关键词
Multiview light field image; Angular super-resolution; Frequency attention; View alignment;
D O I
10.1007/978-981-97-8508-7_24
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Light Field (LF) camera, renowned for its ability to capture both the intensity and directional aspects of light rays simultaneously, has garnered widespread attention. However, the plenoptic LF camera encounters a constraint in its field of view due to sensor limitations. To address this challenge, this paper introduces a multiview LF angular super-resolution method based on view alignment and frequency attention. Specifically, we first propose an alignment paradigm to acquire the targeted sparse LF image by warping its adjacent two sparse LF views to their target positions. Moreover, an angular frequency attention block is introduced to meticulously discern global high-frequency details within LF images. Subsequently, the structural information is extracted through the application of a gradient-guided method to guarantee the geometric consistency. Comprehensive experiments verify the effectiveness of our proposed method in both single LF angular reconstruction and multiview LF reconstruction tasks.
引用
收藏
页码:343 / 356
页数:14
相关论文
共 50 条
  • [21] Cooperative Light-Field Image Super-Resolution Based on Multi-Modality Embedding and Fusion With Frequency Attention
    Yao, Hui
    Ren, Jieji
    Yan, Xiangchao
    Ren, Mingjun
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 548 - 552
  • [22] Graph-Based Light Field Super-Resolution
    Rossi, Mattia
    Frossard, Pascal
    2017 IEEE 19TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2017,
  • [23] MFSRNet: spatial-angular correlation retaining for light field super-resolution
    Sizhe Wang
    Hao Sheng
    Da Yang
    Zhenglong Cui
    Ruixuan Cong
    Wei Ke
    Applied Intelligence, 2023, 53 : 20327 - 20345
  • [24] MFSRNet: spatial-angular correlation retaining for light field super-resolution
    Wang, Sizhe
    Sheng, Hao
    Yang, Da
    Cui, Zhenglong
    Cong, Ruixuan
    Ke, Wei
    APPLIED INTELLIGENCE, 2023, 53 (17) : 20327 - 20345
  • [25] Joint Light Field Spatial and Angular Super-Resolution From a Single Image
    Ivan, Andre
    Williem
    Park, In Kyu
    IEEE ACCESS, 2020, 8 : 112562 - 112573
  • [26] A survey for light field super-resolution
    Zhao, Mingyuan
    Sheng, Hao
    Yang, Da
    Wang, Sizhe
    Cong, Ruixuan
    Cui, Zhenglong
    Chen, Rongshan
    Wang, Tun
    Wang, Shuai
    Huang, Yang
    Shen, Jiahao
    HIGH-CONFIDENCE COMPUTING, 2024, 4 (01):
  • [27] Light Field Super-Resolution: A Benchmark
    Cheng, Zhen
    Xiong, Zhiwei
    Chen, Chang
    Liu, Dong
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1804 - 1813
  • [28] Light field image super-resolution based on dual learning and deep Fourier channel attention
    Ma, Jian
    Li, Zhipeng
    Cheng, Jin
    An, Ping
    Liang, Dong
    Huang, Linsheng
    OPTICS LETTERS, 2024, 49 (11) : 2886 - 2889
  • [29] Robust Super-Resolution in a Multiview Setup Based on Refined High-Frequency Synthesis
    Richter, Thomas
    Seiler, Juergen
    Schnurrer, Wolfgang
    Kaup, Andre
    2012 IEEE 14TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2012, : 7 - 12
  • [30] Multiview confocal super-resolution microscopy
    Wu, Yicong
    Han, Xiaofei
    Su, Yijun
    Glidewell, Melissa
    Daniels, Jonathan S.
    Liu, Jiamin
    Sengupta, Titas
    Rey-Suarez, Ivan
    Fischer, Robert
    Patel, Akshay
    Combs, Christian
    Sun, Junhui
    Wu, Xufeng
    Christensen, Ryan
    Smith, Corey
    Bao, Lingyu
    Sun, Yilun
    Duncan, Leighton H.
    Chen, Jiji
    Pommier, Yves
    Shi, Yun-Bo
    Murphy, Elizabeth
    Roy, Sougata
    Upadhyaya, Arpita
    Colon-Ramos, Daniel
    La Riviere, Patrick
    Shroff, Hari
    NATURE, 2021, 600 (7888) : 279 - +