Multiview Light Field Angular Super-Resolution Based on View Alignment and Frequency Attention

被引:0
|
作者
Liu, Deyang [1 ,3 ,4 ]
Mao, Yifan [2 ]
Zhang, Youzhi [3 ]
Zheng, Xin [3 ]
Zuo, Yifan [1 ]
Fang, Yuming [1 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang, Jiangxi, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai, Peoples R China
[3] Anqing Normal Univ, Sch Comp & Informat, Anqing, Peoples R China
[4] Anhui Normal Univ, Anhui Prov Key Lab Network & Informat Secur, Wuhu 240002, Peoples R China
基金
中国国家自然科学基金;
关键词
Multiview light field image; Angular super-resolution; Frequency attention; View alignment;
D O I
10.1007/978-981-97-8508-7_24
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Light Field (LF) camera, renowned for its ability to capture both the intensity and directional aspects of light rays simultaneously, has garnered widespread attention. However, the plenoptic LF camera encounters a constraint in its field of view due to sensor limitations. To address this challenge, this paper introduces a multiview LF angular super-resolution method based on view alignment and frequency attention. Specifically, we first propose an alignment paradigm to acquire the targeted sparse LF image by warping its adjacent two sparse LF views to their target positions. Moreover, an angular frequency attention block is introduced to meticulously discern global high-frequency details within LF images. Subsequently, the structural information is extracted through the application of a gradient-guided method to guarantee the geometric consistency. Comprehensive experiments verify the effectiveness of our proposed method in both single LF angular reconstruction and multiview LF reconstruction tasks.
引用
收藏
页码:343 / 356
页数:14
相关论文
共 50 条
  • [31] Multiview confocal super-resolution microscopy
    Yicong Wu
    Xiaofei Han
    Yijun Su
    Melissa Glidewell
    Jonathan S. Daniels
    Jiamin Liu
    Titas Sengupta
    Ivan Rey-Suarez
    Robert Fischer
    Akshay Patel
    Christian Combs
    Junhui Sun
    Xufeng Wu
    Ryan Christensen
    Corey Smith
    Lingyu Bao
    Yilun Sun
    Leighton H. Duncan
    Jiji Chen
    Yves Pommier
    Yun-Bo Shi
    Elizabeth Murphy
    Sougata Roy
    Arpita Upadhyaya
    Daniel Colón-Ramos
    Patrick La Riviere
    Hari Shroff
    Nature, 2021, 600 : 279 - 284
  • [32] Geometry-assisted multi-representation view reconstruction network for Light Field image angular super-resolution
    Liu, Deyang
    Tong, Zaidong
    Huang, Yan
    Chen, Yilei
    Zuo, Yifan
    Fang, Yuming
    KNOWLEDGE-BASED SYSTEMS, 2023, 267
  • [33] Lightweight frequency-based attention network for image super-resolution
    Tang, E.
    Wang, Li
    Wang, Yuanyuan
    Yu, Yongtao
    Zeng, Xiaoqin
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (05)
  • [34] Dense Dual-Attention Network for Light Field Image Super-Resolution
    Mo, Yu
    Wang, Yingqian
    Xiao, Chao
    Yang, Jungang
    An, Wei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (07) : 4431 - 4443
  • [35] View Synthesis Method with Partitioned Image for Angular Super-Resolution
    Kim, Dong-Myung
    Kang, Hyun-Soo
    Suh, Jae-Won
    2020 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2020,
  • [36] Direct Inter-Intra View Association for Light Field Super-Resolution
    Yang, Da
    Sheng, Hao
    Wang, Shuai
    Chen, Rongshan
    Xiong, Zhang
    NEURAL INFORMATION PROCESSING, ICONIP 2023, PT V, 2024, 14451 : 265 - 278
  • [37] Dual Attention with the Self-Attention Alignment for Efficient Video Super-resolution
    Yuezhong Chu
    Yunan Qiao
    Heng Liu
    Jungong Han
    Cognitive Computation, 2022, 14 : 1140 - 1151
  • [38] Dual Attention with the Self-Attention Alignment for Efficient Video Super-resolution
    Chu, Yuezhong
    Qiao, Yunan
    Liu, Heng
    Han, Jungong
    COGNITIVE COMPUTATION, 2022, 14 (03) : 1140 - 1151
  • [39] Light Field Image Super-Resolution Based on Multilevel Structures
    Park, Hwa-Jong
    Shin, Junho
    Kim, Hyunseop
    Koh, Yeong Jun
    IEEE ACCESS, 2022, 10 : 59135 - 59144
  • [40] Light field angular super resolution based on residual channel attention and classification up-sampling
    Xingzheng Wang
    Zixuan Wang
    Senlin You
    Multimedia Tools and Applications, 2025, 84 (12) : 10945 - 10967