Learning a Multilevel Cooperative View Reconstruction Network for Light Field Angular Super-Resolution

被引:4
|
作者
Liu, Deyang [1 ]
Mao, Yifan [2 ]
Zhou, Xiaofei [3 ]
An, Ping [4 ]
Fang, Yuming [5 ]
机构
[1] Jiangxi Univ Finance & Econ, Anhui Prov Key Lab Network & Informat Secur, Nanchang, Jiangxi, Peoples R China
[2] Anqing Normal Unviers, Sch Comp & Informat, Anqing, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Automat, Hangzhou, Peoples R China
[4] Shanghai Univ, Sch Commun & Informat Engn, Shanghai, Peoples R China
[5] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Light fields; angular reconstruction; debluring; transformer;
D O I
10.1109/ICME55011.2023.00221
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, many methods have been proposed to improve the angular resolution of sparsely-sampled Light Field (LF). However, the synthesized dense LF inevitably exhibits blurry edges and artifacts. This paper intents to model the global relations of LF views and quality degradation model by learning a multilevel cooperative view reconstruction network to further enhance LF angular Super-Resolution (SR) performance. The proposed LF angular SR network consists of three sub-networks including the Cooperative Angular Transformer Network (CAT-Net), the Deblurring Network (DBNet), and the Texture Repair Network (TRNet). The CATNet simultaneously captures global features of all LF views and local features within each view, which benefits in characterizing the inherent LF structure. The DBNet models a quality degradation model by estimating blur kernels to reduce the blurry edges and artifacts. The TRNet focuses on restoring fine-scale texture details. Experimental results over various LF datasets including large baseline LF images demonstrate the significant superiority of our method when compared with state-of-the-art ones.
引用
收藏
页码:1271 / 1276
页数:6
相关论文
共 50 条
  • [21] Disparity Enhancement-Based Light Field Angular Super-Resolution
    Cai, Dongjun
    Chen, Yilei
    Huang, Xinpeng
    An, Ping
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 81 - 85
  • [22] MULTI-MODELS FUSION FOR LIGHT FIELD ANGULAR SUPER-RESOLUTION
    Cao, Fengyin
    An, Ping
    Huang, Xinpeng
    Yang, Chao
    Wu, Qiang
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2365 - 2369
  • [23] Spatial-angular-epipolar transformer for light field spatial and angular super-resolution
    Wang, Sizhe
    Sheng, Hao
    Chen, Rongshan
    Yang, Da
    Cui, Zhenglong
    Cong, Ruixuan
    Xiong, Zhang
    DISPLAYS, 2024, 85
  • [24] Super-Resolution and Sparse View CT Reconstruction
    Zang, Guangming
    Aly, Mohamed
    Idoughi, Ramzi
    Wonka, Peter
    Heidrich, Wolfgang
    COMPUTER VISION - ECCV 2018, PT XVI, 2018, 11220 : 145 - 161
  • [25] Low-light-level image super-resolution reconstruction via deep learning network
    Wang, Bowen
    Zou, Yan
    Li, Yuhai
    Lu, Wenlin
    Zuo, Chao
    AOPC 2021: OPTICAL SENSING AND IMAGING TECHNOLOGY, 2021, 12065
  • [26] Light Field Image Super-Resolution Network via Joint Spatial-Angular and Epipolar Information
    Duong, Vinh Van
    Huu, Thuc Nguyen
    Yim, Jonghoon
    Jeon, Byeungwoo
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2023, 9 : 350 - 366
  • [27] Fusion and Allocation Network for Light Field Image Super-Resolution
    Zhang, Wei
    Ke, Wei
    Wu, Zewei
    Zhang, Zeyu
    Sheng, Hao
    Xiong, Zhang
    MATHEMATICS, 2023, 11 (05)
  • [28] Neural Radiance Field-Based Light Field Super-Resolution in Angular Domain
    Yuan, Miao
    Chang, Liu
    Jun, Qiu
    ACTA OPTICA SINICA, 2023, 43 (14)
  • [29] Learning Non-Local Spatial-Angular Correlation for Light Field Image Super-Resolution
    Liang, Zhengyu
    Wang, Yingqian
    Wang, Longguang
    Yang, Jungang
    Zhou, Shilin
    Guo, Yulan
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 12342 - 12352
  • [30] Depth-guided learning light field angular super-resolution with edge-aware inpainting
    Xia Liu
    Minghui Wang
    Anzhi Wang
    Xiyao Hua
    Shanshan Liu
    The Visual Computer, 2022, 38 : 2839 - 2851