Fast and Accurate Light Field View Synthesis by Optimizing Input View Selection

被引:1
|
作者
Wang, Xingzheng [1 ]
Zan, Yongqiang [1 ]
You, Senlin [1 ]
Deng, Yuanlong [1 ]
Li, Lihua [2 ]
机构
[1] Shenzhen Univ, Coll Mechatron & Control Engn, Shenzhen 518060, Peoples R China
[2] Shenzhen Technol Univ, Sino German Coll Intelligent Mfg, Shenzhen 518118, Peoples R China
关键词
light field; depth estimation; view synthesis; convolutional neural network; MICRO-LENS ARRAY; HIGH NUMERICAL APERTURE; FABRICATION;
D O I
10.3390/mi12050557
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
There is a trade-off between spatial resolution and angular resolution limits in light field applications; various targeted algorithms have been proposed to enhance angular resolution while ensuring high spatial resolution simultaneously, which is also called view synthesis. Among them, depth estimation-based methods can use only four corner views to reconstruct a novel view at an arbitrary location. However, depth estimation is a time-consuming process, and the quality of the reconstructed novel view is not only related to the number of the input views, but also the location of the input views. In this paper, we explore the relationship between different input view selections with the angular super-resolution reconstruction results. Different numbers and positions of input views are selected to compare the speed of super-resolution reconstruction and the quality of novel views. Experimental results show that the speed of the algorithm decreases with the increase of the input views for each novel view, and the quality of the novel view decreases with the increase of the distance from the input views. After comparison using two input views in the same line to reconstruct the novel views between them, fast and accurate light field view synthesis is achieved.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] View synthesis with sparse light field for 6DoF immersive video
    Kwak, Sangwoon
    Yun, Joungil
    Jeong, Jun-Young
    Kim, Youngwook
    Ihm, Insung
    Cheong, Won-Sik
    Seo, Jeongil
    ETRI JOURNAL, 2022, 44 (01) : 24 - 37
  • [32] Light Field View Synthesis via Aperture Disparity and Warping Confidence Map
    Meng, Nan
    Li, Kai
    Liu, Jianzhuang
    Lam, Edmund Y.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3908 - 3921
  • [33] LIGHT-FIELD VIEW SYNTHESIS USING A CONVOLUTIONAL BLOCK ATTENTION MODULE
    Gul, M. Shahzeb Khan
    Mukati, M. Umair
    Baetz, Michel
    Forchhammer, Soren
    Keinert, Joachim
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3398 - 3402
  • [34] Self-supervised Light Field View Synthesis Using Cycle Consistency
    Chen, Yang
    Alain, Martin
    Smolic, Aljosa
    2020 IEEE 22ND INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2020,
  • [35] Subjective Evaluation of Light Field Image Compression Methods based on View Synthesis
    Bakir, Nader
    Fezza, Sid Ahmed
    Hamidouche, Wassim
    Samrouth, Khouloud
    Deforges, Olivier
    2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,
  • [36] LEARNING-BASED LIGHT FIELD VIEW SYNTHESIS FOR EFFICIENT TRANSMISSION AND STORAGE
    Wafa, Abrar
    Pourazad, Mahsa T.
    Nasiopoulos, Panos
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 354 - 358
  • [37] Region-of-Interest Compression and View Synthesis for Light Field Video Streaming
    Wang, Bing
    Peng, Qiang
    Wang, Eric
    Han, Kang
    Xiang, Wei
    IEEE ACCESS, 2019, 7 : 41183 - 41192
  • [38] Light Field View Synthesis via Aperture Disparity and Warping Confidence Map
    Meng, Nan
    Li, Kai
    Liu, Jianzhuang
    Lam, Edmund Y.
    IEEE Transactions on Image Processing, 2021, 30 : 3908 - 3921
  • [39] Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines
    Mildenhall, Ben
    Srinivasan, Pratul P.
    Ortiz-Cayon, Rodrigo
    Kalantari, Nima Khademi
    Ramamoorthi, Ravi
    Ng, Ren
    Kar, Abhishek
    ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (04):
  • [40] A BENCHMARK OF LIGHT FIELD VIEW INTERPOLATION METHODS
    Yue, Dingcheng
    Gul, Muhammad Shahzeb Khan
    Baetz, Michel
    Keinert, Joachim
    Mantiuk, Rafal
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2020,