Synthesizing Light Field Views based on Superpixels in Epipolar Plane Image Domain

被引:0
|
作者
Yim, Jonghoon [1 ]
Van Duong, Vinh [1 ]
Huu, Thuc Nguyen [1 ]
Jeon, Byeungwoo [1 ]
机构
[1] Sungkyunkwan Univ, Dept Elect & Comp Engn, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Light field; view synthesis; superpixel segmentation; epipolar plane image;
D O I
10.1117/12.2667015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the perspective of alleviating the inherent trade-off between the spatial and angular resolutions of light field (LF) images, much research has been carried out to increase the angular resolution of LFs by synthesizing intermediate views. Since the height of each EPI is equal to the angular resolution of LF, we tackle the view synthesis problem as doubling the height of each EPI in LF. To efficiently stretch the EPI while not consuming too much computing time, we propose to first segment the EPI into superpixels and then adaptively interpolate each superpixel separately. The test results on the synthetic and real-scene LF datasets show that our scheme can achieve average Peak signal-to-noise ratio (PSNR) / structural similarity index measure (SSIM) around 30.58dB / 0.9131 and 32.28dB / 0.9510, by taking computing time of 5.80 minute and 1.83 minute for HCI and EPFL dataset, respectively.
引用
收藏
页数:5
相关论文
共 50 条
  • [11] LIGHT FIELD UPSAMPLING BY JOINT BILATERAL FILTERING ON EPIPOLAR PLANE IMAGES
    Shao, Hao-Chiang
    Hwang, Wen-Liang
    2016 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2016,
  • [12] Tensor-Based Light Field Compressed Sensing and Epipolar Plane Images Reconstruction via Deep Learning
    Wei, Linhui
    Wang, Yumei
    Liu, Yu
    IEEE ACCESS, 2020, 8 : 134898 - 134910
  • [13] Image Haze Removal Based on Superpixels and Markov Random Field
    Tan, Yibo
    Wang, Guoyu
    IEEE ACCESS, 2020, 8 : 60728 - 60736
  • [14] Self-Supervised Light Field Depth Estimation Using Epipolar Plane Images
    Li, Kunyuan
    Zhang, Jun
    Gao, Jun
    Qi, Meibin
    2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 731 - 740
  • [15] Epipolar based Light Field Key-Location Detector
    Teixeira, Jose Abecasis
    Brites, Catarina
    Pereira, Fernando
    Ascenso, Joao
    2017 IEEE 19TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2017,
  • [16] EPIC: Context Adaptive Lossless Light Field Compression using Epipolar Plane Images
    Mukati, Muhammad Umair
    Forchhammer, Soren
    2020 DATA COMPRESSION CONFERENCE (DCC 2020), 2020, : 43 - 52
  • [17] Epipolar Plane Image based Rendering for 3D Video Coding
    Brites, Catarina
    Ascenso, Joao
    Pereira, Fernando
    2015 IEEE 17TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2015,
  • [18] Dense light field reconstruction based on epipolar focus spectrum
    Li, Yaning
    Wang, Xue
    Zhu, Hao
    Zhou, Guoqing
    Wang, Qing
    PATTERN RECOGNITION, 2023, 140
  • [19] Learning an epipolar shift compensation for light field image super-resolution
    Wang, Xinya
    Ma, Jiayi
    Yi, Peng
    Tian, Xin
    Jiang, Junjun
    Zhang, Xiao-Ping
    INFORMATION FUSION, 2022, 79 : 188 - 199
  • [20] Multi-view Object Segmentation Based on Epipolar Plane Image Analysis
    Fan, Liangzhong
    Yu, Xin
    Shu, Zhenyu
    Zhang, Qiaowen
    ISCSCT 2008: INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE AND COMPUTATIONAL TECHNOLOGY, VOL 2, PROCEEDINGS, 2008, : 602 - +