A Switchable Light Field Camera Architecture with Angle Sensitive Pixels and Dictionary-based Sparse Coding

被引:0
|
作者
Hirsch, Matthew [1 ]
Sivaramakrishnan, Sriram [2 ]
Jayasuriya, Suren [2 ]
Wang, Albert [2 ]
Molnar, Alyosha [2 ]
Raskar, Ramesh [1 ]
Wetzstein, Gordon [1 ]
机构
[1] MIT, Media Lab, Cambridge, MA 02139 USA
[2] Cornell Univ, Ithaca, NY USA
关键词
PHOTOGRAPHY;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a flexible light field camera architecture that is at the convergence of optics, sensor electronics, and applied mathematics. Through the co-design of a sensor that comprises tailored, Angle Sensitive Pixels and advanced reconstruction algorithms, we show that-contrary to light field cameras today-our system can use the same measurements captured in a single sensor image to recover either a high-resolution 2D image, a low-resolution 4D light field using fast, linear processing, or a high-resolution light field using sparsity-constrained optimization.
引用
收藏
页数:10
相关论文
共 18 条
  • [1] Dictionary-based light field acquisition using sparse camera array
    Cao, Xuan
    Geng, Zheng
    Li, Tuotuo
    [J]. OPTICS EXPRESS, 2014, 22 (20): : 24081 - 24095
  • [2] DICTIONARY-BASED TENSOR-TRAIN SPARSE CODING
    Boudehane, Abdelhak
    Zniyed, Yassine
    Tenenhaus, Arthur
    Le Brusquet, Laurent
    Boyer, Remy
    [J]. 28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 1000 - 1004
  • [3] Enhanced Angle Sensitive Pixels for Light Field Imaging
    Sivaramakrishnan, Sriram
    Wang, Albert
    Gill, Patrick R.
    Molnar, Alyosha
    [J]. 2011 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM), 2011,
  • [4] Dictionary-Based Low-Rank Approximations and the Mixed Sparse Coding Problem
    Cohen, Jeremy E.
    [J]. FRONTIERS IN APPLIED MATHEMATICS AND STATISTICS, 2022, 8
  • [5] Multi-resolution dictionary-based sparse coding method for interferometric phase image denoising
    Hao, Hongxing
    Yu, Ronghuan
    Hu, Huaquan
    Liu, Boyu
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (03)
  • [6] Reducing covariate factors of gait recognition using feature selection and dictionary-based sparse coding
    Munif Alotaibi
    Ausif Mahmood
    [J]. Signal, Image and Video Processing, 2017, 11 : 1131 - 1138
  • [7] Reconstruction of high spectral resolution multispectral image using dictionary-based learning and sparse coding
    Ghosh, Dipanwita
    Chakravortty, Somdatta
    [J]. GEOCARTO INTERNATIONAL, 2022, 37 (25) : 10798 - 10818
  • [8] Reducing covariate factors of gait recognition using feature selection and dictionary-based sparse coding
    Alotaibi, Munif
    Mahmood, Ausif
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2017, 11 (06) : 1131 - 1138
  • [9] Linear Angle Sensitive Pixels for 4D Light Field Capture
    Varghese, Vigil
    Qian, Xinyuan
    Chen, Shoushun
    Shen ZeXiang
    [J]. 2013 INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2013, : 72 - 75
  • [10] Light Field Compression With Graph Learning and Dictionary-Guided Sparse Coding
    Zhang, Yuchen
    Dai, Wenrui
    Li, Yong
    Li, Chenglin
    Hou, Junhui
    Zou, Junni
    Xiong, Hongkai
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 3059 - 3072