Optic design and image processing considering angle of incidence via end-to-end optimization method

In this paper, an end-to-end optimization of optics and image processing which consider angle of incidences is proposed. By considering the various angle of incidences to the optics, the optimized system can capture and reconstruct a real image even for non-paraxial input light. The optimization pipeline includes diffractive wave simulation, effects from wavelength differences, and image processing. Several points spread functions are used to simulate captured images for tilted input light. Captured images are reconstructed by different deconvolution kernels according to the sub-section of the images. To apply the system to real-world experiments, we consider the limitation of diffraction angle for given memory constraints and differences between manufacturing and sensor resolution by using Fourier optics. We demonstrate the simulation results of the proposed approach by applying it to various angle of incidences.