Sparse representation-based demosaicking method for joint chromatic and polarimetric imagery

Division of focal plane (DoFP) polarization camera has become mainstream among various polarimetric imaging systems whose sensor is equipped with Bayer filter and directional polarization filter, so joint chromatic and polarimetric image demosaicking is essential. However, since 15 or 14 pixels are missed out of 16 pixels in color polarization mosaic images, it's challenging to adopt a method to reconstruct full-resolution images well. In this paper, we propose a demosaicking model based on sparse coding. The model introduces RGB-polarization channels correlation, adaptive sub-dictionaries and non-local self-similarity restrictions, and combines them into an optimal problem to solve. The experimental results, including reconstructing full-resolution synthetic images and camera captured real scenes, demonstrate that our proposed method outperforms the current state-of-the-art method in terms of quantitative measures and visual quality.