Sparsity and incoherence in orthogonal matching pursuit

Recovery of sparse signals via approximation methods has been extensively studied in recently years. We consider the nonuniform recovery of orthogonal matching pursuit (OMP) from fewer noisy random measurements. Rows of sensing matrices are assumed to be drawn independently from a probability distribution obeying the isotropy property and the incoherence property. Our models not only include the standard sensing matrices in compressed sensing context, but also cover other new sensing matrices such as random convolutions, subsampled tight or continuous frames. Given m admissible random measurements of a fixed s-sparse signal xRn, we show that OMP can recover the support of x exactly after s iterations with overwhelming probability provided that m = O(s(s + log( n - s))). It follows that the approximation order of OMP is parallel to x - x(j)parallel to = O(eta(j)) where 0<<1 and xj denotes the recovered signal at j-th iteration. As a byproduct of the proof, the necessary number of measurements to ensure sparse recovery by l1-minimization with random partial circulant or Toeplitz matrices is proved to be optimal.