A Minimax Approach to Errors-in-Variables Linear Models

The paper considers a simple Errors-in-Variables (EiV) model Yi = a + bXi + εξi; Zi= Xi + σζi, where ξi, ζi are i.i.d. standard Gaussian random variables, Xi ∈ ℝ are unknown non-random regressors, and ε, σ are known noise levels. The goal is to estimates unknown parameters a, b ∈ ℝ based on the observations {Yi, Zi, i = 1, …, n}. It is well known [3] that the maximum likelihood estimates of these parameters have unbounded moments. In order to construct estimates with good statistical properties, we study EiV model in the large noise regime assuming that n → ∞, but ϵ2=nϵ∘2,σ2=nσ∘2 with some ϵ∘2,σ∘2>0. Under these assumptions, a minimax approach to estimating a, b is developed. It is shown that minimax estimates are solutions to a convex optimization problem and a fast algorithm for solving it is proposed. © 2018, Allerton Press, Inc.