On the solution of the Tikhonov regularization of the total least squares problem

被引:97
|
作者
Beck, Amir [1 ]
Ben-Tal, Aharon [1 ]
机构
[1] Technion Israel Inst Technol, Dept Ind Engn & Management, MINERVA Optimizat Ctr, IL-3200 Haifa, Israel
关键词
total least squares; Tikhonov regularization; fractional programming; nonconvex optimization; trust region subproblem;
D O I
10.1137/050624418
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Total least squares (TLS) is a method for treating an overdetermined system of linear equations Ax approximate to b, where both the matrix A and the vector b are contaminated by noise. Tikhonov regularization of the TLS (TRTLS) leads to an optimization problem of minimizing the sum of fractional quadratic and quadratic functions. As such, the problem is nonconvex. We show how to reduce the problem to a single variable minimization of a function G over a closed interval. Computing a value and a derivative of G consists of solving a single trust region subproblem. For the special case of regularization with a squared Euclidean norm we show that G is unimodal and provide an alternative algorithm, which requires only one spectral decomposition. A numerical example is given to illustrate the effectiveness of our method.
引用
收藏
页码:98 / 118
页数:21
相关论文
共 50 条
  • [1] Tikhonov regularization and total least squares
    Golub, GH
    Hansen, PC
    O'Leary, DP
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 1999, 21 (01) : 185 - 194
  • [2] Computational Experiments on the Tikhonov Regularization of the Total Least Squares Problem
    Salahi, Maziar
    Zareamoghaddam, Hossein
    [J]. COMPUTER SCIENCE JOURNAL OF MOLDOVA, 2009, 17 (01) : 14 - 25
  • [3] Semidefinite relaxation for the total least squares problem with Tikhonov-like regularization
    Cen, Xiaoli
    Xia, Yong
    Yang, Meijia
    [J]. OPTIMIZATION, 2021, 70 (02) : 251 - 268
  • [4] Tikhonov regularization for weighted total least squares problems
    Wei, Yimin
    Zhang, Naimin
    Ng, Michael K.
    Xu, Wei
    [J]. APPLIED MATHEMATICS LETTERS, 2007, 20 (01) : 82 - 87
  • [5] Efficiently solving total least squares with Tikhonov identical regularization
    Meijia Yang
    Yong Xia
    Jiulin Wang
    Jiming Peng
    [J]. Computational Optimization and Applications, 2018, 70 : 571 - 592
  • [6] Large-scale Tikhonov regularization of total least squares
    Lampe, Joerg
    Voss, Heinrich
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2012, 238 : 95 - 108
  • [7] Efficiently solving total least squares with Tikhonov identical regularization
    Yang, Meijia
    Xia, Yong
    Wang, Jiulin
    Peng, Jiming
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2018, 70 (02) : 571 - 592
  • [8] Perturbation analysis and condition numbers for the Tikhonov regularization of total least squares problem and their statistical estimation
    Samar, Mahvish
    Lin, Fu-Rong
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2022, 411
  • [9] A comparison of truncated total least squares with Tikhonov regularization in imaging by ultrasound inverse scattering
    Liu, C
    Wang, YM
    Heng, PA
    [J]. PHYSICS IN MEDICINE AND BIOLOGY, 2003, 48 (15): : 2437 - 2451
  • [10] A fast algorithm for globally solving Tikhonov regularized total least squares problem
    Yong Xia
    Longfei Wang
    Meijia Yang
    [J]. Journal of Global Optimization, 2019, 73 : 311 - 330