On the solution of the Tikhonov regularization of the total least squares problem

被引:97
|
作者
Beck, Amir [1 ]
Ben-Tal, Aharon [1 ]
机构
[1] Technion Israel Inst Technol, Dept Ind Engn & Management, MINERVA Optimizat Ctr, IL-3200 Haifa, Israel
关键词
total least squares; Tikhonov regularization; fractional programming; nonconvex optimization; trust region subproblem;
D O I
10.1137/050624418
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Total least squares (TLS) is a method for treating an overdetermined system of linear equations Ax approximate to b, where both the matrix A and the vector b are contaminated by noise. Tikhonov regularization of the TLS (TRTLS) leads to an optimization problem of minimizing the sum of fractional quadratic and quadratic functions. As such, the problem is nonconvex. We show how to reduce the problem to a single variable minimization of a function G over a closed interval. Computing a value and a derivative of G consists of solving a single trust region subproblem. For the special case of regularization with a squared Euclidean norm we show that G is unimodal and provide an alternative algorithm, which requires only one spectral decomposition. A numerical example is given to illustrate the effectiveness of our method.
引用
收藏
页码:98 / 118
页数:21
相关论文
共 50 条
  • [41] Regularized integer least-squares estimation: Tikhonov's regularization in a weak GNSS model
    Wu, Zemin
    Bian, Shaofeng
    [J]. JOURNAL OF GEODESY, 2022, 96 (04)
  • [42] AN ANALYSIS OF THE TOTAL LEAST-SQUARES PROBLEM
    GOLUB, GH
    VANLOAN, CF
    [J]. SIAM JOURNAL ON NUMERICAL ANALYSIS, 1980, 17 (06) : 883 - 893
  • [43] Tikhonov regularization with a solution constraint
    Calvetti, D
    Reichel, L
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2004, 26 (01): : 224 - 239
  • [44] Condition numbers of the mixed least squares-total least squares problem revisited
    Liu, Qiaohua
    Zhang, Qian
    Shen, Dongmei
    [J]. LINEAR & MULTILINEAR ALGEBRA, 2023, 71 (13): : 2144 - 2162
  • [45] SOLUTION OF A TECHNICAL PROBLEM BY METHOD OF LEAST SQUARES
    GASKAROV, DV
    MOZGALEV.AV
    [J]. TELECOMMUNICATIONS AND RADIO ENGINEER-USSR, 1968, (09): : 144 - &
  • [46] A parallel multisplitting solution of the least squares problem
    Renaut, RA
    [J]. NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 1998, 5 (01) : 11 - 31
  • [47] Tikhonov regularization with conjugate gradient least squares method for large-scale discrete ill-posed problem in image restoration
    Wang, Wenli
    Qu, Gangrong
    Song, Caiqin
    Ge, Youran
    Liu, Yuhan
    [J]. APPLIED NUMERICAL MATHEMATICS, 2024, 204 : 147 - 161
  • [48] Mixed and componentwise condition numbers for a linear function of the solution of the total least squares problem
    Diao, Huai-An
    Sun, Yang
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 2018, 544 : 1 - 29
  • [49] Numerical solution of the inverse electrocardiography problem with the use of the Tikhonov regularization method
    Denisov A.M.
    Zakharov E.V.
    Kalinin A.V.
    Kalinin V.V.
    [J]. Moscow University Computational Mathematics and Cybernetics, 2008, 32 (2) : 61 - 68
  • [50] Solution of Inverse Heat Conduction Problem using the Tikhonov Regularization Method
    Piotr Duda
    [J]. Journal of Thermal Science, 2017, 26 (01) : 60 - 65