Stochastic mirror descent method for linear ill-posed problems in Banach spaces

被引:3
|
作者
Jin, Qinian [1 ]
Lu, Xiliang [2 ,3 ]
Zhang, Liuying [2 ]
机构
[1] Australian Natl Univ, Math Sci Inst, Canberra, ACT 2601, Australia
[2] Wuhan Univ, Sch Math & Stat, Wuhan 430072, Peoples R China
[3] Wuhan Univ, Hubei Computat Sci Key Lab, Wuhan 430072, Peoples R China
基金
美国国家科学基金会; 澳大利亚研究理事会;
关键词
linear ill-posed system; stochastic mirror descent method; convergence; rate of convergence; CONVERGENCE-RATES; EQUATIONS; REGULARIZATION;
D O I
10.1088/1361-6420/accd8e
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Consider linear ill-posed problems governed by the system Aix=y(i) i=1, horizontal ellipsis ,p i is a bounded linear operator from a Banach space X to a Hilbert space Y ( i ). In case p is huge, solving the problem by an iterative regularization method using the whole information at each iteration step can be very expensive, due to the huge amount of memory and excessive computational load per iteration. To solve such large-scale ill-posed systems efficiently, we develop in this paper a stochastic mirror descent method which uses only a small portion of randomly selected equations at each iteration step and incorporates convex regularization terms into the algorithm design. Therefore, our method scales very well with the problem size and has the capability of capturing features of sought solutions. The convergence property of the method depends crucially on the choice of step-sizes. We consider various rules for choosing step-sizes and obtain convergence results under a priori early stopping rules. In particular, by incorporating the spirit of the discrepancy principle we propose a choice rule of step-sizes which can efficiently suppress the oscillations in iterates and reduce the effect of semi-convergence. Furthermore, we establish an order optimal convergence rate result when the sought solution satisfies a benchmark source condition. Various numerical simulations are reported to test the performance of the method.
引用
收藏
页数:39
相关论文
共 50 条
  • [1] Nonlinear iterative methods for linear ill-posed problems in Banach spaces
    Schöfer, F
    Louis, AK
    Schuster, T
    [J]. INVERSE PROBLEMS, 2006, 22 (01) : 311 - 329
  • [2] A descent method for regularization of ill-posed problems
    Zama, F
    Piccolomini, EL
    [J]. OPTIMIZATION METHODS & SOFTWARE, 2005, 20 (4-5): : 615 - 628
  • [3] Analysis of the Block Coordinate Descent Method for Linear Ill-Posed Problems
    Rabanser, Simon
    Neumann, Lukas
    Haltmeier, Markus
    [J]. SIAM JOURNAL ON IMAGING SCIENCES, 2019, 12 (04): : 1808 - 1832
  • [4] ON THE CONVERGENCE OF STOCHASTIC GRADIENT DESCENT FOR NONLINEAR ILL-POSED PROBLEMS
    Jin, Bangti
    Zhou, Zehui
    Zou, Jun
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (02) : 1421 - 1450
  • [5] Regularization of ill-posed problems in Banach spaces: convergence rates
    Resmerita, E
    [J]. INVERSE PROBLEMS, 2005, 21 (04) : 1303 - 1314
  • [6] A stochastic procedure to solve linear ill-posed problems
    Maouche, Fouad
    Dahmani, Abdelnasser
    Rahmania, Nadji
    [J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2017, 46 (03) : 1519 - 1531
  • [8] Nonstationary iterated Tikhonov regularization for ill-posed problems in Banach spaces
    Jin, Qinian
    Stals, Linda
    [J]. INVERSE PROBLEMS, 2012, 28 (10)
  • [9] On the regular landweber iteration for nonlinear ill-posed problems in banach spaces
    Li, Jing
    Liu, Zhen-Hai
    [J]. Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2009, 36 (07): : 89 - 92
  • [10] Ill-posed quadratic optimization in Banach spaces
    Ben Belgacem, Faker
    [J]. JOURNAL OF INVERSE AND ILL-POSED PROBLEMS, 2010, 18 (03): : 263 - 279