CONVERGENCE ANALYSIS OF ASYNCHRONOUS LINEAR ITERATIONS WITH STOCHASTIC DELAYS

被引：9

作者：

BEIDAS, BF ^{[1
]}

PAPAVASSILOPOULOS, GP ^{[1
]}

机构：

[1] UNIV SO CALIF,DEPT ELECT ENGN SYST,LOS ANGELES,CA 90089

来源：

PARALLEL COMPUTING | 1993年 / 19卷 / 03期

关键词：

LINEAR ALGEBRA; ITERATIVE ALGORITHMS; ASYNCHRONOUS ITERATIONS; CONVERGENCE ANALYSIS; MULTIPROCESSOR SYSTEMS; STOCHASTIC DELAYS;

D O I：

10.1016/0167-8191(93)90038-M

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

We present a general linear model of asynchronous iterations, the communication delays of which are stochastic with Markovian character. This model allows static or dynamic allocation of the iterate vector components to processors. It also allows simultaneous updating of the same vector component by multiple processors. Sufficient conditions under which the model of asynchronous iterations converges in the second moment (and in the mean) to the sought solution are provided. For the specialization of the Markov case when the communication delays are independent, identically distributed (i.i.d.), we provide sufficient conditions for convergence in the second moment and necessary and sufficient conditions for convergence in the mean.

引用

页码：281 / 302

页数：22

共 50 条

[31] Asynchronous Stochastic Optimization Robust to Arbitrary Delays
Cohen, Alon
Daniely, Amit
Drori, Yoel
Koren, Tomer
Schain, Mariano
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
[32] Perturbation of parallel asynchronous linear iterations by floating point errors
Spiteri, P
Miellou, JC
El Baz, D
ELECTRONIC TRANSACTIONS ON NUMERICAL ANALYSIS, 2002, 13 : 38 - 55
[33] Correction to: On the Convergence of Asynchronous Parallel Iteration with Unbounded Delays
Zhimin Peng
Yangyang Xu
Ming Yan
Wotao Yin
Journal of the Operations Research Society of China, 2023, 11 : 977 - 977
[34] THE CONVERGENCE AND SATURATION OF ITERATIONS OF POSITIVE LINEAR-OPERATORS
NISHISHIRAHO, T
MATHEMATISCHE ZEITSCHRIFT, 1987, 194 (03) : 397 - 404
[35] On the speed of convergence of Picard iterations of backward stochastic differential equations
Martin Hutzenthaler
Thomas Kruse
Tuan Anh Nguyen
Probability,Uncertainty and Quantitative Risk, 2022, (02) : 133 - 150
[36] Asymptotic convergence of spectral inverse iterations for stochastic eigenvalue problems
Harri Hakula
Mikael Laaksonen
Numerische Mathematik, 2019, 142 : 577 - 609
[37] On the speed of convergence of Picard iterations of backward stochastic differential equations
Hutzenthaler, Martin
Kruse, Thomas
Nguyen, Tuan Anh
PROBABILITY UNCERTAINTY AND QUANTITATIVE RISK, 2022, 7 (02) : 133 - 150
[38] Asymptotic convergence of spectral inverse iterations for stochastic eigenvalue problems
Hakula, Harri
Laaksonen, Mikael
NUMERISCHE MATHEMATIK, 2019, 142 (03) : 577 - 609
[39] ASYMPTOTIC AGREEMENT AND CONVERGENCE OF ASYNCHRONOUS STOCHASTIC ALGORITHMS
LI, S
BASAR, T
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1987, 32 (07) : 612 - 618
[40] Distributed Convergence Detection Based on Global Residual Error Under Asynchronous Iterations
Magoules, Frederic
Gbikpi-Benissan, Guillaume
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2018, 29 (04) : 819 - 829

← 1 2 3 4 5 →