PARALLEL ALGORITHMS FOR LEAST MEDIAN OF SQUARES REGRESSION

被引:5
|
作者
XU, CW
SHIUE, WK
机构
[1] SO ILLINOIS UNIV,DEPT COMP SCI,EDWARDSVILLE,IL 62026
[2] SO ILLINOIS UNIV,DEPT MATH & STAT,EDWARDSVILLE,IL 62026
关键词
SWEEP-LINE ALGORITHM; PARALLEL ALGORITHM; LEAST MEDIAN OF SQUARES REGRESSION; LOAD BALANCING;
D O I
10.1016/0167-9473(93)90135-G
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Recently much effort has been devoted to devising robust regression procedures to which the least median of squares (LMS) regression proposed by Rousseeuw (Journal of the American Statistical Association 79, 1984) belongs. LMS's breakdown point achieves the highest possible value of 50%. It may not be possible to write down closed form expressions for the estimates of LMS and the computations involved are not trivial. Efforts have been made to look for better performance algorithms. Based on the algorithm of Rousseeuw, Steele and Steiger (Discrete Applied Mathematics 14, 1986) provided a lemma that characterized the computation as a discrete optimization problem with worst time complexity of O(n3). Souvaine and Steele (Journal of the American Statistical Association 82, 1987) developed a sweep-line algorithm with time complexity of O(n2log n). This paper reports the use of parallel computing techniques to speedup the computation of LMS. The Rousseeuw's algorithm and the T-sweep algorithm, an algorithm based on Tukey's idea, have been successfully parallelized, but parallel sweep-line algorithm and its refinement may not work at all in the sense that its performance is untolerantly low due to severe load imbalancing.
引用
收藏
页码:349 / 362
页数:14
相关论文
共 50 条
  • [41] Partial least squares regression
    deJong, S
    Phatak, A
    [J]. RECENT ADVANCES IN TOTAL LEAST SQUARES TECHNIQUES AND ERRORS-IN-VARIABLES MODELING, 1997, : 25 - 36
  • [42] LINEAR LEAST SQUARES REGRESSION
    WATSON, GS
    [J]. ANNALS OF MATHEMATICAL STATISTICS, 1967, 38 (06): : 1679 - &
  • [43] LEAST-SQUARES ALGORITHMS
    WAMPLER, RH
    [J]. AMERICAN STATISTICIAN, 1977, 31 (01): : 52 - 53
  • [44] Improved pruning algorithms for sparse least squares support vector regression machine
    Zhao, Yong-Ping
    Sun, Jian-Guo
    [J]. Xitong Gongcheng Lilun yu Shijian/System Engineering Theory and Practice, 2009, 29 (06): : 166 - 171
  • [45] A class of multidimensional NIPALS algorithms for quaternion and tensor partial least squares regression
    Stott, Alexander E.
    Dees, Bruno Scalzo
    Kisil, Ilia
    Mandic, Danilo P.
    [J]. SIGNAL PROCESSING, 2019, 160 : 316 - 327
  • [46] Fuzzy least-squares algorithms for interactive fuzzy linear regression models
    Yang, MS
    Liu, HH
    [J]. FUZZY SETS AND SYSTEMS, 2003, 135 (02) : 305 - 316
  • [47] Weighted least squares fitting using ordinary least squares algorithms
    Henk A. L. Kiers
    [J]. Psychometrika, 1997, 62 : 251 - 266
  • [48] Weighted least squares fitting using ordinary least squares algorithms
    Kiers, HAL
    [J]. PSYCHOMETRIKA, 1997, 62 (02) : 251 - 266
  • [49] Fast algorithms for structured least squares and total least squares problems
    Kalsi, Anoop
    O'Leary, Dianne P.
    [J]. JOURNAL OF RESEARCH OF THE NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY, 2006, 111 (02) : 113 - 119
  • [50] COMPUTING THE EXACT LEAST MEDIAN OF SQUARES ESTIMATE AND STABILITY DIAGNOSTICS IN MULTIPLE LINEAR-REGRESSION
    STROMBERG, AJ
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1993, 14 (06): : 1289 - 1299