Inversion-free subsampling Newton's method for large sample logistic regression

被引:4
|
作者
Kirkby, J. Lars [1 ]
Nguyen, Dang H. [2 ]
Duy Nguyen [3 ]
Nguyen, Nhu N. [4 ]
机构
[1] Georgia Inst Technol, Sch Ind & Syst Engn, Atlanta, GA 30318 USA
[2] Univ Alabama, Dept Math, 345 Gordon Palmer Hall,Box 870350, Tuscaloosa, AL 35487 USA
[3] Marist Coll, Dept Math, 3399 North Rd, Poughkeepsie, NY 12601 USA
[4] Univ Connecticut, Dept Math, 341 Mansfield, Storrs, CT 06269 USA
基金
美国国家科学基金会;
关键词
Logistic regression; Massive data; Optimal subsampling; Newton's method; Gradient descent; Stochastic gradient descent; APPROXIMATION; CHALLENGES; MATRIX;
D O I
10.1007/s00362-021-01263-y
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper, we develop a subsampling Newton's method to efficiently approximate the maximum likelihood estimate in logistic regression, which is especially useful for large-sample problems. One distinct feature of our algorithm is that matrix inversion is not explicitly performed. We propose two algorithms which are used to construct iteratively a sequence of matrices which converge to the Hessian of the maximum likelihood function on the subsample. We provide numerical examples to show that the proposed method is efficient and robust.
引用
收藏
页码:943 / 963
页数:21
相关论文
共 50 条
  • [1] Inversion-free subsampling Newton’s method for large sample logistic regression
    J. Lars Kirkby
    Dang H. Nguyen
    Duy Nguyen
    Nhu N. Nguyen
    [J]. Statistical Papers, 2022, 63 : 943 - 963
  • [2] On the Inversion-Free Newton's Method and Its Applications
    Chau, Huy N.
    Kirkby, J. Lars
    Nguyen, Dang H.
    Nguyen, Duy
    Nguyen, Nhu N.
    Nguyen, Thai
    [J]. INTERNATIONAL STATISTICAL REVIEW, 2024, 92 (02) : 284 - 321
  • [3] Optimal Subsampling for Large Sample Logistic Regression
    Wang, HaiYing
    Zhu, Rong
    Ma, Ping
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2018, 113 (522) : 829 - 844
  • [4] Optimal Subsampling for Large Sample Logistic Regression (vol 113, pg 829, 2018)
    Wang, Haiying
    Zhu, Rong
    Ma, Ping
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2019, 114 (525) : 486 - 486
  • [5] Trust region Newton method for large-scale logistic regression
    Lin, Chih-Jen
    Weng, Ruby C.
    Keerthi, S. Sathiya
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2008, 9 : 627 - 650
  • [6] Trust region Newton method for large-scale logistic regression
    Department of Computer Science, National Taiwan University, Taipei 106, Taiwan
    不详
    不详
    [J]. J. Mach. Learn. Res., 2008, (627-650):
  • [7] Inversion-Free Evaluation of Nearest Neighbors in Method of Moments
    Capek, Miloslav
    Jelinek, Lukas
    Gustafsson, Mats
    [J]. IEEE ANTENNAS AND WIRELESS PROPAGATION LETTERS, 2019, 18 (11): : 2311 - 2315
  • [8] INVERSION-FREE METHOD FOR SOLUTION TO EQUATIONS OF NONLINEAR OPERATORS
    BURMEISTER, W
    [J]. ZEITSCHRIFT FUR ANGEWANDTE MATHEMATIK UND MECHANIK, 1972, 52 (02): : 101 - +
  • [9] A new inversion-free method for a rational matrix equation
    Monsalve, Marlliny
    Raydan, Marcos
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 2010, 433 (01) : 64 - 71
  • [10] Logistic regression methods with truncated newton method
    Rahayu, Santi Puteri
    Zain, Jasni Mohamad
    Embong, Abdullah
    Juwari
    Purnami, Santi Wulan
    [J]. INTERNATIONAL CONFERENCE ON ADVANCES SCIENCE AND CONTEMPORARY ENGINEERING 2012, 2012, 50 : 827 - 836