A More Efficient and Practical Modified Nystrom Method

被引:0
|
作者
Zhang, Wei [1 ]
Sun, Zhe [2 ,3 ]
Liu, Jian [4 ]
Chen, Suisheng [1 ]
机构
[1] Fair Friend Inst Intelligent Mfg, Hangzhou Vocat & Tech Coll, Hangzhou 310018, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Post Ind Technol Res & Dev Ctr State Posts Bur, Internet Things Technol, Nanjing 210023, Peoples R China
[3] Nanjing Univ Posts & Telecommun, Post Big Data Technol & Applicat Engn Res Ctr Jian, Nanjing 210023, Peoples R China
[4] Nanjing Univ Finance & Econ, Coll Informat Engn, Nanjing 210023, Peoples R China
基金
中国国家自然科学基金;
关键词
kernel method; Nystrom method; low-rank approximation; machine learning; MATRIX; APPROXIMATION;
D O I
10.3390/math11112433
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
In this paper, we propose an efficient Nystrom method with theoretical and empirical guarantees. In parallel computing environments and for sparse input kernel matrices, our algorithm can have computation efficiency comparable to the conventional Nystrom method, theoretically. Additionally, we derive an important theoretical result with a compacter sketching matrix and faster speed, at the cost of some accuracy loss compared to the existing state-of-the-art results. Faster randomized SVD and more efficient adaptive sampling methods are also proposed, which have wide application in many machine-learning and data-mining tasks.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Efficient Algorithms and Error Analysis for the Modified Nystrom Method
    Wang, Shusen
    Zhang, Zhihua
    [J]. ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 33, 2014, 33 : 996 - 1004
  • [2] Efficient spatiotemporal grouping using the Nystrom method
    Fowlkes, C
    Belongie, S
    Malik, J
    [J]. 2001 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2001, : 231 - 238
  • [3] Improving the Modified Nystrom Method Using Spectral Shifting
    Wang, Shusen
    Zhang, Chao
    Qian, Hui
    Zhang, Zhihua
    [J]. PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, : 611 - 620
  • [4] An Efficient Solution of EFIE using Parallelized Nystrom Method
    Zhang, Jian
    Shi, Xu
    Zhang, Li
    Tong, Mei Song
    [J]. 2019 INTERNATIONAL APPLIED COMPUTATIONAL ELECTROMAGNETICS SOCIETY SYMPOSIUM - CHINA (ACES), VOL 1, 2019,
  • [5] Double Nystrom Method: An Efficient and Accurate Nystrom Scheme for Large-Scale Data Sets
    Lim, Woosang
    Kim, Minhwan
    Park, Haesun
    Jung, Kyomin
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 1367 - 1375
  • [6] A modified Nystrom method for integral equations with Mellin type kernels
    De Bonis, M. C.
    Laurita, C.
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2016, 296 : 512 - 527
  • [7] Efficient Nystrom method for Low Rank Approximation and Error Analysis
    Patel, Lokendra Singh
    Saha, Suman
    Ghrera, S. P.
    [J]. 2015 THIRD INTERNATIONAL CONFERENCE ON IMAGE INFORMATION PROCESSING (ICIIP), 2015, : 536 - 542
  • [8] On the stability of a modified Nystrom method for Mellin convolution equations in weighted spaces
    De Bonis, M. C.
    Laurita, C.
    [J]. NUMERICAL ALGORITHMS, 2018, 79 (02) : 611 - 631
  • [9] Less is More: Nystrom Computational Regularization
    Rudi, Alessandro
    Camoriano, Raffaello
    Rosasco, Lorenzo
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [10] The isogeometric Nystrom method
    Zechner, Juergen
    Marussig, Benjamin
    Beer, Gernot
    Fries, Thomas-Peter
    [J]. COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2016, 308 : 212 - 237