Efficient Serial and Parallel SVM Training using Coordinate Descent

被引:0
|
作者
Liossis, Emmanuel [1 ]
机构
[1] Natl Tech Univ Athens, Sch Elect & Comp Engn, Intelligent Syst Lab, Athens, Greece
关键词
SVM; training algorithm; parallel;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Eliminating the bias term of the Support Vector Machine (SVM) classifier permits substancial simplification to training algorithms. Using this elimination, the optimization invloved in training can be decomposed to update as low as one coordinate at a time. This paper explores two directions of improvements which stem from this simplification. The first one is about the options available for choosing the coordinate to optimize during each optimization iteration. The second one is about the parallelization schemes which the simplified optimization facilitates.
引用
收藏
页码:76 / 83
页数:8
相关论文
共 50 条
  • [41] Optimization in High Dimensions via Accelerated, Parallel, and Proximal Coordinate Descent
    Fercoq, Olivier
    Richtarik, Peter
    SIAM REVIEW, 2016, 58 (04) : 739 - 771
  • [42] Sparse Representation and Dictionary Learning Based on Alternating Parallel Coordinate Descent
    Tang, Zunyi
    Tamura, Toshiyo
    Ding, Shuxue
    Li, Zhenni
    2013 INTERNATIONAL JOINT CONFERENCE ON AWARENESS SCIENCE AND TECHNOLOGY & UBI-MEDIA COMPUTING (ICAST-UMEDIA), 2013, : 491 - +
  • [43] Scalable Coordinate Descent Approaches to Parallel Matrix Factorization for Recommender Systems
    Yu, Hsiang-Fu
    Hsieh, Cho-Jui
    Si, Si
    Dhillon, Inderjit
    12TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2012), 2012, : 765 - 774
  • [44] Efficient Nonnegative Tensor Factorization via Saturating Coordinate Descent
    Balasubramaniam, Thirunavukarasu
    Nayak, Richi
    Yuen, Chau
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2020, 14 (04)
  • [45] Efficient block-coordinate descent algorithms for the Group Lasso
    Qin Z.
    Scheinberg K.
    Goldfarb D.
    Qin, Z. (zq2107@columbia.edu), 2013, Springer Verlag (05) : 143 - 169
  • [46] Blockwise coordinate descent schemes for efficient and effective dictionary learning
    Liu, Bao-Di
    Wang, Yu-Xiong
    Shen, Bin
    Li, Xue
    Zhang, Yu-Jin
    Wang, Yan-Jiang
    NEUROCOMPUTING, 2016, 178 : 25 - 35
  • [47] Dual Coordinate-Descent Methods for Linear One-Class SVM and SVDD
    Chou, Hung-Yi
    Lin, Pin-Yen
    Lin, Chih-Jen
    PROCEEDINGS OF THE 2020 SIAM INTERNATIONAL CONFERENCE ON DATA MINING (SDM), 2020, : 181 - 189
  • [48] Efficient SVM Regression Training with SMO
    Gary William Flake
    Steve Lawrence
    Machine Learning, 2002, 46 : 271 - 290
  • [49] Efficient SVM regression training with SMO
    Flake, GW
    Lawrence, S
    MACHINE LEARNING, 2002, 46 (1-3) : 271 - 290
  • [50] Efficient Detection for Large-Scale MIMO Systems Using Dichotomous Coordinate Descent Iterations
    Quan, Zhi
    Lv, Shuhua
    Jiang, Li
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2020, E103B (11) : 1310 - 1317