Efficient Serial and Parallel SVM Training using Coordinate Descent

被引:0
|
作者
Liossis, Emmanuel [1 ]
机构
[1] Natl Tech Univ Athens, Sch Elect & Comp Engn, Intelligent Syst Lab, Athens, Greece
关键词
SVM; training algorithm; parallel;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Eliminating the bias term of the Support Vector Machine (SVM) classifier permits substancial simplification to training algorithms. Using this elimination, the optimization invloved in training can be decomposed to update as low as one coordinate at a time. This paper explores two directions of improvements which stem from this simplification. The first one is about the options available for choosing the coordinate to optimize during each optimization iteration. The second one is about the parallelization schemes which the simplified optimization facilitates.
引用
收藏
页码:76 / 83
页数:8
相关论文
共 50 条
  • [1] Efficient Serial and Parallel Coordinate Descent Methods for Huge-Scale Truss Topology Design
    Richtarik, Peter
    Takac, Martin
    OPERATIONS RESEARCH PROCEEDINGS 2011, 2012, : 27 - 32
  • [2] On the complexity of parallel coordinate descent
    Tappenden, Rachael
    Takac, Martin
    Richtarik, Peter
    OPTIMIZATION METHODS & SOFTWARE, 2018, 33 (02): : 372 - 395
  • [3] A computationally efficient parallel coordinate descent algorithm for MPC: implementation on a PLC
    Necoara, Ion
    Clipici, Dragos N.
    2013 EUROPEAN CONTROL CONFERENCE (ECC), 2013, : 3596 - 3601
  • [4] Asynchronous Parallel Greedy Coordinate Descent
    You, Yang
    Lian, XiangRu
    Liu, Ji
    Yu, Hsiang-Fu
    Dhillon, Inderjit S.
    Demmel, James
    Hsieh, Cho-Jui
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [5] ACCELERATED, PARALLEL, AND PROXIMAL COORDINATE DESCENT
    Fercoq, Olivier
    Richtarik, Peter
    SIAM JOURNAL ON OPTIMIZATION, 2015, 25 (04) : 1997 - 2023
  • [6] Parallel coordinate descent for the Adaboost problem
    Fercoq, Olivier
    2013 12TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2013), VOL 1, 2013, : 354 - 358
  • [7] PPD: A Scalable and Efficient Parallel Primal-Dual Coordinate Descent Algorithm
    Wu, Hejun
    Huang, Xinchuan
    Luo, Qiong
    Yang, Zhongheng
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (04) : 1958 - 1966
  • [8] An asynchronous parallel stochastic coordinate descent algorithm
    Liu, Ji
    Wright, Stephen J.
    Ré, Christopher
    Bittorf, Victor
    Sridhar, Srikrishna
    Journal of Machine Learning Research, 2015, 16 : 285 - 322
  • [9] An Asynchronous Parallel Stochastic Coordinate Descent Algorithm
    Liu, Ji
    Wright, Stephen J.
    Re, Christopher
    Bittorf, Victor
    Sridhar, Srikrishna
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 32 (CYCLE 2), 2014, 32 : 469 - 477
  • [10] An Asynchronous Parallel Stochastic Coordinate Descent Algorithm
    Liu, Ji
    Wright, Stephen J.
    Re, Christopher
    Bittorf, Victor
    Sridhar, Srikrishna
    JOURNAL OF MACHINE LEARNING RESEARCH, 2015, 16 : 285 - 322