Efficient Serial and Parallel SVM Training using Coordinate Descent

被引:0
|
作者
Liossis, Emmanuel [1 ]
机构
[1] Natl Tech Univ Athens, Sch Elect & Comp Engn, Intelligent Syst Lab, Athens, Greece
来源
PROCEEDINGS OF THE 2013 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE FOR ENGINEERING SOLUTIONS (CIES) | 2013年
关键词
SVM; training algorithm; parallel;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Eliminating the bias term of the Support Vector Machine (SVM) classifier permits substancial simplification to training algorithms. Using this elimination, the optimization invloved in training can be decomposed to update as low as one coordinate at a time. This paper explores two directions of improvements which stem from this simplification. The first one is about the options available for choosing the coordinate to optimize during each optimization iteration. The second one is about the parallelization schemes which the simplified optimization facilitates.
引用
收藏
页码:76 / 83
页数:8
相关论文
共 50 条
  • [21] Parallel coordinate descent methods for big data optimization
    Richtarik, Peter
    Takac, Martin
    MATHEMATICAL PROGRAMMING, 2016, 156 (1-2) : 433 - 484
  • [22] An efficient parallel block coordinate descent algorithm for large-scale precision matrix estimation using graphics processing units
    Young-Geun Choi
    Seunghwan Lee
    Donghyeon Yu
    Computational Statistics, 2022, 37 : 419 - 443
  • [23] An efficient parallel block coordinate descent algorithm for large-scale precision matrix estimation using graphics processing units
    Choi, Young-Geun
    Lee, Seunghwan
    Yu, Donghyeon
    COMPUTATIONAL STATISTICS, 2022, 37 (01) : 419 - 443
  • [24] Efficient Top-K Feature Selection Using Coordinate Descent Method
    Xu, Lei
    Wang, Rong
    Nie, Feiping
    Li, Xuelong
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 10594 - 10601
  • [25] Efficient parallel coordinate descent algorithm for convex optimization problems with separable constraints: Application to distributed MPC
    Necoara, Ion
    Clipici, Dragos
    JOURNAL OF PROCESS CONTROL, 2013, 23 (03) : 243 - 253
  • [26] Parallel and Distributed Structured SVM Training
    Jiang, Jiantong
    Wen, Zeyi
    Wang, Zeke
    He, Bingsheng
    Chen, Jian
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (05) : 1084 - 1096
  • [27] SPARSE CYCLIC COORDINATE DESCENT FOR EFFICIENT FREQUENCY ESTIMATION
    Guzman, Yuneisy Garcia
    Lunglmayr, Michael
    2019 IEEE 8TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP 2019), 2019, : 440 - 444
  • [28] SySCD: A System-Aware Parallel Coordinate Descent Algorithm
    Ioannou, Nikolas
    Mendler-Dunner, Celestine
    Parnell, Thomas
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [29] Fixing the Convergence Problems in Parallel Asynchronous Dual Coordinate Descent
    Zhang, Huan
    Hsieh, Cho-Jui
    2016 IEEE 16TH INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2016, : 619 - 628
  • [30] Efficient Parallel Stochastic Gradient Descent for Matrix Factorization Using GPU
    Nassar, Mohamed A.
    El-Sayed, Layla A. A.
    Taha, Yousry
    2016 11TH INTERNATIONAL CONFERENCE FOR INTERNET TECHNOLOGY AND SECURED TRANSACTIONS (ICITST), 2016, : 63 - 68