Quadratic programming formulations for classificationand regression

被引:8
|
作者
Gilbert, Robin C. [1 ]
Trafalis, Theodore B. [1 ]
机构
[1] Univ Oklahoma, Sch Ind Engn, Lab Optimizat & Intelligent Syst, Norman, OK 73019 USA
来源
OPTIMIZATION METHODS & SOFTWARE | 2009年 / 24卷 / 02期
关键词
classification; nonlinear regression; pattern recognition; SMO ALGORITHM; CONVERGENCE;
D O I
10.1080/10556780902752892
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We reformulate the support vector machine approach to classification and regression problems using a different methodology than the classical 'largest margin' paradigm. From this, we are able to derive extremely simple quadratic programming problems that allow for general symbolic solutions to the classical problems of geometric classification and regression. We obtain a new class of learning machines that are also robust to the presence of small perturbations and/or corrupted or missing data in the training sets (provided that information about the amplitude of the perturbations is known approximately). A high performance framework for very large-scale classification and regression problems based on a Voronoi tessellation of the input space is also introduced in this work. Our approach has been tested on seven benchmark databases with noticeable gain in computational time in comparison with standard decomposition techniques such as SVMlight.
引用
收藏
页码:175 / 185
页数:11
相关论文
共 50 条
  • [1] Quadratic Programming and Penalized Regression
    Smith, Andrew D. A. C.
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2013, 42 (07) : 1363 - 1372
  • [2] QUADRATIC PROGRAMMING FOR NONLINEAR REGRESSION
    SHRAGER, RI
    COMMUNICATIONS OF THE ACM, 1972, 15 (01) : 41 - &
  • [3] Mixed integer programming and quadratic programming formulations for the interval count problem
    Medeiros, Livia
    Oliveira, Fabiano
    Lucena, Abilio
    Szwarefiter, Jayme
    XII LATIN-AMERICAN ALGORITHMS, GRAPHS AND OPTIMIZATION SYMPOSIUM, LAGOS 2023, 2023, 224 : 283 - 291
  • [4] Mixed integer programming and quadratic programming formulations for the interval count problem
    Medeiros, Lívia
    Oliveira, Fabiano
    Lucena, Abilio
    Szwarcfiter, Jayme
    Procedia Computer Science, 2023, 223 : 283 - 291
  • [5] Extended formulations in mixed integer conic quadratic programming
    Vielma J.P.
    Dunning I.
    Huchette J.
    Lubin M.
    Mathematical Programming Computation, 2017, 9 (3) : 369 - 418
  • [6] Continuous quadratic programming formulations of optimization problems on graphs
    Hager, William W.
    Hungerford, James T.
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2015, 240 (02) : 328 - 337
  • [7] Interval regression analysis by quadratic programming approach
    Tanaka, H
    Lee, H
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 1998, 6 (04) : 473 - 481
  • [8] Interval regression analysis based on quadratic programming
    Tanaka, H
    Koyama, K
    Lee, H
    FUZZ-IEEE '96 - PROCEEDINGS OF THE FIFTH IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOLS 1-3, 1996, : 325 - 329
  • [9] Compact mixed-integer programming formulations in quadratic optimization
    Beach, Benjamin
    Hildebrand, Robert
    Huchette, Joey
    JOURNAL OF GLOBAL OPTIMIZATION, 2022, 84 (04) : 869 - 912
  • [10] Compact mixed-integer programming formulations in quadratic optimization
    Benjamin Beach
    Robert Hildebrand
    Joey Huchette
    Journal of Global Optimization, 2022, 84 : 869 - 912