Extended twin parametric margin support vector regression

被引:0
|
作者
Sahleh, Ali [1 ]
Salahi, Maziar [1 ]
Eskandari, Sadegh [2 ]
Khodamoradi, Tahereh [1 ]
机构
[1] Univ Guilan, Fac Math Sci, Dept Appl Math, Namjoo Blvd, Rasht 41938-33697, Guilan, Iran
[2] Univ Guilan, Fac Math Sci, Dept Comp Sci, Namjoo Blvd, Rasht 41938 33697, Guilan, Iran
关键词
Support vector regression; Twin support vector regression; Hinge-loss function; Stock market prediction; FEATURE-EXTRACTION; CLASSIFICATION; MACHINE;
D O I
10.1007/s12597-024-00829-2
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Support Vector Regression (SVR) and its extensions have demonstrated effectiveness in addressing regression problems, yet they face challenges, including high computational costs for large-scale datasets and sensitivity to outliers. To mitigate these limitations, various techniques such as twin SVR (TWSVR) and robust TWSVR (RTWSVR) have been proposed. However, existing approaches may suffer from issues like alignment of the final regressor with the dataset during the learning processes. In this paper, we introduce an extended twin parametric margin SVR (ETPMSVR) model inspired by the principles of robust geometric TPMSVM (RGTPSVM). The ETPMSVR addresses these challenges by integrating the average of & varepsilon;\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\epsilon$$\end{document}-insensitive upper and lower bounds of the regressor into the objective function and constraints, ensuring alignment with the dataset and hence the final regerssor is found along with two boundary hyperplanes during the training process in a single quadratic programming problem. Additionally, a hinge-loss function is incorporated to enhance robustness against outliers. We derive the dual formulation to improve computational efficiency. Experiments on a diverse range of datasets, 10 UCI datasets and 8 S &P index datasets from financial market, demonstrate the efficacy of the proposed model in comparison to various benchmarks, including TWSVR, RTWSVR, multi-layer perceptron, and long short-term memory network.
引用
收藏
页数:24
相关论文
共 50 条
  • [31] Smooth twin support vector regression
    Chen, Xiaobo
    Yang, Jian
    Liang, Jun
    Ye, Qiaolin
    NEURAL COMPUTING & APPLICATIONS, 2012, 21 (03): : 505 - 513
  • [32] On Lagrangian twin support vector regression
    Balasundaram, S.
    Tanveer, M.
    NEURAL COMPUTING & APPLICATIONS, 2013, 22 : S257 - S267
  • [33] On Lagrangian twin support vector regression
    S. Balasundaram
    M. Tanveer
    Neural Computing and Applications, 2013, 22 : 257 - 267
  • [34] A safe sample screening rule for Laplacian twin parametric-margin support vector machine
    Yang, Zhiji
    Xu, Yitian
    PATTERN RECOGNITION, 2018, 84 : 1 - 12
  • [35] Angle-based twin parametric-margin support vector machine for pattern classification
    Rastogi , Reshma
    Saigal, Pooja
    Chandra, Suresh
    KNOWLEDGE-BASED SYSTEMS, 2018, 139 : 64 - 77
  • [36] Laplacian twin parametric-margin support vector machine for semi-supervised classification
    Yang, Zhiji
    Xu, Yitian
    NEUROCOMPUTING, 2016, 171 : 325 - 334
  • [37] ISOLATION FOREST-BASED LEAST SQUARES TWIN MARGIN DISTRIBUTION SUPPORT VECTOR REGRESSION
    Feng, Wei
    Shen, Geliang
    Xu, Benye
    Gu, Binjie
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2021, 17 (02): : 565 - 579
  • [38] A New Fast Twin Support Vector Regression
    Fan, Ying
    Shi, Yilin
    Kang, Kai
    Zheng, Fengde
    Su, Peng
    Yang, Jie
    PROCEEDINGS OF 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2020), 2020, : 489 - 492
  • [39] Twin support vector regression with Huber loss
    Niu, Jiayi
    Chen, Jing
    Xu, Yitian
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2017, 32 (06) : 4247 - 4258
  • [40] Accurate incremental ε-twin support vector regression
    Cao J.
    Gu B.-J.
    Pan F.
    Xiong W.-L.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2022, 39 (06): : 1020 - 1032