Statistical margin error bounds for L1-norm support vector machines

Comparing with L-p-norm (1 < p < + infinity) Support Vector Machines (SVMs), the L-1-norm SVM enjoys the nice property of simultaneously performing classification and feature selection. Margin error bounds for SVM on Hilbert spaces (or on more general q-uniformly smooth Banach spaces) have been obtained in the literature to justify the strategy of maximizing the margin in SVM. In this paper, we devote to estimating the margin error bound for L-1-norm SVM methods and giving a geometrical interpretation for the result. We show that the fat-shattering dimension of the Banach spaces l(1) and l(infinity) are both infinite. Therefore, we establish margin error bounds for the SVM on finite dimensional spaces with L-1-norm, thus supplying statistical justification for the large margin classification of L-1-norm SVM on finite dimensional spaces. To complete the theory, corresponding results for the L-infinity-norm SVM are also presented. (C) 2019 Elsevier B.V. All rights reserved.