Back to Search Start Over

A semismooth Newton method for support vector classification and regression.

Authors :
Yin, Juan
Li, Qingna
Source :
Computational Optimization & Applications; Jun2019, Vol. 73 Issue 2, p477-508, 32p
Publication Year :
2019

Abstract

Support vector machine is an important and fundamental technique in machine learning. In this paper, we apply a semismooth Newton method to solve two typical SVM models: the L2-loss SVC model and the ϵ -L2-loss SVR model. The semismooth Newton method is widely used in optimization community. A common belief on the semismooth Newton method is its fast convergence rate as well as high computational complexity. Our contribution in this paper is that by exploring the sparse structure of the models, we significantly reduce the computational complexity, meanwhile keeping the quadratic convergence rate. Extensive numerical experiments demonstrate the outstanding performance of the semismooth Newton method, especially for problems with huge size of sample data (for news20.binary problem with 19,996 features and 1,355,191 samples, it only takes 3 s). In particular, for the ϵ -L2-loss SVR model, the semismooth Newton method significantly outperforms the leading solvers including DCD and TRON. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09266003
Volume :
73
Issue :
2
Database :
Complementary Index
Journal :
Computational Optimization & Applications
Publication Type :
Academic Journal
Accession number :
136099063
Full Text :
https://doi.org/10.1007/s10589-019-00075-z