
Kernel least absolute shrinkage and selection operator regression classifier for pattern classification
Author(s) -
Xu Jie,
Yin Jun
Publication year - 2013
Publication title -
iet computer vision
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.38
H-Index - 37
eISSN - 1751-9640
pISSN - 1751-9632
DOI - 10.1049/iet-cvi.2011.0193
Subject(s) - pattern recognition (psychology) , mathematics , artificial intelligence , feature selection , classifier (uml) , kernel (algebra) , feature vector , radial basis function kernel , hilbert space , kernel method , support vector machine , reproducing kernel hilbert space , computer science , combinatorics , mathematical analysis
The feature vectors in feature space are more likely to be linearly separable than the observations in input space. To enhance the separability of the feature vectors, the authors perform least absolute shrinkage and selection operator (LASSO) regression in the reproducing kernel Hilbert space and develop a kernel LASSO regression classifier (LASSO‐KRC). Based on the theory of calculus, least squares optimisation with L1‐norm regularised constraints can be reformulated into another equivalent form. Without an explicit mapping function, the solution to the optimisation problem can be obtained by solving a convex optimisation problem with any symmetric kernel function. LASSO‐KRC is applied to pattern classification and appears to outperform nearest neighbour classifier, minimum distance classifier, sparse representation classifier and linear regression classifier.