On the V γ Dimension for Regression in Reproducing Kernel Hilbert Spaces
Author(s) -
Theodoros Evgeniou,
Massimiliano Pontil
Publication year - 1999
Publication title -
lecture notes in computer science
Language(s) - English
Resource type - Book series
SCImago Journal Rank - 0.249
H-Index - 400
eISSN - 1611-3349
pISSN - 0302-9743
ISBN - 3-540-66748-2
DOI - 10.1007/3-540-46769-6_9
Subject(s) - reproducing kernel hilbert space , mathematics , dimension (graph theory) , representer theorem , linear subspace , kernel (algebra) , hilbert space , bounded function , computation , kernel regression , kernel method , support vector machine , kernel embedding of distributions , regression , discrete mathematics , combinatorics , statistics , pure mathematics , algorithm , mathematical analysis , artificial intelligence , computer science
This paper presents a computation of the Vγ dimension for regression in bounded subspaces of Reproducing Kernel Hilbert Spaces (RKHS) for the Support Vector Machine (SVM) regression Ɛ-insensitive loss function LƐ, and general Lp loss functions. Finiteness of the Vγ dimension is shown, which also proves uniform convergence in probability for regression machines in RKHS subspaces that use the LƐ or general Lp loss functions. This paper presents a novel proof of this result. It also presents a computation of an upper bound of the Vγ dimension under some conditions, that leads to an approach for the estimation of the empirical Vγ dimension given a set of training data.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom