Robust Linear Discriminant Analysis for Multiple Groups: Influence and Classification Efficiencies
Author(s) -
Christophe Croux,
Peter Filzmoser,
Kristel Joossens
Publication year - 2005
Publication title -
ssrn electronic journal
Language(s) - English
Resource type - Journals
ISSN - 1556-5068
DOI - 10.2139/ssrn.876896
Subject(s) - linear discriminant analysis , optimal discriminant analysis , pattern recognition (psychology) , statistics , mathematics , artificial intelligence , computer science
Linear discriminant analysis for multiple groups is typically carried out using Fisher's method. This method relies on the sample averages and covariance ma- trices computed from the dierent groups constituting the training sample. Since sample averages and covariance matrices are not robust, it is proposed to use robust estimators of location and covariance instead, yielding a robust version of Fisher's method. In this paper expressions are derived for the influence that an observation in the training set has on the error rate of the Fisher method for multiple linear discriminant analysis. These influence functions on the error rate turn out to be unbounded for the classical rule, but bounded when using a robust approach. Using these influence functions, we compute relative classification eciencies of the robust procedures with respect to the classical method. It is shown that, by using an appropriate robust estimator, the loss in classification eciency at the normal model remains limited. These findings are confirmed by finite sample simulations.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom