Premium
Two‐way Gaussian mixture models for high dimensional classification
Author(s) -
Qiao Mu,
Li Jia
Publication year - 2010
Publication title -
statistical analysis and data mining: the asa data science journal
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.381
H-Index - 33
eISSN - 1932-1872
pISSN - 1932-1864
DOI - 10.1002/sam.10082
Subject(s) - mixture model , gaussian , exponential family , dimension (graph theory) , pattern recognition (psychology) , dimensionality reduction , range (aeronautics) , computer science , mathematics , artificial intelligence , linear discriminant analysis , expectation–maximization algorithm , exponential function , data mining , algorithm , statistics , maximum likelihood , combinatorics , engineering , mathematical analysis , physics , quantum mechanics , aerospace engineering
Mixture discriminant analysis (MDA) has gained applications in a wide range of engineering and scientific fields. In this article, under the paradigm of MDA, we propose a two‐way Gaussian mixture model for classifying high dimensional data. This model regularizes the mixture component means by dividing variables into groups and then constraining the parameters for the variables in the same group to be identical. The grouping of the variables is not pre‐determined, but optimized as part of model estimation. A dimension reduction property for a two‐way mixture of distributions from a general exponential family is proved. Estimation methods for the two‐way Gaussian mixture with or without missing data are derived. Experiments on several real data sets show that the parsimonious two‐way mixture often outperforms a mixture model without variable grouping; and as a byproduct, significant dimension reduction is achieved. Copyright © 2010 Wiley Periodicals, Inc. Statistical Analysis and Data Mining 3: 259‐271, 2010