Premium
Sparse spectral estimation with missing and corrupted measurements
Author(s) -
Elsener Andreas,
Geer Sara
Publication year - 2019
Publication title -
stat
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.61
H-Index - 18
ISSN - 2049-1573
DOI - 10.1002/sta4.229
Subject(s) - missing data , imputation (statistics) , estimator , subspace topology , principal component analysis , matrix completion , computer science , pattern recognition (psychology) , mathematics , covariance matrix , artificial intelligence , statistics , gaussian , physics , quantum mechanics
Supervised learning methods with missing data have been extensively studied not just due to the techniques related to low‐rank matrix completion. Also, in unsupervised learning, one often relies on imputation methods. As a matter of fact, missing values induce a bias in various estimators such as the sample covariance matrix. In the present paper, a convex method for sparse subspace estimation is extended to the case of missing and corrupted measurements. This is done by correcting the bias instead of imputing the missing values. The estimator is then used as an initial value for a nonconvex procedure to improve the overall statistical performance. The methodological and theoretical frameworks are applied to a wide range of statistical problems. These include sparse principal component analysis with different types of randomly missing data. Finally, the statistical performance is demonstrated on synthetic data.