z-logo
Premium
Regularized Sandwich Estimators for Analysis of High‐Dimensional Data Using Generalized Estimating Equations
Author(s) -
Warton David I.
Publication year - 2011
Publication title -
biometrics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.298
H-Index - 130
eISSN - 1541-0420
pISSN - 0006-341X
DOI - 10.1111/j.1541-0420.2010.01438.x
Subject(s) - estimator , resampling , mathematics , generalized estimating equation , curse of dimensionality , statistics , estimating equations , wald test , covariance matrix , poisson distribution , statistical inference , computer science , statistical hypothesis testing
Summary A modification of generalized estimating equations (GEEs) methodology is proposed for hypothesis testing of high‐dimensional data, with particular interest in multivariate abundance data in ecology, an important application of interest in thousands of environmental science studies. Such data are typically counts characterized by high dimensionality (in the sense that cluster size exceeds number of clusters,  n > K )  and over‐dispersion relative to the Poisson distribution. Usual GEE methods cannot be applied in this setting primarily because sandwich estimators become numerically unstable as  n  increases. We propose instead using a regularized sandwich estimator that assumes a common correlation matrix  R , and shrinks the sample estimate of  R  toward the working correlation matrix to improve its numerical stability. It is shown via theory and simulation that this substantially improves the power of Wald statistics when cluster size is not small. We apply the proposed approach to study the effects of nutrient addition on nematode communities, and in doing so discuss important issues in implementation, such as using statistics that have good properties when parameter estimates approach the boundary (), and using resampling to enable valid inference that is robust to high dimensionality and to possible model misspecification.

This content is not available in your region!

Continue researching here.

Having issues? You can contact us here