Premium
Power of Tests for a Dichotomous Independent Variable Measured with Error
Author(s) -
McCaffrey Daniel F.,
Elliott Marc N.
Publication year - 2008
Publication title -
health services research
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.706
H-Index - 121
eISSN - 1475-6773
pISSN - 0017-9124
DOI - 10.1111/j.1475-6773.2007.00810.x
Subject(s) - estimator , statistics , variable (mathematics) , variables , econometrics , type i and type ii errors , standard error , computer science , statistical power , mathematics , mathematical analysis
Objective. To examine the implications for statistical power of using predicted probabilities for a dichotomous independent variable, rather than the actual variable. Data Sources/Study Setting. An application uses 271,479 observations from the 2000 to 2002 CAHPS Medicare Fee‐for‐Service surveys. Study Design and Data. A methodological study with simulation results and a substantive application to previously collected data. Principle Findings. Researchers often must employ key dichotomous predictors that are unobserved but for which predictions exist. We consider three approaches to such data: the classification estimator (1); the direct substitution estimator (2); the partial information maximum likelihood estimator (3, PIMLE). The efficiency of (1) (its power relative to testing with the true variable) roughly scales with the square of one less the classification error. The efficiency of (2) roughly scales with the R 2 for predicting the unobserved dichotomous variable, and is usually more powerful than (1). Approach (3) is most powerful, but for testing differences in means of 0.2–0.5 standard deviations, (2) is typically more than 95 percent as efficient as (3). Conclusions. The information loss from not observing actual values of dichotomous predictors can be quite large. Direct substitution is easy to implement and interpret and nearly as efficient as the PIMLE.