Premium
Confidence intervals for multinomial logistic regression in sparse data
Author(s) -
Bull Shelley B.,
Lewinger Juan Pablo,
Lee Sophia S. F.
Publication year - 2006
Publication title -
statistics in medicine
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.996
H-Index - 183
eISSN - 1097-0258
pISSN - 0277-6715
DOI - 10.1002/sim.2518
Subject(s) - multinomial logistic regression , statistics , logistic regression , mathematics , covariate , confidence interval , likelihood function , binary data , multinomial distribution , econometrics , wald test , maximum likelihood , binary number , statistical hypothesis testing , arithmetic
Logistic regression is one of the most widely used regression models in practice, but alternatives to conventional maximum likelihood estimation methods may be more appropriate for small or sparse samples. Modification of the logistic regression score function to remove first‐order bias is equivalent to penalizing the likelihood by the Jeffreys prior, and yields penalized maximum likelihood estimates (PLEs) that always exist, even in samples in which maximum likelihood estimates (MLEs) are infinite. PLEs are an attractive alternative in small‐to‐moderate‐sized samples, and are preferred to exact conditional MLEs when there are continuous covariates. We present methods to construct confidence intervals (CI) in the penalized multinomial logistic regression model, and compare CI coverage and length for the PLE‐based methods to that of conventional MLE‐based methods in trinomial logistic regressions with both binary and continuous covariates. Based on simulation studies in sparse data sets, we recommend profile CIs over asymptotic Wald‐type intervals for the PLEs in all cases. Furthermore, when finite sample bias and data separation are likely to occur, we prefer PLE profile CIs over MLE methods. Copyright © 2006 John Wiley & Sons, Ltd.