Premium
Valid Inference in Random Effects Meta‐Analysis
Author(s) -
Follmann Dean A.,
Proschan Michael A.
Publication year - 1999
Publication title -
biometrics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.298
H-Index - 130
eISSN - 1541-0420
pISSN - 0006-341X
DOI - 10.1111/j.0006-341x.1999.00732.x
Subject(s) - permutation (music) , test statistic , random permutation , null distribution , resampling , inference , mathematics , statistics , statistic , type i and type ii errors , random effects model , meta analysis , statistical hypothesis testing , computer science , combinatorics , artificial intelligence , medicine , physics , acoustics , block (permutation group theory)
Summary. The standard approach to inference for random effects meta‐analysis relies on approximating the null distribution of a test statistic by a standard normal distribution. This approximation is asymptotic on k, the number of studies, and can be substantially in error in medical meta‐analyses, which often have only a few studies. This paper proposes permutation and ad hoc methods for testing with the random effects model. Under the group permutation method, we randomly switch the treatment and control group labels in each trial. This idea is similar to using a permutation distribution for a community intervention trial where communities are randomized in pairs. The permutation method theoretically controls the type I error rate for typical meta‐analyses scenarios. We also suggest two ad hoc procedures. Our first suggestion is to use a t‐reference distribution with k ‐ 1 degrees of freedom rather than a standard normal distribution for the usual random effects test statistic. We also investigate the use of a simple t‐statistic on the reported treatment effects.