Premium
Estimation of the predictive power of the model in mixed‐effects meta‐regression: A simulation study
Author(s) -
LópezLópez José Antonio,
MarínMartínez Fulgencio,
SánchezMeca Julio,
Noortgate Wim,
Viechtbauer Wolfgang
Publication year - 2014
Publication title -
british journal of mathematical and statistical psychology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 3.157
H-Index - 51
eISSN - 2044-8317
pISSN - 0007-1102
DOI - 10.1111/bmsp.12002
Subject(s) - estimator , predictive power , statistics , meta analysis , econometrics , meta regression , residual , sample size determination , estimation , regression , regression analysis , mixed model , mathematics , convergence (economics) , computer science , algorithm , engineering , economics , medicine , philosophy , systems engineering , epistemology , economic growth
Several methods are available to estimate the total and residual amount of heterogeneity in meta‐analysis, leading to different alternatives when estimating the predictive power in mixed‐effects meta‐regression models using the formula proposed by Raudenbush (1994, 2009). In this paper, a simulation study was conducted to compare the performance of seven estimators of these parameters under various realistic scenarios in psychology and related fields. Our results suggest that the number of studies ( k ) exerts the most important influence on the accuracy of the results, and that precise estimates of the heterogeneity variances and the model predictive power can only be expected with at least 20 and 40 studies, respectively. Increases in the average within‐study sample size (N ¯ ) also improved the results for all estimators. Some differences among the accuracy of the estimators were observed, especially under adverse (small k andN ¯ ) conditions, while the results for the different methods tended to convergence for more optimal scenarios.