Premium
Accounting for sample overlap in economics meta‐analyses: The generalized‐weights method in practice
Author(s) -
Bom Pedro R. D.,
Rachinger Heiko
Publication year - 2025
Publication title -
journal of economic surveys
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.657
H-Index - 92
eISSN - 1467-6419
pISSN - 0950-0804
DOI - 10.1111/joes.12633
Abstract Meta‐analyses in economics frequently exhibit considerable overlap among primary samples. If not addressed, sample overlap leads to efficiency losses and inflated rates of false positives at the meta‐analytical level. In previous work, we proposed a generalized‐weights (GW) approach to handle sample overlap. This approach effectively approximates the correlation structure between primary estimates using information on sample sizes and overlap degrees in the primary studies. This paper demonstrates the application of the GW method to economics meta‐analyses, addressing practical challenges that are likely to be encountered. We account for variations in data aggregation levels, estimation methods, and effect size metrics, among other issues. We derive explicit covariance formulas for different scenarios, evaluate the accuracy of the approximations, and employ Monte Carlo simulations to demonstrate how the method enhances efficiency and restores the false positive rate to its nominal level.
Empowering knowledge with every search
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom