Premium
The use of propensity scores and observational data to estimate randomized controlled trial generalizability bias
Author(s) -
Pressler Taylor R.,
Kaizar Eloise E.
Publication year - 2013
Publication title -
statistics in medicine
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.996
H-Index - 183
eISSN - 1097-0258
pISSN - 0277-6715
DOI - 10.1002/sim.5802
Subject(s) - generalizability theory , observational study , estimator , confounding , propensity score matching , statistics , econometrics , randomized controlled trial , average treatment effect , randomized experiment , population , mathematics , medicine , surgery , environmental health
Although randomized controlled trials are considered the ‘gold standard’ for clinical studies, the use of exclusion criteria may impact the external validity of the results. It is unknown whether estimators of effect size are biased by excluding a portion of the target population from enrollment. We propose to use observational data to estimate the bias due to enrollment restrictions, which we term generalizability bias. In this paper, we introduce a class of estimators for the generalizability bias and use simulation to study its properties in the presence of non‐constant treatment effects. We find the surprising result that our estimators can be unbiased for the true generalizability bias even when all potentially confounding variables are not measured. In addition, our proposed doubly robust estimator performs well even for mis‐specified models. Copyright © 2013 John Wiley & Sons, Ltd.