
Some statistical memes which sound correct but aren't quite: Application to the analysis of observational databases used in learning health systems
Author(s) -
Samsa Gregory P.
Publication year - 2020
Publication title -
learning health systems
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.501
H-Index - 9
ISSN - 2379-6146
DOI - 10.1002/lrh2.10219
Subject(s) - observational study , context (archaeology) , computer science , statistical analysis , randomized controlled trial , database , data science , psychology , statistics , medicine , mathematics , history , surgery , archaeology
We consider four memes, correct within the context of randomized trials but requiring modification for the analysis of the observational databases typically associated with learning health systems: (a) the right answer always requires randomization; (b) a bigger database is always a better database; (c) statistical adjustment always works if based on a large enough database; and (d) always make a formal adjustment when testing multiple hypotheses. The rationale for these memes within the context of randomized trials is discussed, and the memes are restated in a fashion that is consistent with learning health systems.