Open AccessMultiplicity Control vs Replication
Author(s) -
Andrew Hunter,
Nataly Beribisky,
Linda Farmus,
Robert A. Cribbie
Publication year - 2020
Publication title -
meta-psychology
Language(s) - English
Resource type - Journals
ISSN - 2003-2714
DOI - 10.15626/mp.2019.1992
Subject(s) - multiplicity (mathematics) , replication (statistics) , multiplicity of infection , computer science , mathematics , biology , statistics , genetics , in vitro , geometry
This paper presents a side-by-side consideration of multiplicity control procedures and replication as solutions to the problem of multiplicity. Several independent theoretical arguments are presented which demonstrate that replication serves several important functions, and that multiplicity control procedures have a number of serious flaws. Subsequently, the results of a simulation study are provided, showing that under typical conditions, replication provides similar familywise error control and power as multiplicity control procedures. Taken together, these theoretical and statistical arguments lead to the conclusion that researchers who are concerned about the problem of multiplicity should shift their attention away from multiplicity control procedures and towards increased use of replication.