Premium
Error Rates in Multiple Comparisons Among Means—Results of a Simulation Exercise
Author(s) -
Thomas D. A. H.
Publication year - 1974
Publication title -
journal of the royal statistical society: series c (applied statistics)
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.205
H-Index - 72
eISSN - 1467-9876
pISSN - 0035-9254
DOI - 10.2307/2347121
Subject(s) - statistics , psychology , computer science , mathematics
Summary When a number of tests are carried out simultaneously on a set of data some overall guarantee against making type I errors is required. Various solutions to this problem have been suggested with different approaches to this overall protection level. The joint operating characteristics of simultaneous tests are usually incompletely specified and simulation has to be employed to evaluate the power of the tests. A new simulation is reported, comparing seven methods of pairwise comparisons and four for constructing simultaneous sets of confidence limits. The general conclusions are that Duncan's multiple range test is the best method of those considered for the former and the Bonferroni t ‐based limits for the latter. The findings are generally in agreement with all but one of the previous simulations which have been carried out on multiple comparisons.