Premium
STATISTICAL POWER AND COST IN TRAINING EVALUATION: SOME NEW CONSIDERATIONS
Author(s) -
YANG HYUCKSEUNG,
SACKETT PAUL R.,
ARVEY RICHARD D.
Publication year - 1996
Publication title -
personnel psychology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 6.076
H-Index - 142
eISSN - 1744-6570
pISSN - 0031-5826
DOI - 10.1111/j.1744-6570.1996.tb01588.x
Subject(s) - analysis of covariance , sample size determination , proxy (statistics) , statistical power , statistics , control (management) , sample (material) , econometrics , treatment and control groups , psychology , computer science , operations management , mathematics , artificial intelligence , engineering , chemistry , chromatography
Two ways to reduce the costs of training evaluation are examined. First, we examine the potential for reducing the costs of training evaluation by assigning different numbers of subjects into training and control groups. Given a total N of subjects, statistical power to detect the effectiveness of a training program can be maximized by assigning the subjects equally to training and control groups. If we take into account the costs of training evaluation, however, an unequal‐group‐size design with a larger total N may achieve the same level of statistical power at lower cost. We derive formulas for the optimal ratios of the control group size to the training group size for both ANOVA and ANCOVA designs, incorporating the differential costs of training and control group participation. Second, we examine the possibility that using a less expensive proxy criterion measure in place of the target criterion measure of interest when evaluating the training effectiveness can pay off. We show that using a proxy criterion increases the sample size needed to achieve a given level of statistical power, and then we describe procedures for examining the tradeoff between the costs saved by using the less expensive proxy criterion and the costs incurred by the larger sample size.