Premium
Standard Errors of Variance Components, Measurement Errors and Generalizability Coefficients for Crossed Designs
Author(s) -
Almehrizi Rashid S.
Publication year - 2020
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/jedm.12277
Subject(s) - generalizability theory , statistics , estimator , standard error , variance (accounting) , variance components , confidence interval , standard deviation , mathematics , observational error , normal distribution , sampling (signal processing) , multivariate statistics , monte carlo method , computer science , accounting , filter (signal processing) , business , computer vision
Estimates of various variance components, universe score variance, measurement error variances, and generalizability coefficients, like all statistics, are subject to sampling variability, particularly in small samples. Such variability is quantified traditionally through estimated standard errors and/or confidence intervals. The paper derived new standard errors for all estimated statistics for two crossed designs (single‐facet design and two‐facet design) in generalizability theory. The derivation was based on the assumption of multivariate normal distribution for observation scores using delta method. The derivation was differentiating between fixed and random facets. The adequacy of the derived standard errors was examined using Mont Carlo simulation for the two designs under several test conditions and compared to the traditional existing methods as well as implementation on real data. Results showed that the derived standard errors for all estimators are converging to the empirical standard errors for all simulation conditions with the two designs for both normal and non‐normal continuous data.