Premium
Quantification of Variability and Uncertainty for Censored Data Sets and Application to Air Toxic Emission Factors
Author(s) -
Zhao Yuchao,
Frey H. Christopher
Publication year - 2004
Publication title -
risk analysis
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.972
H-Index - 130
eISSN - 1539-6924
pISSN - 0272-4332
DOI - 10.1111/j.0272-4332.2004.00504.x
Subject(s) - statistics , censoring (clinical trials) , mathematics , weibull distribution , percentile , parametric statistics , sample size determination , nonparametric statistics , confidence interval , log normal distribution , population , bootstrapping (finance) , econometrics , demography , sociology
Many environmental data sets, such as for air toxic emission factors, contain several values reported only as below detection limit. Such data sets are referred to as “censored.” Typical approaches to dealing with the censored data sets include replacing censored values with arbitrary values of zero, one‐half of the detection limit, or the detection limit. Here, an approach to quantification of the variability and uncertainty of censored data sets is demonstrated. Empirical bootstrap simulation is used to simulate censored bootstrap samples from the original data. Maximum likelihood estimation (MLE) is used to fit parametric probability distributions to each bootstrap sample, thereby specifying alternative estimates of the unknown population distribution of the censored data sets. Sampling distributions for uncertainty in statistics such as the mean, median, and percentile are calculated. The robustness of the method was tested by application to different degrees of censoring, sample sizes, coefficients of variation, and numbers of detection limits. Lognormal, gamma, and Weibull distributions were evaluated. The reliability of using this method to estimate the mean is evaluated by averaging the best estimated means of 20 cases for small sample size of 20. The confidence intervals for distribution percentiles estimated with bootstrap/MLE method compared favorably to results obtained with the nonparametric Kaplan–Meier method. The bootstrap/MLE method is illustrated via an application to an empirical air toxic emission factor data set.