Skip to main content
U.S. flag

An official website of the United States government

Evaluation of statistical treatments of left-censored environmental data using coincident uncensored data sets. II. Group comparisons

January 1, 2015

The main classes of statistical treatments that have been used to determine if two groups of censored environmental data arise from the same distribution are substitution methods, maximum likelihood (MLE) techniques, and nonparametric methods. These treatments along with using all instrument-generated data (IN), even those less than the detection limit, were evaluated by examining 550 data sets in which the true values of the censored data were known, and therefore “true” probabilities could be calculated and used as a yardstick for comparison. It was found that technique “quality” was strongly dependent on the degree of censoring present in the groups. For low degrees of censoring (<25% in each group), the Generalized Wilcoxon (GW) technique and substitution of √2/2 times the detection limit gave overall the best results. For moderate degrees of censoring, MLE worked best, but only if the distribution could be estimated to be normal or log-normal prior to its application; otherwise, GW was a suitable alternative. For higher degrees of censoring (each group >40% censoring), no technique provided reliable estimates of the true probability. Group size did not appear to influence the quality of the result, and no technique appeared to become better or worse than other techniques relative to group size. Finally, IN appeared to do very well relative to the other techniques regardless of censoring or group size.

Publication Year 2015
Title Evaluation of statistical treatments of left-censored environmental data using coincident uncensored data sets. II. Group comparisons
DOI 10.1021/acs.est.5b02385
Authors Ronald C. Antweiler
Publication Type Article
Publication Subtype Journal Article
Series Title Environmental Science & Technology
Index ID 70189701
Record Source USGS Publications Warehouse
USGS Organization National Research Program - Central Branch