Premium
Consequences of dichotomization
Author(s) -
Fedorov Valerii,
Mannino Frank,
Zhang Rongmei
Publication year - 2008
Publication title -
pharmaceutical statistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.421
H-Index - 38
eISSN - 1539-1612
pISSN - 1539-1604
DOI - 10.1002/pst.331
Subject(s) - statistics , outcome (game theory) , econometrics , sample size determination , mathematics , transformation (genetics) , fisher information , mathematical economics , biochemistry , chemistry , gene
Abstract Dichotomization is the transformation of a continuous outcome (response) to a binary outcome. This approach, while somewhat common, is harmful from the viewpoint of statistical estimation and hypothesis testing. We show that this leads to loss of information, which can be large. For normally distributed data, this loss in terms of Fisher's information is at least 1 − 2/π (or 36%). In other words, 100 continuous observations are statistically equivalent to 158 dichotomized observations. The amount of information lost depends greatly on the prior choice of cut points, with the optimal cut point depending upon the unknown parameters. The loss of information leads to loss of power or conversely a sample size increase to maintain power. Only in certain cases, for instance, in estimating a value of the cumulative distribution function and when the assumed model is very different from the true model, can the use of dichotomized outcomes be considered a reasonable approach. Copyright © 2008 John Wiley & Sons, Ltd.