Premium
The shrinking or disappearing observed treatment effect
Author(s) -
ChuangStein Christy,
Kirby Simon
Publication year - 2014
Publication title -
pharmaceutical statistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.421
H-Index - 38
eISSN - 1539-1612
pISSN - 1539-1604
DOI - 10.1002/pst.1633
Subject(s) - interim , surprise , analogy , clinical trial , interim analysis , econometrics , treatment effect , psychology , medicine , statistics , epistemology , mathematics , social psychology , philosophy , political science , law , traditional medicine
It is frequently noted that an initial clinical trial finding was not reproduced in a later trial. This is often met with some surprise. Yet, there is a relatively straightforward reason partially responsible for this observation. In this article, we examine this reason by first reviewing some findings in a recent publication in the Journal of the American Medical Association. To help explain the non‐negligible chance of failing to reproduce a previous positive finding, we compare a series of trials to successive diagnostic tests used for identifying a condition. To help explain the suspicion that the treatment effect, when observed in a subsequent trial, seems to have decreased in magnitude, we draw a conceptual analogy between phases II–III development stages and interim analyses of a trial with a group sequential design. Both analogies remind us that what we observed in an early trial could be a false positive or a random high. We discuss statistical sources for these occurrences and discuss why it is important for statisticians to take these into consideration when designing and interpreting trial results. Copyright © 2014 John Wiley & Sons, Ltd.