Premium
Compared with what? An analysis of control‐group types in Cochrane and Campbell reviews of psychosocial treatment efficacy with substance use disorders
Author(s) -
Karlsson Patrik,
Bergmark Anders
Publication year - 2015
Publication title -
addiction
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.424
H-Index - 193
eISSN - 1360-0443
pISSN - 0965-2140
DOI - 10.1111/add.12799
Subject(s) - psychosocial , systematic review , psychological intervention , psychology , clinical psychology , medicine , substance abuse , psychiatry , medline , political science , law
Abstract Background and Aims A crucial, but under‐appreciated, aspect in experimental research on psychosocial treatments of substance use disorders concerns what kinds of control groups are used. This paper examines how the distinction between different control‐group designs have been handled by the Cochrane and the Campbell Collaborations in their systematic reviews of psychosocial treatments of substance abuse disorders. Methods We assessed Cochrane and Campbell reviews ( n = 8) that were devoted to psychosocial treatments of substance use disorders. We noted what control groups were considered and analysed the extent to which the reviews provided a rationale for chosen comparison conditions. We also analysed whether type of control group in the primary studies influenced how the reviews framed the effects discussed and whether this was related to conclusions drawn. Results The reviews covered studies involving widely different control conditions. Overall, little attention was paid to the use of different control groups (e.g. head‐to‐head comparisons versus untreated controls) and what this implies when interpreting effect sizes. Seven of eight reviews did not provide a rationale for the choice of comparison conditions. Conclusions Cochrane and Campbell reviews of the efficacy of psychosocial interventions with substance use disorders seem to underappreciate that the use of different control‐group types yields different effect estimates. Most reviews have not distinguished between different control‐group designs and therefore have provided a confused picture regarding absolute and relative treatment efficacy. A systematic approach to treating different control‐group designs in research reviews is necessary for meaningful estimates of treatment efficacy.