Premium
Assessment of generalizability, applicability and predictability (GAP) for evaluating external validity in studies of universal family‐based prevention of alcohol misuse in young people: systematic methodological review of randomized controlled trials
Author(s) -
FernandezHermida Jose Ramon,
Calafat Amador,
Becoña Elisardo,
Tsertsvadze Alexander,
Foxcroft David R.
Publication year - 2012
Publication title -
addiction
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.424
H-Index - 193
eISSN - 1360-0443
pISSN - 0965-2140
DOI - 10.1111/j.1360-0443.2012.03867.x
Subject(s) - generalizability theory , external validity , internal validity , randomized controlled trial , psychology , observational study , systematic review , population , criterion validity , clinical psychology , psycinfo , medicine , medline , construct validity , psychometrics , social psychology , developmental psychology , environmental health , pathology , political science , law , surgery
Aims To assess external validity characteristics of studies from two Cochrane Systematic Reviews of the effectiveness of universal family‐based prevention of alcohol misuse in young people. Methods Two reviewers used an a priori developed external validity rating form and independently assessed three external validity dimensions of generalizability, applicability and predictability (GAP) in randomized controlled trials. Results The majority (69%) of the included 29 studies were rated ‘unclear’ on the reporting of sufficient information for judging generalizability from sample to study population. Ten studies (35%) were rated ‘unclear’ on the reporting of sufficient information for judging applicability to other populations and settings. No study provided an assessment of the validity of the trial end‐point measures for subsequent mortality, morbidity, quality of life or other economic or social outcomes. Similarly, no study reported on the validity of surrogate measures using established criteria for assessing surrogate end‐points. Conclusions Studies evaluating the benefits of family‐based prevention of alcohol misuse in young people are generally inadequate at reporting information relevant to generalizability of the findings or implications for health or social outcomes. Researchers, study authors, peer reviewers, journal editors and scientific societies should take steps to improve the reporting of information relevant to external validity in prevention trials.