Open Access
Evaluating screening questionnaires using receiver Operating Characteristic (ROC) curves from two‐phase (double) samples
Author(s) -
Bisoffi Giulia,
Mazzi Maria Angela,
Dunn Graham
Publication year - 2000
Publication title -
international journal of methods in psychiatric research
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.275
H-Index - 73
eISSN - 1557-0657
pISSN - 1049-8931
DOI - 10.1002/mpr.86
Subject(s) - jackknife resampling , receiver operating characteristic , weighting , statistics , sensitivity (control systems) , sampling (signal processing) , standard error , macro , bootstrapping (finance) , mathematics , computer science , econometrics , medicine , estimator , engineering , filter (signal processing) , electronic engineering , computer vision , radiology , programming language
Abstract The characteristics of psychiatric screening tests (for example, sensitivity, specificity, and AUC – the area under an ROC curve) are frequently assessed using data arising from two‐phase samples. Too often, however, the statistical methods that are used are incorrect. They do not appropriately account for the sampling design. Valid methods for the estimate of sensitivity, specificity and, in particular, the AUC, together with its standard error, are discussed in detail and a Stata macro for the implementation of these methods is provided. Simple weighting procedures are used to correct for verification biases arising from the two‐phase design, together with bootstrap or jackknife sampling for the calculation of valid standard errors. Copyright © 2000 Whurr Publishers Ltd.