Premium
Quantifying risk stratification provided by diagnostic tests and risk predictions: Comparison to AUC and decision curve analysis
Author(s) -
Katki Hormuzd A.
Publication year - 2019
Publication title -
statistics in medicine
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.996
H-Index - 183
eISSN - 1097-0258
pISSN - 0277-6715
DOI - 10.1002/sim.8163
Subject(s) - risk stratification , risk assessment , context (archaeology) , absolute risk reduction , statistics , framingham risk score , medicine , econometrics , stratification (seeds) , computer science , disease , mathematics , confidence interval , seed dormancy , paleontology , botany , germination , computer security , dormancy , biology
A property of diagnostic tests and risk models deserving more attention is risk stratification , defined as the ability of a test or model to separate those at high absolute risk of disease from those at low absolute risk. Risk stratification fills a gap between measures of classification (ie, area under the curve (AUC)) that do not require absolute risks and decision analysis that requires not only absolute risks but also subjective specification of costs and utilities. We introduce mean risk stratification (MRS) as the average change in risk of disease (posttest‐pretest) revealed by a diagnostic test or risk model dichotomized at a risk threshold. Mean risk stratification is particularly valuable for rare conditions, where AUC can be high but MRS can be low, identifying situations that temper overenthusiasm for screening with the new test/model. We apply MRS to the controversy over who should get testing for mutations in BRCA1/2 that cause high risks of breast and ovarian cancers. To reveal different properties of risk thresholds to refer women for BRCA1/2 testing, we propose an eclectic approach considering MRS and other metrics. The value of MRS is to interpret AUC in the context of BRCA1/2 mutation prevalence, providing a range of risk thresholds at which a risk model is “optimally informative,” and to provide insight into why net benefit arrives to its conclusion.