Premium
Examination of risk scores to better predict hospital‐related harms
Author(s) -
Than Stephanie,
Crabtree Amelia,
Moran Chris
Publication year - 2019
Publication title -
internal medicine journal
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.596
H-Index - 70
eISSN - 1445-5994
pISSN - 1444-0903
DOI - 10.1111/imj.14121
Subject(s) - medicine , receiver operating characteristic , risk assessment , harm , predictive validity , incidence (geometry) , predictive modelling , predictive value of tests , emergency medicine , physical therapy , statistics , clinical psychology , physics , computer security , mathematics , optics , computer science , political science , law
Background Many hospitals use predictive scores to identify a person's risk of inpatient falls, pressure injury and malnutrition despite evidence of limited predictive accuracy. Aim To examine whether we could improve predictive accuracy by generating a score combining all components of currently used tools. Methods We performed a retrospective, cross‐validation study in a single sub‐acute (geriatrics and rehabilitation) hospital, extracting data regarding hospital risk scores, and incidence of falls, pressure injury and malnutrition from January 2014 to June 2016. The sample was randomly halved into training and testing data sets. For each harm outcome, model fit was examined using area under receiver operating characteristic curves (AUC) and proportions of people reclassified based on a combined score were calculated. Secondary analyses explored the predictive performance of individual question‐responses. Results Data were available for 4487 admissions (median age 83.0 years). A total of 667 (15%) people had at least one fall, 499 (11%) had at least one pressure injury and 20 (0.4%) malnutrition. The currently used tools had, at best, moderate ability to predict risk of harm outcomes (AUC 0.56–0.73). Testing of the combined score models resulted in minimal change in AUC (<5.1%) and did not add value to risk category reclassification. Most of the predictive ability of the currently used tools relied on the performance of two individual question‐responses. Conclusion Combining scores or reducing to two‐item question‐responses did little to change predictive accuracy. This study highlights the limitations of hospital harm predictive scores and emphasises the importance of rigorous testing of predictive scores.