Review, Assess, Classify, and Evaluate (RACE): a framework for studying m-health apps and its application for opioid apps

Objective The proliferation of m-health interventions has led to a growing research area of app analysis. We derived RACE (Review, Assess, Classify, and Evaluate) framework through the integration of existing methodologies for the purpose of analyzing m-health apps, and applied it to study opioid apps. Materials and Methods The 3-step RACE framework integrates established methods and evidence-based criteria used in a successive manner to identify and analyze m-health apps: the Preferred Reporting Items for Systematic Reviews and Meta-Analyses, inter-rater reliability analysis, and Nickerson-Varshney-Muntermann taxonomy. Results Using RACE, 153 opioid apps were identified, assessed, and classified leading to dimensions of Target Audience, Key Function, Operation, Security & Privacy, and Impact, with Cohen’s kappa < 1.0 suggesting subjectivity in app narrative assessments. The most common functions were education (24%), prescription (16%), reminder-monitoring-support (13%), and treatment & recovery (37%). A majority are passive apps (56%). The target audience are patients (49%), healthcare professionals (39%), and others (12%). Security & Privacy is evident in 84% apps. Discussion Applying the 3-step RACE framework revealed patterns and gaps in opioid apps leading to systematization of knowledge. Lessons learned can be applied to the study of m-health apps for other health conditions. Conclusion With over 350 000 existing and emerging m-health apps, RACE shows promise as a robust and replicable framework for analyzing m-health apps for specific health conditions. Future research can utilize the RACE framework toward understanding the dimensions and characteristics of existing m-health apps to inform best practices for collaborative, connected and continued care.