Open AccessAn approach for improving the quality of country-level TB modelling
Author(s) -
Christopher Finn McQuaid,
MC Clarkson,
Meghan Bellerose,
Katherine Floyd,
Richard G. White,
NA Menzies
Publication year - 2021
Publication title -
the international journal of tuberculosis and lung disease/the international journal of tuberculosis and lung disease. articles traduits en français ...
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.103
H-Index - 110
eISSN - 1815-7920
pISSN - 1027-3719
DOI - 10.5588/ijtld.21.0127
Subject(s) - scope (computer science) , benchmarking , transparency (behavior) , management science , constructive , process (computing) , process management , quality (philosophy) , risk analysis (engineering) , medicine , computer science , engineering , philosophy , computer security , epistemology , marketing , business , programming language , operating system
Mathematical modelling is increasingly used to inform budgeting and strategic decision-making by national TB programmes. Despite the importance of these decisions, there is currently no mechanism to review and confirm the appropriateness of modelling analyses. We have developed a benchmarking, reporting, and review (BRR) approach and accompanying tools to allow constructive review of country-level TB modelling applications. This approach has been piloted in five modelling applications and the results of this study have been used to revise and finalise the approach. The BRR approach consists of 1) quantitative benchmarks against which model assumptions and results can be compared, 2) standardised reporting templates and review criteria, and 3) a multi-stage review process providing feedback to modellers during the application, as well as a summary evaluation after completion. During the pilot, use of the tools prompted important changes in the approaches taken to modelling. The pilot also identified issues beyond the scope of a review mechanism, such as a lack of empirical evidence and capacity constraints. This approach provides independent evaluation of the appropriateness of modelling decisions during the course of an application, allowing meaningful changes to be made before results are used to inform decision-making. The use of these tools can improve the quality and transparency of country-level TB modelling applications.