Premium
Sensitivity and identification quantification by a relative latent model complexity perturbation in Bayesian meta‐analysis
Author(s) -
Roos Małgorzata,
Hunanyan Sona,
Bakka Haakon,
Rue Håvard
Publication year - 2021
Publication title -
biometrical journal
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.108
H-Index - 63
eISSN - 1521-4036
pISSN - 0323-3847
DOI - 10.1002/bimj.202000193
Subject(s) - prior probability , bayesian probability , standard deviation , statistics , bayesian hierarchical modeling , bayesian average , mathematics , bayesian inference , econometrics , sensitivity (control systems) , identification (biology) , computer science , electronic engineering , engineering , botany , biology
Abstract In recent years, Bayesian meta‐analysis expressed by a normal–normal hierarchical model (NNHM) has been widely used for combining evidence from multiple studies. Data provided for the NNHM are frequently based on a small number of studies and on uncertain within‐study standard deviation values. Despite the widespread use of Bayesian NNHM, it has always been unclear to what extent the posterior inference is impacted by the heterogeneity prior (sensitivity S ) and by the uncertainty in the within‐study standard deviation values (identification I ). Thus, to answer this question, we developed a unified method to simultaneously quantify both sensitivity and identification ( S ‐ I ) for all model parameters in a Bayesian NNHM, based on derivatives of the Bhattacharyya coefficient with respect to relative latent model complexity (RLMC) perturbations. Three case studies exemplify the applicability of the method proposed: historical data for a conventional therapy, data from which one large study is first included and then excluded, and two subgroup meta‐analyses specified by their randomization status. We analyzed six scenarios, crossing three RLMC targets with two heterogeneity priors (half‐normal, half‐Cauchy). The results show that S ‐ I explicitly reveals which parameters are affected by the heterogeneity prior and by the uncertainty in the within‐study standard deviation values. In addition, we compare the impact of both heterogeneity priors and quantify how S ‐ I values are affected by omitting one large study and by the randomization status. Finally, the range of applicability of S ‐ I is extended to Bayesian NtHM. A dedicated R package facilitates automatic S ‐ I quantification in applied Bayesian meta‐analyses.