Evaluating the implementation and sustainability of an evidence-based intervention: delivering Triple P within Indigenous child welfare agencies

In both Indigenous and non-Indigenous populations, research clearly links evidence-based parenting programs to decreases in child behavior problems, dysfunctional parenting, and child abuse and maltreatment. However, Indigenous families often do not have adequate opportunities to access these programs. This is due to a number of compounding program, service organization, process and interaction factors that are reviewed and evaluated in this thesis. Chapter 1 provides a rationale and overview for evaluating factors that impact initial and long-term use of evidence-based programs (EBPs). It presents the case for developing and evaluating a framework of supports for sustainment of EBPs developed specifically for providers working in disadvantage communities. The research plan presented involves: a systematic review and conceptual framework of barriers and enablers to implementation and sustainment in real-world practice settings; development and validation of a scale measuring inhibitors and enablers to program sustainment; and evaluation of outcomes for implementation and sustainment for providers who are trained in the Triple P – Positive Parenting Program, as an example EBP, both internationally in varied service settings and specifically for Indigenous Australians working in the child protection sector. Chapter 2 presents a review of the literature (submitted for publication) pertaining to provider implementation and sustainment of EBPs with families and communities experiencing disadvantage. Important factors that facilitate success and create barriers to program sustainment are synthesized into key themes. These themes are drawn on to develop the Sustained Implementation Support Framework for EBPs. The need to develop a conceptual framework and a measure to guide and evaluate EBP implementation in community settings is established. Chapter 3 outlines the preliminary validation of a measure, the Sustained Implementation Support Scale, of enablers and inhibitors (program benefits, program burden, workplace support, workplace cohesion and leadership style) to EBP sustainment (submitted for publication). Exploratory and confirmatory factor analysis with a sample of 593 Triple P trained practitioners showed that the model had good fit to the data [χ (340) = 736.27, p < .001; CFI = .914; SRMR = .053; RMSEA = .062 90% (CI .056 .068)] and led to a 28-item scale with good reliability, and good convergent, discriminant and predictive validity. The combined set of predictors explained between 8.3% – 8.9% (Cox and Snell R) of the variance in sustained program implementation. This study demonstrated that practitioners sustaining implementation at least three years post training were more likely to have supervision/peer support, reported higher levels of program benefit, workplace support and positive leadership style, and lower program burden compared to practitioners who were non-sustainers. Workplace cohesion was not significantly related to