Effectiveness and efficiency of guideline dissemination and implementation strategies.

Health Services Research Unit, University of Aberdeen, UK.
Health technology assessment (Winchester, England) (Impact Factor: 5.12). 03/2004; 8(6):iii-iv, 1-72.
Source: PubMed

ABSTRACT To undertake a systematic review of the effectiveness and costs of different guideline development, dissemination and implementation strategies. To estimate the resource implications of these strategies. To develop a framework for deciding when it is efficient to develop and introduce clinical guidelines.
MEDLINE, Healthstar, Cochrane Controlled Trial Register, EMBASE, SIGLE and the specialised register of the Cochrane Effective Practice and Organisation of Care (EPOC) group.
Single estimates of dichotomous process variables were derived for each study comparison based upon the primary end-point or the median measure across several reported end-points. Separate analyses were undertaken for comparisons of different types of intervention. The study also explored whether the effects of multifaceted interventions increased with the number of intervention components. Studies reporting economic data were also critically appraised. A survey to estimate the feasibility and likely resource requirements of guideline dissemination and implementation strategies in UK settings was carried out with key informants from primary and secondary care.
In total, 235 studies reporting 309 comparisons met the inclusion criteria; of these 73% of comparisons evaluated multifaceted interventions, although the maximum number of replications of a specific multifaceted intervention was 11 comparisons. Overall, the majority of comparisons reporting dichotomous process data observed improvements in care; however, there was considerable variation in the observed effects both within and across interventions. Commonly evaluated single interventions were reminders, dissemination of educational materials, and audit and feedback. There were 23 comparisons of multifaceted interventions involving educational outreach. The majority of interventions observed modest to moderate improvements in care. No relationship was found between the number of component interventions and the effects of multifaceted interventions. Only 29.4% of comparisons reported any economic data. The majority of studies only reported costs of treatment; only 25 studies reported data on the costs of guideline development or guideline dissemination and implementation. The majority of studies used process measures for their primary end-point, despite the fact that only three guidelines were explicitly evidence based (and may not have been efficient). Respondents to the key informant survey rarely identified existing budgets to support guideline dissemination and implementation strategies. In general, the respondents thought that only dissemination of educational materials and short (lunchtime) educational meetings were generally feasible within current resources.
There is an imperfect evidence base to support decisions about which guideline dissemination and implementation strategies are likely to be efficient under different circumstances. Decision makers need to use considerable judgement about how best to use the limited resources they have for clinical governance and related activities to maximise population benefits. They need to consider the potential clinical areas for clinical effectiveness activities, the likely benefits and costs required to introduce guidelines and the likely benefits and costs as a result of any changes in provider behaviour. Further research is required to: develop and validate a coherent theoretical framework of health professional and organisational behaviour and behaviour change to inform better the choice of interventions in research and service settings, and to estimate the efficiency of dissemination and implementation strategies in the presence of different barriers and effect modifiers.

  • Source
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Background Cardiovascular disease (CVD) is the leading cause of death and disability worldwide. Despite the widespread availability of evidence-based clinical guidelines and validated risk predication equations for prevention and management of CVD, their translation into routine practice is limited. We developed a multifaceted quality improvement intervention for CVD risk management which incorporates electronic decision support, patient risk communication tools, computerised audit and feedback tools, and monthly, peer-ranked performance feedback via a web portal. The intervention was implemented in a cluster randomised controlled trial in 60 primary healthcare services in Australia. Overall, there were improvements in risk factor recording and in prescribing of recommended treatments among under-treated individuals, but it is unclear how this intervention was used in practice and what factors promoted or hindered its use. This information is necessary to optimise intervention impact and maximally implement it in a post-trial context. In this study protocol, we outline our methods to conduct a theory-based, process evaluation of the intervention. Our aims are to understand how, why, and for whom the intervention produced the observed outcomes and to develop effective strategies for translation and dissemination.Methods/designWe will conduct four discrete but inter-related studies taking a mixed methods approach. Our quantitative studies will examine (1) the longer term effectiveness of the intervention post-trial, (2) patient and health service level correlates with trial outcomes, and (3) the health economic impact of implementing the intervention at scale. The qualitative studies will (1) identify healthcare provider perspectives on implementation barriers and enablers and (2) use video ethnography and patient semi-structured interviews to understand how cardiovascular risk is communicated in the doctor/patient interaction both with and without the use of intervention. We will also assess the costs of implementing the intervention in Australian primary healthcare settings which will inform scale-up considerations.DiscussionThis mixed methods evaluation will provide a detailed understanding of the process of implementing a quality improvement intervention and identify the factors that might influence scalability and sustainability.Trials registration 12611000478910.
    Implementation Science 12/2014; 9(1):187. · 3.47 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Preventable adverse drug events (ADEs) are closely related to administration processes of parenteral medication. The Dutch Patient Safety Program provided a protocol for administering parenteral medication to reduce the amount of ADEs. The execution of the protocol was evaluated and a cost estimation was performed to provide insight in the associated costs of protocol compliance. A longitudinal evaluation study was performed in secondary care. A total of 2154 observations of the administration process of parenteral medication were carried out within 10 measurements in 19 hospitals between November 2011 and December 2012. The total time needed for the process was measured in a sample of five hospitals. Multilevel linear and logistic regression analyses were used to analyse the trend over time of the implementation and to assess the association between hospital and administration characteristics, and compliance of the protocol. A cost estimation provided insight into the costs of performing a complete administration process and the costs at department level for 1 year. The complete protocol was performed in 19% of the observations. The proceeding 'check by a second nurse' was least performed. Large differences were found between individual hospitals in performing the administration protocol. The compliance of the protocol was negatively influenced in case of disturbance of the administrator. The overall trend over time of completion of the protocol fluctuated during the study period. On average, 3 min 26 s were needed to perform the complete protocol, which costs €2.42. Extrapolating the costs to department level, including cost for clinical lessons, the difference in costs in performing the complete protocol and an incomplete protocol was €7.891 for 1 year. The protocol for administering parenteral medication is still not implemented completely, therefore an investment in time and Euros is needed. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to
    BMJ Open 12/2014; 4(12):e005232. · 2.06 Impact Factor

Full-text (2 Sources)

Available from
Jun 2, 2014