A realist evaluation of the role of communities of practice in changing healthcare practice.

Centre for Clinical Governance Research, Australian Institute of Health Innovation, University of New South Wales, Sydney, NSW 2052, Australia. .
Implementation Science (Impact Factor: 2.37). 01/2011; 6:49. DOI: 10.1186/1748-5908-6-49
Source: PubMed

ABSTRACT Healthcare organisations seeking to manage knowledge and improve organisational performance are increasingly investing in communities of practice (CoPs). Such investments are being made in the absence of empirical evidence demonstrating the impact of CoPs in improving the delivery of healthcare. A realist evaluation is proposed to address this knowledge gap. Underpinned by the principle that outcomes are determined by the context in which an intervention is implemented, a realist evaluation is well suited to understand the role of CoPs in improving healthcare practice. By applying a realist approach, this study will explore the following questions: What outcomes do CoPs achieve in healthcare? Do these outcomes translate into improved practice in healthcare? What are the contexts and mechanisms by which CoPs improve healthcare?
The realist evaluation will be conducted by developing, testing, and refining theories on how, why, and when CoPs improve healthcare practice. When collecting data, context will be defined as the setting in which the CoP operates; mechanisms will be the factors and resources that the community offers to influence a change in behaviour or action; and outcomes will be defined as a change in behaviour or work practice that occurs as a result of accessing resources provided by the CoP.
Realist evaluation is being used increasingly to study social interventions where context plays an important role in determining outcomes. This study further enhances the value of realist evaluations by incorporating a social network analysis component to quantify the structural context associated with CoPs. By identifying key mechanisms and contexts that optimise the effectiveness of CoPs, this study will contribute to creating a framework that will guide future establishment and evaluation of CoPs in healthcare.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Robotic surgery offers many potential benefits for patients. While an increasing number of healthcare providers are purchasing surgical robots, there are reports that the technology is failing to be introduced into routine practice. Additionally, in robotic surgery, the surgeon is physically separated from the patient and the rest of the team, with the potential to negatively impact teamwork in the operating theatre. The aim of this study is to ascertain: how and under what circumstances robotic surgery is effectively introduced into routine practice; and how and under what circumstances robotic surgery impacts teamwork, communication and decision making, and subsequent patient outcomes.Methods and design: We will undertake a process evaluation alongside a randomised controlled trial comparing laparoscopic and robotic surgery for the curative treatment of rectal cancer. Realist evaluation provides an overall framework for the study. The study will be in three phases. In Phase I, grey literature will be reviewed to identify stakeholders' theories concerning how robotic surgery becomes embedded into surgical practice and its impacts. These theories will be refined and added to through interviews conducted across English hospitals that are using robotic surgery for rectal cancer resection with staff at different levels of the organisation, along with a review of documentation associated with the introduction of robotic surgery. In Phase II, a multi-site case study will be conducted across four English hospitals to test and refine the candidate theories. Data will be collected using multiple methods: the structured observation tool OTAS (Observational Teamwork Assessment for Surgery); video recordings of operations; ethnographic observation; and interviews. In Phase III, interviews will be conducted at the four case sites with staff representing a range of surgical disciplines, to assess the extent to which the results of Phase II are generalisable and to refine the resulting theories to reflect the experience of a broader range of surgical disciplines. The study will provide (i) guidance to healthcare organisations on factors likely to facilitate successful implementation and integration of robotic surgery, and (ii) guidance on how to ensure effective communication and teamwork when undertaking robotic surgery.
    Implementation Science 05/2014; 9(1):52. · 2.37 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Evaluation is often used as a vehicle to improve program implementation. To evaluate the implementation of programs that provide care for frail older people a Community of Practice (CoP) was developed in the Netherlands. The purpose of this paper is to describe and reflect on the role of a CoP in the implementation of these programs. Using a responsive evaluation approach this study was based on interviews with participating stakeholders and transcripts of the CoP meetings with 13 professionals, project managers and patient representatives. Findings showed that CoP members had unanticipated concerns regarding the pro-active approach of the programs and older people not being open to receiving care. The heterogenic composition was appreciated and fostered learning. A social infrastructure was created for active learning inside and outside the CoP. We conclude that a CoP is a useful strategy as part of an evaluation aimed at improving program implementation. Lessons learned include the importance of creating ownership among CoP members by sharing responsibilities and paying attention to the heterogenic group composition and professional language spoken to involve all members.
    Evaluation and Program Planning 10/2014; · 0.90 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Background In knowledge translation, complex interventions may be implemented in the attempt to improve uptake of research-based knowledge in practice. Traditional evaluation efforts that focus on aggregate effectiveness represent an oversimplification of both the environment and the interventions themselves. However, theory-based approaches to evaluation, such as realist evaluation (RE), may be better-suited to examination of complex knowledge translation interventions with a view to understanding what works, for whom, and under what conditions. It is the aim of the present state-of-the-art review to examine current literature with regard to the use of RE in the assessment of knowledge translation interventions implemented within healthcare environments.Methods Multiple online databases were searched from 1997 through June 2013. Primary studies examining the application or implementation of knowledge translation interventions within healthcare settings and using RE were selected for inclusion. Varying applications of RE across studies were examined in terms of a) reporting of core elements of RE, and b) potential feasibility of this evaluation method.ResultsA total of 14 studies (6 study protocols), published between 2007 and 2013, were identified for inclusion. Projects were initiated in a variety of healthcare settings and represented a range of interventions. While a majority of authors mentioned context (C), mechanism (M) and outcome (O), a minority reported the development of C-M-O configurations or testable hypotheses based on these configurations. Four completed studies reported results that included refinement of proposed C-M-O configurations and offered explanations within the RE framework. In the few studies offering insight regarding challenges associated with the use of RE, difficulties were expressed regarding the definition of both mechanisms and contextual factors. Overall, RE was perceived as time-consuming and resource intensive.Conclusions The use of RE in knowledge translation is relatively new; however, theory-building approaches to the examination of complex interventions in this area may be increasing as researchers attempt to identify what works, for whom and under what circumstances. Completion of the RE cycle may be challenging, particularly in the development of C-M-O configurations; however, as researchers approach challenges and explore innovations in its application, rich and detailed accounts may improve feasibility.
    Implementation Science 09/2014; 9(1):115. · 2.37 Impact Factor

Full-text (2 Sources)

Available from
Jun 4, 2014