Reliable Effectiveness: A Theory on Sustaining and Replicating Worthwhile Innovations

1101 Parkside Avenue, Ewing, NJ 08618, USA.
Administration and Policy in Mental Health and Mental Health Services Research (Impact Factor: 3.44). 06/2006; 33(3):356-87. DOI: 10.1007/s10488-006-0047-1
Source: PubMed


While many health and human service innovations are sustained and replicated, it has been a puzzle how to sustain and replicate the performance of the better ones. What knowledge, skills, and conditions are required to reproduce across space and time the effectiveness of those innovations that are the most worthwhile? An extensive body of literature and experience is reviewed to suggest a comprehensive conceptual framework of programmatic, organizational, and environmental factors that may shape the circumstances for sustaining and replicating effectiveness.

3 Reads
  • Source
    • "Many factors make it difficult to study sustainability and draw conclusions in the current literature. A fundamental challenge is the tension that exists between the continuation of interventions as originally designed and the need to adapt them for use in contexts that may differ in important ways from those in which they were originally developed and tested [5,16,17]. A number of conceptualizations of sustainability have been proposed that reflect differing priorities and perspectives on this issue [18]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: The introduction of evidence-based programs and practices into healthcare settings has been the subject of an increasing amount of research in recent years. While a number of studies have examined initial implementation efforts, less research has been conducted to determine what happens beyond that point. There is increasing recognition that the extent to which new programs are sustained is influenced by many different factors and that more needs to be known about just what these factors are and how they interact. To understand the current state of the research literature on sustainability, our team took stock of what is currently known in this area and identified areas in which further research would be particularly helpful. This paper reviews the methods that have been used, the types of outcomes that have been measured and reported, findings from studies that reported long-term implementation outcomes, and factors that have been identified as potential influences on the sustained use of new practices, programs, or interventions. We conclude with recommendations and considerations for future research. Two coders identified 125 studies on sustainability that met eligibility criteria. An initial coding scheme was developed based on constructs identified in previous literature on implementation. Additional codes were generated deductively. Related constructs among factors were identified by consensus and collapsed under the general categories. Studies that described the extent to which programs or innovations were sustained were also categorized and summarized. Although "sustainability" was the term most commonly used in the literature to refer to what happened after initial implementation, not all the studies that were reviewed actually presented working definitions of the term. Most study designs were retrospective and naturalistic. Approximately half of the studies relied on self-reports to assess sustainability or elements that influence sustainability. Approximately half employed quantitative methodologies, and the remainder employed qualitative or mixed methodologies. Few studies that investigated sustainability outcomes employed rigorous methods of evaluation (e.g., objective evaluation, judgement of implementation quality or fidelity). Among those that did, a small number reported full sustainment or high fidelity. Very little research has examined the extent, nature, or impact of adaptations to the interventions or programs once implemented. Influences on sustainability included organizational context, capacity, processes, and factors related to the new program or practice themselves. Clearer definitions and research that is guided by the conceptual literature on sustainability are critical to the development of the research in the area. Further efforts to characterize the phenomenon and the factors that influence it will enhance the quality of future research. Careful consideration must also be given to interactions among influences at multiple levels, as well as issues such as fidelity, modification, and changes in implementation over time. While prospective and experimental designs are needed, there is also an important role for qualitative research in efforts to understand the phenomenon, refine hypotheses, and develop strategies to promote sustainment.
    Implementation Science 03/2012; 7(1):17. DOI:10.1186/1748-5908-7-17 · 4.12 Impact Factor
  • Source

  • Source

Show more