Challenges in replicating interventions

University of Washington Seattle, Seattle, Washington, United States
Journal of Adolescent Health (Impact Factor: 2.75). 07/2007; 40(6):514-20. DOI: 10.1016/j.jadohealth.2006.09.005
Source: PubMed

ABSTRACT To describe and reflect on an effort to document, through a set of 6 interventions, the process of adapting effective youth risk behavior interventions for new settings, and to provide insights into how this might best be accomplished.
Six studies were funded by the NIH, starting in 1999. The studies were funded in response to a Request for Applications (RFA) to replicate HIV prevention interventions for youth. Researchers were to select an HIV risk reduction intervention program shown to be effective in one adolescent population and to replicate it in a new community or different adolescent population. This was to be done while systematically documenting those processes and aspects of the intervention hypothesized to be critical to the development of community-based, culturally sensitive programs. The replication was to assess the variations necessary to gain cooperation, implement a locally feasible and meaningful intervention, and evaluate the outcomes in the new setting. The rationale for this initiative and description of the goals and approaches to adaptation of the funded researchers are described.
Issues relevant to all interventions are discussed, in addition to those unique to replication. The processes and the consequences of the adaptations are then discussed. The further challenges in taking a successful intervention "to scale" are not discussed.
Replications of effective interventions face all of the challenges of implementation design, plus additional challenges of balancing fidelity to the original intervention and sensitivity to the needs of new populations.

Download full-text


Available from: Elaine Borawski, Jul 04, 2015
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: In response to the needs of military families confronting the challenges of prolonged war, we developed Families OverComing Under Stress (FOCUS), a multi-session intervention for families facing multiple deployments and combat stress injuries adapted from existing evidence-based family prevention interventions (Lester et al. in Mil Med 176(1): 19-25, 2011). In an implementation of this intervention contracted by the US Navy Bureau of Medicine and Surgery (BUMED), FOCUS teams were deployed to military bases in the United States and the Pacific Rim to deliver a suite of family-centered preventive services based on the FOCUS model (Beardslee et al. in Prev Sci 12(4): 339-348, 2011). Given the number of families affected by wartime service and the changing circumstances they faced in active duty and veteran settings, it rapidly became evident that adaptations of this approach for families in other contexts were needed. We identified the core elements of FOCUS that are essential across all adaptations: (1) Family Psychological Health Check-in; (2) family-specific psychoeducation; (3) family narrative timeline; and (4) family-level resilience skills (e.g., problem solving). In this report, we describe the iterative process of adapting the intervention for different groups of families: wounded, ill, and injured warriors, families with young children, couples, and parents. We also describe the process of adopting this intervention for use in different ecological contexts to serve National Guard, Reserve and veterans, and utilization of technology-enhanced platforms to reach geographically dispersed families. We highlight the lessons learned when faced with the need to rapidly deploy interventions, adapt them to the changing, growing needs of families under real-world circumstances, and conduct rigorous evaluation procedures when long-term, randomized trial designs are not feasible to meet an emergent public health need.
    Clinical Child and Family Psychology Review 10/2013; 16(4). DOI:10.1007/s10567-013-0154-y · 4.75 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: A set of mediation analyses were carried out in this study using data from It's Your Game. . .Keep It Real (IYG), a successful HIV/STI/pregnancy prevention program. The IYG study evaluated a skill and normbased. HIV/STI/pregnancy prevention program that was implemented from 2004 to 2007 among 907 urban low-income middle school youth in Houston, TX, USA. Analyses were carried out to investigate the degree to which a set of proposed psychosocial measures of behavioral knowledge, perceived self-efficacy, behavioral, and normative beliefs, and perceived risky situations, all targeted by the intervention, mediated the intervention's effectiveness in reducing initiation of sex. The mediation process was assessed by examining the significance and size of the estimated effects from the mediating pathways. The findings from this study provide evidence that the majority of the psychosocial mediators targeted by the IYG intervention are indeed related to the desired behavior and provide evidence that the conceptual theory underlying the targeted psychosocial mediators in the intervention is appropriate. Two of the psychosocial mediators significantly mediated the intervention effect, knowledge of STI signs and symptoms and refusal self-efficacy. This study suggests that the underlying causal mechanisms of action of these interventions are complex and warrant further analyses.
    AIDS research and treatment 06/2012; 2012:298494. DOI:10.1155/2012/298494
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Objective: To reduce health disparities, behavioral health interventions must reach subcultural groups and demonstrate effectiveness in improving their health behaviors and outcomes. One approach to developing such health interventions is to culturally adapt original evidence-based interventions. The goals of the article are to (a) describe consensus on the stages involved in developing cultural adaptations, (b) identify common elements in cultural adaptations, (c) examine evidence on the effectiveness of culturally enhanced interventions for various health conditions, and (d) pose questions for future research. Method: Influential literature from the past decade was examined to identify points of consensus. Results: There is agreement that cultural adaptation can be organized into 5 stages: information gathering, preliminary design, preliminary testing, refinement, and final trial. With few exceptions, reviews of several health conditions (e.g., AIDS, asthma, diabetes) concluded that culturally enhanced interventions are more effective in improving health outcomes than usual care or other control conditions. Conclusions: Progress has been made in establishing methods for conducting cultural adaptations and providing evidence of their effectiveness. Future research should include evaluations of cultural adaptations developed in stages, tests to determine the effectiveness of cultural adaptations relative to the original versions, and studies that advance our understanding of cultural constructs' contributions to intervention engagement and efficacy. (PsycINFO Database Record (c) 2012 APA, all rights reserved).
    Journal of Consulting and Clinical Psychology 01/2012; 81(2). DOI:10.1037/a0027085 · 4.85 Impact Factor