Study designs for effectiveness and translation research :identifying trade-offs.

Guide to Community Preventive Services, National Center for Health Marketing, Centers for Disease Control and Prevention, Atlanta, Georgia 30333, USA.
American Journal of Preventive Medicine (Impact Factor: 4.28). 09/2007; 33(2):139-154. DOI: 10.1016/j.amepre.2007.04.005
Source: PubMed

ABSTRACT Practitioners and policymakers need credible evidence of effectiveness to justify allocating resources to complex, expensive health programs. Investigators, however, face challenges in designing sound effectiveness and translation research with relevance for "real-world" settings.
Research experts and federal and foundation funders (n= approximately 120) prepared for and participated in a symposium, held May 4-5, 2004, to weigh the strengths, limitations, and trade-offs between alternate designs for studying the effectiveness and translation of complex, multilevel health interventions.
Symposium attendees acknowledged that research phases (hypothesis generating, efficacy, effectiveness, translation) are iterative and cyclical, not linear, since research in advanced phases may reveal unanswered questions in earlier phases. Research questions thus always need to drive the choice of study design. When randomization and experimental control are feasible, participants noted that the randomized controlled trial with individual random assignment remains the gold standard for safeguarding internal validity. Attendees highlighted trade-offs of randomized controlled trial variants, quasi-experimental designs, and natural experiments for use when randomization or experimental control or both are impossible or inadequately address external validity. Participants discussed enhancements to all designs to increase confidence in causal inference while accommodating greater external validity. Since no single study can establish causality, participants encouraged replication of studies and triangulation using different study designs. Participants also recommended participatory research approaches for building population relevance, acceptability, and usefulness.
Consideration of the study design choices, trade-offs, and enhancements discussed here can guide the design, funding, completion, and publication of appropriate policy- and practice-oriented effectiveness and translational research for complex, multilevel health interventions.

Download full-text


Available from: Lawrence W Green, Jul 25, 2014
1 Follower
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Objective. To assess the efficacy and acceptability of a group medical nutritional therapy (MNT) intervention, using motivational interviewing (MI). Research Design & Method. African American (AA) women with type 2 diabetes (T2D) participated in five, certified diabetes educator/dietitian-facilitated intervention sessions targeting carbohydrate, fat, and fruit/vegetable intake and management. Motivation-based activities centered on exploration of dietary ambivalence and the relationships between diet and personal strengths. Repeated pre- and post-intervention, psychosocial, dietary self-care, and clinical outcomes were collected and analyzed using generalized least squares regression. An acceptability assessment was administered after intervention. Results. Participants (n = 24) were mostly of middle age (mean age 50.8 ± 6.3) with an average BMI of 39 ± 6.5. Compared to a gradual pre-intervention loss of HbA1c control and confidence in choosing restaurant foods, a significant post-intervention improvement in HbA1c (P = 0.03) and a near significant (P = 0.06) increase in confidence in choosing restaurant foods were observed with both returning to pre-intervention levels. 100% reported that they would recommend the study to other AA women with type 2 diabetes. Conclusion. The results support the potential efficacy of a group MNT/MI intervention in improving glycemic control and dietary self-care-related confidence in overweight/obese AA women with type 2 diabetes.
    Journal of obesity 08/2014; 2014:345941. DOI:10.1155/2014/345941
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: People with ID have an increased risk for unhealthy diets, physical inactivity and weight disturbances. The aim of the current study was to investigate the effectiveness of a novel and complex intervention to improve diet and physical activity, targeting both caregivers and residents, in community residences for people with ID. A three component intervention based on Social Cognitive Theory was developed, including: (1) appointment of a health ambassador in each community residence attending network meetings, (2) a study circle for caregivers, and (3) a health course for the residents. The intervention lasted for 12-16 months and allowed for some local tailoring. A cluster randomised controlled trial, randomised at residence level, was conducted to evaluate the effects of the intervention. Thirty community residences for people with mild or moderate ID in Stockholm County, Sweden, were included. A total of 130 participants, 74 women and 56 men aged 20-66 years, entered, and 129 participants completed the study. The primary outcome was physical activity, measured by pedometry. Secondary outcomes were BMI, waist circumference, dietary quality measured by digital photography, satisfaction with life assessed with a scale, and work routines assessed with a questionnaire. Outcomes were related to intervention fidelity. A positive intervention effect was found on physical activity, with an average increase of 1608 steps/day among participants in the intervention group (P=0.045). The effect size was 0.29 (Cohen's d). The type of residence was found to be an effect moderator. A positive intervention effect was found as well on work routines, with an average increase of 7.1 percentage points on a self-assessment scale among residences in the intervention group (P=0.016). No significant effects were found on BMI, waist circumference, dietary quality, or satisfaction with life. In conclusion, this innovative intervention was effective in improving physical activity and work routines. It is likely that even greater effects could be achieved by improvements in implementation strategies, leading to higher fidelity.
    Research in developmental disabilities 09/2013; 34(11):3847-3857. DOI:10.1016/j.ridd.2013.07.019 · 4.41 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: This article summarizes a comprehensive, systems-oriented framework designed to improve the use of a wide variety of evidence sources to address population-wide obesity problems. The L.E.A.D. framework (for Locate the evidence, Evaluate the evidence, Assemble the evidence, and inform Decisions), developed by an expert consensus committee convened by the Institute of Medicine, is broadly applicable to complex, community-wide health problems. The article explains how to use the framework, presenting an evidence typology that helps specify relevant research questions and includes examples of how particular research methodologies and sources of evidence relate to questions that stem from decision-maker needs. The utility of a range of quantitative, qualitative, and mixed method designs and data sources for assembling a broad and credible evidence base is discussed, with a call for ongoing "evidence generation" to fill information gaps using the recommended systems perspective.
    Health Education &amp Behavior 06/2013; 41(1). DOI:10.1177/1090198113490726 · 1.54 Impact Factor