Study designs for effectiveness and translation research :identifying trade-offs.

Guide to Community Preventive Services, National Center for Health Marketing, Centers for Disease Control and Prevention, Atlanta, Georgia 30333, USA.
American Journal of Preventive Medicine (Impact Factor: 4.28). 09/2007; 33(2):139-154. DOI: 10.1016/j.amepre.2007.04.005
Source: PubMed

ABSTRACT Practitioners and policymakers need credible evidence of effectiveness to justify allocating resources to complex, expensive health programs. Investigators, however, face challenges in designing sound effectiveness and translation research with relevance for "real-world" settings.
Research experts and federal and foundation funders (n= approximately 120) prepared for and participated in a symposium, held May 4-5, 2004, to weigh the strengths, limitations, and trade-offs between alternate designs for studying the effectiveness and translation of complex, multilevel health interventions.
Symposium attendees acknowledged that research phases (hypothesis generating, efficacy, effectiveness, translation) are iterative and cyclical, not linear, since research in advanced phases may reveal unanswered questions in earlier phases. Research questions thus always need to drive the choice of study design. When randomization and experimental control are feasible, participants noted that the randomized controlled trial with individual random assignment remains the gold standard for safeguarding internal validity. Attendees highlighted trade-offs of randomized controlled trial variants, quasi-experimental designs, and natural experiments for use when randomization or experimental control or both are impossible or inadequately address external validity. Participants discussed enhancements to all designs to increase confidence in causal inference while accommodating greater external validity. Since no single study can establish causality, participants encouraged replication of studies and triangulation using different study designs. Participants also recommended participatory research approaches for building population relevance, acceptability, and usefulness.
Consideration of the study design choices, trade-offs, and enhancements discussed here can guide the design, funding, completion, and publication of appropriate policy- and practice-oriented effectiveness and translational research for complex, multilevel health interventions.

1 Follower
  • [Show abstract] [Hide abstract]
    ABSTRACT: Lifestyle factors are important in the development of chronic diseases, such as heart disease, respiratory disease, and diabetes, and chronic disease risk can be reduced by changes in lifestyle behaviors linked to these conditions. The use of mass media and community-wide strategies targeting these behaviors has been extensively evaluated since the 1970s. This review summarizes some examples of interventions and their use of media conducted within the old communications landscape of the 1970s and 1980s and the key lessons learned from their design, implementation, and evaluation. We then consider the potential and evidence base for using contemporary technology applications and platforms-within the new communications landscape-to improve the prevention and management of lifestyle-related chronic diseases in the future. We discuss the implications and adaptation of lessons derived from the ways in which new technologies are being used in commercial and political contexts and their relevance for public health. Finally, we consider some recent examples of applying new technologies to public health issues and consider some of the challenges in this rapidly developing field. Expected final online publication date for the Annual Review of Public Health Volume 36 is March 18, 2015. Please see for revised estimates.
    Annual Review of Public Health 01/2015; 36(1). DOI:10.1146/annurev-publhealth-031914-122848 · 6.63 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: An essential strategy expected to reduce the global burden of chronic and cardiovascular disease is evidence-based policy. However, it is often unknown what specific components should constitute an evidence-based policy intervention. We have developed an expedient method to appraise and compare the strengths of the evidence bases suggesting that individual components of a policy intervention will contribute to the positive public health impact of that intervention. Using a new definition of "best available evidence," the Quality and Impact of Component (QuIC) Evidence Assessment analyzes dimensions of evidence quality and evidence of public health impact to categorize multiple policy component evidence bases along a continuum of "emerging," "promising impact," "promising quality," and "best." QuIC was recently applied to components from 2 policy interventions to prevent and improve the outcomes of cardiovascular disease: public-access defibrillation and community health workers. Results illustrate QuIC's utility in international policy practice and research. Copyright © 2015 World Heart Federation (Geneva). All rights reserved.
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Article Autism spectrum disorder (ASD) is a lifelong disability that influences an individual's social, communication, and behav-ioral interactions and can cause difficulties in educational development and skill acquisition (American Psychiatric Association, 2013). Although ASD can be identified as early as 2 years of age (Corsello, Akshoomoff, & Stahmer, 2013), it is often only identified once children enter the education system (Aspect, 2013b). The reported prevalence of ASD within the community continues to rise. In England, researchers estimate that there are approximately 1 in 100 people in the population who are diagnosed with ASD (Brugha et al., 2011). In 2014, however, the U.S. Centers for Disease Control and Prevention indi-cated a much higher community incidence when they reported an estimated prevalence of 1 in 68 8-year-old chil-dren are diagnosed with ASD—a 123% increase in the prev-alence of ASD since 2002 (Autism and Developmental Disabilities Monitoring Network, 2014). In Australia, data provided by the Australian Bureau of Statistics show that in 2012, there were 115,000 Australians living with ASD (Australian Bureau of Statistics, 2014), and that almost 81,200 were school-aged children (5-19 years). Of these children, 95% are reported to need specialized edu-cation to support their communication, social, or learning dif-ficulties (Australian Bureau of Statistics, 2014). Recent research has also suggested that the majority of these students are enrolled in mainstream schools and are not participating in specialized intervention programs (Aspect, 2013b). A diagnosis of ASD can provide an opportunity for par-ents and therapists to implement evidence-based early inter-vention programs such as speech pathology (Burgess & Turkstra, 2010; van der Meer & Rispoli, 2010), occupational therapy (Ashburner, Ziviani, & Rodger, 2010), psychologi-cal interventions (van der Meer & Weijers, 2013), and behav-ior modification programs (Stock, Mirends, & Smith, 2013), and much of this research is concentrated on programs and support mechanisms appropriate for pre-school-aged chil-dren (Eapen, Črnčec, & Walter, 2013; Warren et al., 2011). There is, however, limited peer-reviewed research available for evaluating school-based interventions (Detrich & Lewis, 2013; Dingfelder, 2011; Kasari & Smith, 2013; Parsons et al., 2013), and this has left the ASD school education com-munity with a shortage of rigorously assessed programs to implement in the classroom (Parsons et al., 2013). A growing interest in the gap between research and ASD classroom practice has become a key topic of discussion.


Available from
Jul 25, 2014