Protocol - realist and meta-narrative evidence synthesis: Evolving Standards (RAMESES)

Healthcare Innovation and Policy Unit, Centre for Primary Care and Public Health, Blizard Institute, Barts and The London School of Medicine and Dentistry, London E1 2AB, UK.
BMC Medical Research Methodology (Impact Factor: 2.17). 08/2011; 11:115. DOI: 10.1186/1471-2288-11-115
Source: PubMed

ABSTRACT There is growing interest in theory-driven, qualitative and mixed-method approaches to systematic review as an alternative to (or to extend and supplement) conventional Cochrane-style reviews. These approaches offer the potential to expand the knowledge base in policy-relevant areas - for example by explaining the success, failure or mixed fortunes of complex interventions. However, the quality of such reviews can be difficult to assess. This study aims to produce methodological guidance, publication standards and training resources for those seeking to use the realist and/or meta-narrative approach to systematic review.
We will: [a] collate and summarise existing literature on the principles of good practice in realist and meta-narrative systematic review; [b] consider the extent to which these principles have been followed by published and in-progress reviews, thereby identifying how rigour may be lost and how existing methods could be improved; [c] using an online Delphi method with an interdisciplinary panel of experts from academia and policy, produce a draft set of methodological steps and publication standards; [d] produce training materials with learning outcomes linked to these steps; [e] pilot these standards and training materials prospectively on real reviews-in-progress, capturing methodological and other challenges as they arise; [f] synthesise expert input, evidence review and real-time problem analysis into more definitive guidance and standards; [g] disseminate outputs to audiences in academia and policy. The outputs of the study will be threefold:1. Quality standards and methodological guidance for realist and meta-narrative reviews for use by researchers, research sponsors, students and supervisors2. A 'RAMESES' (Realist and Meta-review Evidence Synthesis: Evolving Standards) statement (comparable to CONSORT or PRISMA) of publication standards for such reviews, published in an open-access academic journal.3. A training module for researchers, including learning outcomes, outline course materials and assessment criteria.
Realist and meta-narrative review are relatively new approaches to systematic review whose overall place in the secondary research toolkit is not yet fully established. As with all secondary research methods, guidance on quality assurance and uniform reporting is an important step towards improving quality and consistency of studies.

1 Follower
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Tobacco control researchers have recently become more interested in systems science methods and mathematical modelling techniques as a means to understand how complex inter-relationships among various factors translate into population-level summaries of tobacco use prevalence and its associated medical and social costs. However, there is currently no resource that provides an overview of how mathematical modelling has been used in tobacco control research. This review will provide a summary of studies that employ modelling techniques to predict tobacco-related outcomes. It will also propose a conceptual framework for grouping existing modelling studies by their objectives. We will conduct a systematic review that is informed by Cochrane procedures, as well as guidelines developed for reviews that are specifically intended to inform policy and programme decision-making. We will search 5 electronic databases to identify studies that use a mathematical model to project a tobacco-related outcome. An online data extraction form will be developed based on the ISPOR-SMDM Modeling Good Research Practices. We will perform a qualitative synthesis of included studies. Ethical approval is not required for this study. An initial paper, published in a peer-reviewed journal, will provide an overview of our findings. Subsequent papers will provide greater detail on results within each study objective category and an assessment of the risk of bias of these grouped studies. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to
    BMJ Open 04/2015; 5(4):e007269. DOI:10.1136/bmjopen-2014-007269 · 2.06 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Building integrated services in a primary care setting is considered an essential important strategy for establishing a high-quality and affordable health care system. The theoretical foundations of such integrated service models are described by the Rainbow Model of Integrated Care, which distinguishes six integration dimensions (clinical, professional, organisational, system, functional and normative integration). The aim of the present study is to refine the Rainbow Model of Integrated Care by developing a taxonomy that specifies the underlying key features of the six dimensions. First, a literature review was conducted to identify features for achieving integrated service delivery. Second, a thematic analysis method was used to develop a taxonomy of key features organised into the dimensions of the Rainbow Model of Integrated Care. Finally, the appropriateness of the key features was tested in a Delphi study among Dutch experts. The taxonomy consists of 59 key features distributed across the six integration dimensions of the Rainbow Model of Integrated Care. Key features associated with the clinical, professional, organisational and normative dimensions were considered appropriate by the experts. Key features linked to the functional and system dimensions were considered less appropriate. This study contributes to the ongoing debate of defining the concept and typology of integrated care. This taxonomy provides a development agenda for establishing an accepted scientific framework of integrated care from an end-user, professional, managerial and policy perspective.
    International journal of integrated care 03/2015; 15. · 1.26 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Systematic review methods are developing rapidly, and most researchers would recognise their key methodological aspects, such as a closely focussed question, a comprehensive search, and a focus on synthesising 'stronger' rather than 'weaker' evidence. However, it may be helpful to question some of these underlying principles, because while they work well for simpler review questions, they may result in overly narrow approaches to more complex questions and interventions. This commentary discusses some core principles of systematic reviews, and how they may require further rethinking, particularly as reviewers turn their attention to increasingly complex issues, where a Bayesian perspective on evidence synthesis, which would aim to assemble evidence - of different types, if necessary - in order to inform decisions', may be more productive than the 'traditional' systematic review model. Among areas identified for future research are the examination of publication bias in qualitative research; research on the efficiency and potential biases of comprehensive searches in different disciplines; and the use of Bayesian methods in evidence synthesis. The incorporation of a systems perspective into systematic reviews is also an area which needs rapid development.
    01/2015; 4(1):36. DOI:10.1186/s13643-015-0027-1