Rating Quality of Evidence and Strength of Recommendations: GRADE: Grading quality of evidence and strength of recommendations for diagnostic tests and strategies

Department of Epidemiology, Italian National Cancer Institute Regina Elena, 00144 Rome, Italy.
BMJ (online) (Impact Factor: 16.38). 06/2008; 336(7653):1106-10. DOI: 10.1136/bmj.39500.677199.AE
Source: PubMed

ABSTRACT The GRADE system can be used to grade the quality of evidence and strength of recommendations for diagnostic tests or strategies. This article explains how patient-important outcomes are taken into account in this processSummary pointsAs for other interventions, the GRADE approach to grading the quality of evidence and strength of recommendations for diagnostic tests or strategies provides a comprehensive and transparent approach for developing recommendationsCross sectional or cohort studies can provide high quality evidence of test accuracyHowever, test accuracy is a surrogate for patient-important outcomes, so such studies often provide low quality evidence for recommendations about diagnostic tests, even when the studies do not have serious limitationsInferring from data on accuracy that a diagnostic test or strategy improves patient-important outcomes will require the availability of effective treatment, reduction of test related adverse effects or anxiety, or improvement of patients’ wellbeing from prognostic informationJudgments are thus needed to assess the directness of test results in relation to consequences of diagnostic recommendations that are important to patientsIn this fourth article of the five part series, we describe how guideline developers are using GRADE to rate the quality of evidence and move from evidence to a recommendation for diagnostic tests and strategies. Although recommendations on diagnostic testing share the fundamental logic of recommendations on treatment, they present unique challenges. We will describe why guideline panels should be cautious when they use evidence of the accuracy of tests (“test accuracy”) as the basis for recommendations and why evidence of test accuracy often provides low quality evidence for making recommendations.Testing makes a variety of contributions to patient careClinicians use tests that are usually referred to as “diagnostic”—including signs and symptoms, imaging, biochemistry, pathology, and psychological testing—for various purposes.1 These purposes include identifying physiological derangements, establishing prognosis, monitoring illness and response to treatment, and diagnosis. This article …

Download full-text


Available from: Paul Glasziou, Jul 29, 2015
1 Follower
  • Source
    • "In step four, a generalized evidence grading based on GRADE is provided to rate the quality of the bodies of evidence. In this step, approaches previously discussed and proposed by the GRADE Working Group [4] [5] or WHO [6] [7] are applied. The latter is used by the WHO Strategic Advisory Group of Experts (SAGE) for the development of vaccination recommendations and includes a modification of the GRADE methodology which allows uprating of evidence quality in the presence of " consistency across investigators, study designs and settings " [7]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: The Project on a Framework for Rating Evidence in Public Health (PRECEPT) is an international collaboration of public health institutes and universities which has been funded by the European Centre for Disease Prevention and Control (ECDC) since 2012. Main objective is to define a framework for evaluating and grading evidence in the field of public health, with particular focus on infectious disease prevention and control. As part of the peer review process, an international expert meeting was held on 13-14 June 2013 in Berlin. Participants were members of the PRECEPT team and selected experts from national public health institutes, World Health Organization (WHO), and academic institutions. The aim of the meeting was to discuss the draft framework and its application to two examples from infectious disease prevention and control. This article introduces the draft PRECEPT framework and reports on the meeting, its structure, most relevant discussions and major conclusions.
    Health Policy 03/2015; 119(6). DOI:10.1016/j.healthpol.2015.02.010 · 1.73 Impact Factor
  • Source
    • "The most conclusive evidence regarding patient outcomes can be derived from diagnostic randomized controlled trials (D-RCTs), in which participants are randomized to have a new diagnostic test vs. a control or no test [5e7]. Performing such trials is challenging [8] [9], but randomized controlled trials (RCTs) represent a rigorous approach to diagnostic test evaluation [10]. D-RCTs evaluating patient outcomes are relatively uncommon [11], but their examination can offer useful insights. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Objectives To evaluate the effects of diagnostic testing on patient outcomes in a large sample of diagnostic randomized controlled trials (D-RCTs) and to examine whether the effects for patient outcomes correlate with the effects on management and with diagnostic accuracy. Study Design and Setting We considered D-RCTs that evaluated diagnostic interventions for any condition and reported effectiveness data on one or more patient outcomes. We calculated odds ratios for patient outcomes and outcomes pertaining to the use of further diagnostic and therapeutic interventions and the diagnostic odds ratio (DOR) for the accuracy of experimental tests. Results One hundred forty trials (153 comparisons) were eligible. Patient outcomes were significantly improved in 28 comparisons (18%). There was no concordance in significance and direction of effects between the patient outcome and outcomes for use of further diagnostic or therapeutic interventions (weighted κ 0.02 and 0.09, respectively). The effect size for the patient outcome did not correlate with the effect sizes for use of further diagnostic (r = 0.05; P = 0.78) or therapeutic interventions (r = 0.18; P = 0.08) or the experimental intervention DOR in the same trial (r = −0.24; P = 0.51). Conclusion Few tests have well-documented benefits on patient outcomes. Diagnostic performance or the effects on management decisions are not necessarily indicative of patient benefits.
    Journal of clinical epidemiology 06/2014; 67(6). DOI:10.1016/j.jclinepi.2013.12.008 · 5.48 Impact Factor
  • Source
    • "The lack of RCTs in psychiatric research, therefore, reflects the newness of the development of biomarkers in mental illness (Van Lieshout and Szatmari, 2009). It is important to keep in mind, however , that while the methodological rigor increases from cross-sectional and case–control studies to longitudinal cohorts with RCTs, in some circumstances cross-sectional studies can provide highly valuable information about the accuracy of a test (Schunemann et al., 2008). There is an extensive literature on the concept, development and validation of biomarkers which is well reviewed elsewhere (Frank and Hargreaves, 2003). "
    [Show abstract] [Hide abstract]
    ABSTRACT: Although the etiology of bipolar disorder remains uncertain, multiple studies examining neuroimaging, peripheral markers and genetics have provided important insights into the pathophysiologic processes underlying bipolar disorder. Neuroimaging studies have consistently demonstrated loss of gray matter, as well as altered activation of subcortical, anterior temporal and ventral prefrontal regions in response to emotional stimuli in bipolar disorder. Genetics studies have identified several potential candidate genes associated with increased risk for developing bipolar disorder that involve circadian rhythm, neuronal development and calcium metabolism. Notably, several groups have found decreased levels of neurotrophic factors and increased pro-inflammatory cytokines and oxidative stress markers. Together these findings provide the background for the identification of potential biomarkers for vulnerability, disease expression and to help understand the course of illness and treatment response. In other areas of medicine, validated biomarkers now inform clinical decision-making. Although the findings reviewed herein hold promise, further research involving large collaborative studies is needed to validate these potential biomarkers prior to employing them for clinical purposes. Therefore, in this positional paper from the ISBD-BIONET (biomarkers network from the International Society for Bipolar Disorders), we will discuss our view of biomarkers for these three areas: neuroimaging, peripheral measurements and genetics; and conclude the paper with our position for the next steps in the search for biomarkers for bipolar disorder.
    Australian and New Zealand Journal of Psychiatry 02/2013; 47(4). DOI:10.1177/0004867413478217 · 3.77 Impact Factor
Show more