Strategies in assessing the need for updating evidence-based guidelines for six clinical topics: An exploration of two search methodologies

Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, NC 27599-7590, USA.
Health Information & Libraries Journal (Impact Factor: 0.89). 10/2008; 25(3):198-207. DOI: 10.1111/j.1471-1842.2007.00765.x
Source: PubMed


Because of the expense of updating practice guidelines, recent attention has focused on approaches that can reliably assess any updating required. Shekelle et al. (Journal of the American Medical Association 2001, 286, 1461-7) proposed using limited literature searches with expert involvement to reduce resources used in assessing whether a guideline needs updating.
This study compared Shekelle's method and the traditional systematic review method regarding comprehensiveness and effort.
Two research teams translated critical key questions on screening test treatments and outcomes to Medical Subjects Headings (MeSH) and search strategies. They refined Shekelle's method over three iterations, seeking greater efficiency. Using both methods independently, teams assessed the need to update six topics from the 1996 Guide to Clinical Preventive Services (US Preventive Services Task Force). Outcomes included completeness of study identification, importance of missed studies and effort involved.
The revised review approach produced fewer citations than the traditional approach and saved time, identifying fewer eligible studies than the traditional approach. None of the studies missed was rated important by the experts consulted.
The revised review approach provides an acceptable method for judging whether a guideline requires updating. Librarians were an integral part of the research process that streamlined the searches.

Download full-text


Available from: Christiane E Voisin, Nov 04, 2014
  • Source
    • "However, information about the process and methods for updating used by guideline organizations is lacking. Only few published research studies are available on this topic [6-9]. Few organizations include chapters or information on guideline updating in their handbooks on guideline development [1,2]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Clinical practice guidelines (CPGs) have become increasingly popular, and the methodology to develop guidelines has evolved enormously. However, little attention has been given to the updating process, in contrast to the appraisal of the available literature. We conducted an international survey to identify current practices in CPG updating and explored the need to standardize and improve the methods. We developed a questionnaire (28 items) based on a review of the existing literature about guideline updating and expert comments. We carried out the survey between March and July 2009, and it was sent by email to 106 institutions: 69 members of the Guidelines International Network who declared that they developed CPGs; 30 institutions included in the U.S. National Guideline Clearinghouse database that published more than 20 CPGs; and 7 institutions selected by an expert committee. Forty-four institutions answered the questionnaire (42% response rate). In the final analysis, 39 completed questionnaires were included. Thirty-six institutions (92%) reported that they update their guidelines. Thirty-one institutions (86%) have a formal procedure for updating their guidelines, and 19 (53%) have a formal procedure for deciding when a guideline becomes out of date. Institutions describe the process as moderately rigorous (36%) or acknowledge that it could certainly be more rigorous (36%). Twenty-two institutions (61%) alert guideline users on their website when a guideline is older than three to five years or when there is a risk of being outdated. Twenty-five institutions (64%) support the concept of "living guidelines," which are continuously monitored and updated. Eighteen institutions (46%) have plans to design a protocol to improve their guideline-updating process, and 21 (54%) are willing to share resources with other organizations. Our study is the first to describe the process of updating CPGs among prominent guideline institutions across the world, providing a comprehensive picture of guideline updating. There is an urgent need to develop rigorous international standards for this process and to minimize duplication of effort internationally.
    Full-text · Article · Sep 2011 · Implementation Science
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The Schizophrenia Patient Outcomes Research Team (PORT) project has played a significant role in the development and dissemination of evidence-based practices for schizophrenia. In contrast to other clinical guidelines, the Schizophrenia PORT Treatment Recommendations, initially published in 1998 and first revised in 2003, are based primarily on empirical data. Over the last 5 years, research on psychopharmacologic and psychosocial treatments for schizophrenia has continued to evolve, warranting an update of the PORT recommendations. In consultation with expert advisors, 2 Evidence Review Groups (ERGs) identified 41 treatment areas for review and conducted electronic literature searches to identify all clinical studies published since the last PORT literature review. The ERGs also reviewed studies preceding 2002 in areas not covered by previous PORT reviews, including smoking cessation, substance abuse, and weight loss. The ERGs reviewed over 600 studies and synthesized the research evidence, producing recommendations for those treatments for which the evidence was sufficiently strong to merit recommendation status. For those treatments lacking empirical support, the ERGs produced parallel summary statements. An Expert Panel consisting of 39 schizophrenia researchers, clinicians, and consumers attended a conference in November 2008 in which consensus was reached on the state of the evidence for each of the treatment areas reviewed. The methods and outcomes of the update process are presented here and resulted in recommendations for 16 psychopharmacologic and 8 psychosocial treatments for schizophrenia. Another 13 psychopharmacologic and 4 psychosocial treatments had insufficient evidence to support a recommendation, representing significant unmet needs in important treatment domains.
    Full-text · Article · Dec 2009 · Schizophrenia Bulletin
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Background Scientific knowledge is in constant change. The flow of new information requires a frequent re-evaluation of the available research results. Clinical practice guidelines (CPGs) are not exempted from this phenomenon and need to be kept updated to maintain the validity of their recommendations. The objective of our review is to systematically identify, describe and assess strategies for monitoring and updating CPGs. Study design and setting We conducted a systematic review of studies evaluating one or more methods of updating (with or without monitoring) CPGs or recommendations. We searched MEDLINE (PubMed) and The Cochrane Methodology Register (The Cochrane Library) from 1966 to June 2012. Additionally, we hand-searched reference lists of the included studies and the Guidelines International Network book of abstracts. If necessary, we contacted study authors to obtain additional information. Results We included a total of eight studies. Four evaluated if CPGs were out of date, three updated CPGs, and one continuously monitored and updated CPGs. The most detailed reported phase of the process was the identification of new evidence. As opposed to studies updating guidelines, studies evaluating if CPGs were out of date applied restricted searches. Only one study compared a restricted versus an exhaustive search suggesting that a restricted search is sufficient to assess recommendations’ Validity. One study analyzed the survival time of CPGs and suggested that these should be reassessed every three years. Conclusions There is limited evidence about the optimal strategies for monitoring and updating clinical practice guidelines. A restricted search is likely to be sufficient to monitor new evidence and assess the need to update, however, more information is needed about the timing and type of search. Only the exhaustive search strategy has been assessed for the update of CPGs. The development and evaluation of more efficient strategies is needed to improve the timeliness and reduce the burden of maintaining the validity of CPGs.
    Full-text · Article · Nov 2012 · Implementation Science