Searching for unpublished trials in Cochrane reviews may not be worth the effort

Department of General Practice and Primary Health Care, Ghent University, Belgium.
Journal of clinical epidemiology (Impact Factor: 5.48). 08/2009; 62(8):838-844.e3. DOI: 10.1016/j.jclinepi.2008.09.010
Source: PubMed

ABSTRACT To assess the value of searching for unpublished data by exploring the extent to which Cochrane reviews include unpublished data and by evaluating the quality of unpublished trials.
We screened all 2,462 completed Cochrane reviews published since 2000 in the Cochrane Database of Systematic Reviews Issue 3, 2006. In a random sample (n=61) of 292 reviews, including unpublished trials, we studied all 116 references.
Unpublished trials make up 8.8% of all included trials in our sample. Thirty-eight percent of the "unpublished" trials have in fact been published. Allocation concealment was "unclear" or not adequate in 54.3% and 61.3% reported blinding. In 47.2% reported withdrawal rates were >20%. Trials that were eventually published had larger mean population sizes (P-value, 0.02). Of the reported sponsors, 87.3% were drug companies. Methodological quality and publication bias are mentioned in half of the reviews and explored in a third. Quality ratings did not have consequences for pooling, because 82.8% was included in the forest plots.
A minority of Cochrane reviews include "unpublished trials" and many of these are eventually published. Truly unpublished studies have poor or unclear methodological quality. Therefore, it may be better to invest in regular updating of reviews, rather than in extensive searching for unpublished data.

Download full-text


Available from: Jan De Maeseneer, Jul 22, 2015
  • Source
    • "It has been suggested that identifying non- English language and unpublished studies for inclusion is important to minimize language and publication bias respectively. However, this has been questioned and suggested that many unpublished studies eventually become published and truly unpublished studies might have poor or unclear methodology, which in turn might serve to introduce bias to any systematic review (Van Driel et al., 2009). "
    [Show abstract] [Hide abstract]
    ABSTRACT: Exercise is widely regarded as an effective intervention for symptomatic rotator cuff tendinopathy but the prescription is diverse and the important components of such programmes are not well understood. The objective of this study was to systematically review the contextual factors and prescription parameters of published exercise programmes for rotator cuff tendinopathy, to generate recommendations based on current evidence. An electronic search of AMED, CiNAHL, CENTRAL, MEDLINE, PEDro and SPORTDiscus was undertaken from their inception to June 2014 and supplemented by hand searching. Eligible studies included randomized controlled trials evaluating the effectiveness of exercise in participants with rotator cuff tendinopathy. Included studies were appraised using the Cochrane risk of bias tool and synthesized narratively. Fourteen studies were included, and suggested that exercise programmes are widely applicable and can be successfully designed by physiotherapists with varying experience; whether the exercise is completed at home or within a clinic setting does not appear to matter and neither does pain production or pain avoidance during exercise; inclusion of some level of resistance does seem to matter although the optimal level is unclear, the optimal number of repetitions is also unclear but higher repetitions might confer superior outcomes; three sets of exercise are preferable to two or one set but the optimal frequency is unknown; most programmes should demonstrate clinically significant outcomes by 12 weeks. This systematic review has offered preliminary guidance in relation to contextual factors and prescription parameters to aid development and application of exercise programmes for rotator cuff tendinopathy.
    International Journal of Rehabilitation Research 02/2015; 38(2). DOI:10.1097/MRR.0000000000000113 · 1.14 Impact Factor
  • Conference Paper: Molecular monoelectronics
    [Show abstract] [Hide abstract]
    ABSTRACT: Summary form only given. Monoelectronics, a field of research concerned with the development of discrete digital electronic devices that code information by single electrons, is discussed. It is suggested that monoelectronic devices should be built from proteins because proteins of living electron transfer chains can store and exchange (tunnel) single electrons, and they may form molecular complexes and modify chemically active sites on the surface that are responsible for complex formation. It is noted that for an artificial protein complex to be produced, it is necessary that the electric field surrounding the protein molecules be known. This knowledge permits accurate choice of experimental conditions. Proteins with one or several metal atoms greatly differ from metal granules that originally served to develop the theory of monoelectronics. Theoretical analysis of the electron transfer through tunnel junctions with one atom in between has revealed volt-ampere oscillations which are a result of discrete energy levels on the prosthetic group of the protein
    Engineering in Medicine and Biology Society, 1989. Images of the Twenty-First Century., Proceedings of the Annual International Conference of the IEEE Engineering in; 12/1989
  • [Show abstract] [Hide abstract]
    ABSTRACT: Introduction: This thesis examines methods for updating searches for systematic reviews of healthcare interventions. Systematic reviews endeavour to find and synthesize all relevant research as a basis for the practice of evidence-based medicine. They are more useful if they are complete and up-to-date. Materials and Methods: The sample was 93 meta-analyses in allopathic medicine. Newer randomized controlled trials (RCTs) were sought through MEDLINE searches, and were assessed for relevance by physicians. Two Boolean searches, two similarity searches and one non-database search approach were tested. The Boolean searches were based on a simple subject search paired with a filter selecting only RCTs from Abridged Index Medicus journals or with the balanced Clinical Query. The two similarity searches were Support Vector Machine (SVM) and a Related Article search of PubMed based on the three newest and three largest studies from the original review. Main Results: Clinical Query provided good recall but with large retrievals. Abridged Index Medicus RCT had smaller retrieval sizes and lower recall, but did detect many large studies. The Related Article search showed the highest recall. Recall with SVM was lower, but retrievals were smaller. RCTs that cited the systematic review being updated were also tested but identified only a small proportion of new evidence. Relative performance of the test searches was consistent regardless of whether the intervention was a drug, device or procedure. All searches showed variability across clinical areas, but Related Articles RCT showed the most consistency. The pairing of Related Article RCT and Clinical Query gave excellent recall of new relevant material. Conclusions: Meta-analysts can identify new evidence through a simple structured Boolean search paired with a related articles protocol. By building on the evidence base formed in the original review, related article searching may replace time-consuming nondatabase methods necessary in conducting original reviews. Agency for Healthcare Research and Quality (Contract No. 290-02-0021); Canadian Agency for Drugs and Technologies in Health
Show more