Article

Citation bias favoring statistically significant studies was present in medical research.

CRC & Division of Clinical Epidemiology, Department of Health and Community Medicine, University of Geneva and University Hospitals of Geneva, Rue Gabrielle Perret-Gentil 6, 1211 GENEVE 14, Switzerland. Electronic address: .
Journal of clinical epidemiology (Impact Factor: 5.48). 03/2013; 66(3):296-301. DOI: 10.1016/j.jclinepi.2012.09.015
Source: PubMed

ABSTRACT Statistically significant studies may be cited more than negative studies on the same topic. We aimed to assess here whether such citation bias is present across the medical literature.
We conducted a cohort study of the association between statistical significance and citations. We selected all therapeutic intervention studies included in meta-analyses published between January and March 2010 in the Cochrane database, and retrieved citation counts of all individual studies using ISI Web of Knowledge. The association between the statistical significance of each study and the number of citations it received between 2008 and 2010 was assessed in mixed Poisson models.
We identified 89 research questions addressed in 458 eligible articles. Significant studies were cited twice as often as nonsignificant studies (multiplicative effect of significance: 2.14, 95% confidence interval: 1.38-3.33). This association was partly because of the higher impact factor of journals where significant studies are published (adjusted multiplicative effect of significance: 1.14, 95% confidence interval: 0.87-1.51).
A citation bias favoring significant results occurs in medical research. As a consequence, treatments may seem more effective to the readers of medical literature than they really are.

1 Bookmark
 · 
131 Views
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Scholarly publishing is the cornerstone of advancing our understanding of the world around us. A staggering amount of research is conducted each day, and this research would effectively serve no purpose without a system for its dissemination. However, academic publishing is slanted toward positive results, with negative results becoming scarcer in the literature (Fanelli, 2012). Countless experiments without splashy results end up in dusty lab notebooks, forever closed off from the rest of the scientific community.
    Journal of Postdoctoral Research. 04/2013; 1(4):51-52.
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Publication bias undermines the integrity of the evidence base by inflating apparent drug efficacy and minimizing drug harms, thus skewing the risk-benefit ratio. This paper reviews the topic of publication bias with a focus on drugs prescribed for psychiatric conditions, especially depression, schizophrenia, bipolar disorder, and autism. Publication bias is pervasive; although psychiatry/psychology may be the most seriously afflicted field, it occurs throughout medicine and science. Responsibility lies with various parties (authors as well as journals, academia as well as industry), so the motives appear to extend beyond the financial interests of drug companies. The desire for success, in combination with cognitive biases, can also influence academic authors and journals. Amid the flood of new medical information coming out each day, the attention of the news media and academic community is more likely to be captured by studies whose results are positive or newsworthy. In the peer review system, a fundamental flaw arises from the fact that authors usually write manuscripts after they know the results. This allows hindsight and other biases to come into play, so data can be "tortured until they confess" (a detailed example is given). If a "publishable" result cannot be achieved, non-publication remains an option. To address publication bias, various measures have been undertaken, including registries of clinical trials. Drug regulatory agencies can provide valuable unpublished data. It is suggested that journals borrow from the FDA review model. Because the significance of study results biases reviewers, results should be excluded from review until after a preliminary judgment of study scientific quality has been rendered, based on the original study protocol. Protocol publication can further enhance the credibility of the published literature.
    CNS Drugs 05/2013; · 4.38 Impact Factor
  • Source
    American Journal of Epidemiology 07/2014; · 4.98 Impact Factor

Full-text

Download
171 Downloads
Available from
May 22, 2014