ArticlePDF Available

The rise and fall of EBM

Authors:
  • European Society for Person Centered Healthcare
Q J Med 1998; 91:371–374
Commentary
QJM
The rise and fall of EBM
B.G. CHARLTON and A. MILES1
From the Department of Psychology, University of Newcastle, Newcastle upon Tyne, and
1European Institute of Health and Medical Sciences, University of Surrey, Guildford, UK
Introduction
The rise of Evidence-based Medicine (EBM) has been were never properly addressed—nonetheless CE was
widely regarded as a refreshing approach that blewone of the more remarkable phenomena of the
British health scene during the 1990s. Tremendous away cobwebs and let in some light. In particular, CE
mobilized the enthusiasm of people to come to gripsadvances have been made in establishing the EBM
brand name, obtaining massive government funding, with interpreting clinical data for themselves for use
in their own clinical practice.manoeuvring to a position of unchallenged authority
within the NHS managerial and political hierarchy But the advocates of clinical epidemiology were
ambitious of influence, and grew impatient. A signi-(and its priesthood among the BMJ editorial staff)—
and promoting EBM as a marketing slogan for ficant change came when the name ‘Evidence-based
Medicine’ or EBM was coined in 1992.2 Althoughlucrative conferences, courses, books, journals,
people and organizations. the term involves a calculatedly dishonest misrepres-
entation,3 this new nomenclature was an immediateThe ‘fall’ of EBM is rather different; since it
involves a quasi-theological ‘fall from grace’: a loss rhetorical success. EBM effectively labelled itself as
rational, objective and altruistic—while any opposi-of clinical, scientific and educational integrity, even
to the point of a decline into a ‘state of sin’ (if tion was implied to be promoting a practice that is
illogical, self-indulgent and opposed to the evidence.seeking and clinging to power at any costs is seen
as sinful). This moral decline would—in the normal A set of mission-statements was proposed as definit-
ive of EBM: these took the form of platitudes whichcourse of eventsbe followed in due course by loss
of status, income and power. However, the EBM could not be opposed by any rational person;4 yet
these content-free proclamations served to camou-barnacle may prove difficult to dislodge now it has
a grip on the minds of politicians and managers. flage controversial ways of operating and marginalize
opponents as wicked or crazy.Certainly, the phenomenon is ripe for re-evaluation.
Clinical Epidemiology to EBM—what’s EBM as a tool of management—a
‘quality-assurance’ systemin a name?
Initially, EBM grew as a bottom-up approach to It is doubtful whether such a crude, question-begging
tactic as naming oneself ‘evidence-based’ wouldcontinuing medical education under the name of
Clinical Epidemiology (CE).1 Clinical Epidemiology have had much influence upon clinicians and med-
ical scientists. However, the proponents of EBMwas based upon emphasizing the potential of epide-
miological information for guiding clinical practice. cleverly bypassed doctors and appealed directly to
politicians, health service managers, public healthIn retrospect, the epidemiological emphasis was
exaggerated and its problems and insufficiencies professionals and the newly expanded ranks of
Address correspondence to Dr B.G. Charlton, Department of Psychology, University of Newcastle, Newcastle upon Tyne
NE1 7RU. e-mail: bruce.g.charlton@ncl.ac.uk
© Oxford University Press 1998
B.G. Charlton et al.372
‘number-crunchers’ (epidemiologists, biostatisticians, the role of implicit or unquantifiable factors such as
clinical judgment, experience, qualitative factors,information technologists, health economists, etc.).
Such personnel had emerged in enormous numbers views of patients and the demands of the clinical
consultation. In particular, EBM displays a longas a consequence of the centralizing and regulating
tendency of the NHS reforms, and they were seeking standing tendency towards anti-scientific rhetoric1
which ignores the foundational role of laboratorytools of legitimation.5
EBM was seized upon by managers and their and clinical sciences in the history of therapeutic
innovation and advance.8myrmidons, and promoted with a massive injection
of publicity, money and organizational infrastructure. The misplaced emphasis on large databases as
offering best guidance for clinical practice leads onThe consequence has been an astonishing trans-
formation from the clinically-led approach of CE to to an implicit belief in the primary role of information
and statistics. Consequently, the nature of clinicalthe managerially-led approach of EBM. Instead of a
bottom-up system using epidemiology to inform good expertise has been redefined by EBM. It has tradition-
ally been assumed that the best people for decidingpractice, the NHS bureaucracy has introduced a top-
down system which employs statistical data to define, upon clinical matters are those with clinical training,
experience and a substantive knowledge of healthprescribe, monitor and enforce specific practices
upon clinicians.6 and disease that ideally includes having performed
research in the field. Such experts are usually doctors.It seems likely that NHS management were so
quick to advance EBM because they saw its potential But EBM regards clinical expertise as mainly a matter
of collecting, analysing and summarizing researchas a ‘quality assurance’ tool capable of regulating,
not just medical practice, but the whole of the health done by other people. Hence the final arbiters
of EBM practice are ‘systematic reviewers’ drawnservice. Traditional managerial and audit methods
require a conveniently measurable output, and clin- from biostatistics, epidemiology, health economics
and other ‘Infostat’ disciplines.5 Clinical advice hasical services are notoriously difficult to quantify.
However ‘quality assurance’ audit concentrates not been neatly bypassed and subjected to external
performance criteria. This can be regarded as theon performance but on the systemquality is defined
and measured in terms of the operations of a control latest move in an ‘audit revolution’ which has swept
the UK Public Sector during the past couple ofand feedback system.7
The ‘evidence-based’ movement in the health decades.7
Suffice it to say that there is not a shred ofservice provides exactly such a quality assurance
system. As the ‘implementation’ moves on from evidence to suggest that an understanding of medical
research and its interpretation for practice can beevidence-based medicine, through evidence-based
education, research and development, nursing, reduced to the routine application of checklists and
formulae. However, doctors are notoriously awkwardpublic health and health policy, we are witnessing
the creation of an interlocking system to comprise and intransigent individuals supported by consider-
able professional solidarity—while Infostat techni-an ‘evidence-based’ health service. This would
incorporate all aspects of health service practice, cians are easily trained, deployed and controlled.
Hence the third, and ethical, criticism of EBM. In aand be based-upon a process of standardized mon-
itoring and interpretation of information. The NHS nutshell, EBM involves a takeover of the clinical
consultation by an alliance of managers and theirwould comprise a set of ‘transparent’ and measurable
activities, regulated by audit of the EB system. And statistical technocrats who are empowered to
define ‘best practice’. The upshot is that the EBMsince the only aspect of quality assurance not open
to challenge is the legitimacy of the quality assurance apparatchiks acquire substantive influence over mil-
lions of clinical consultations, but without anysystem itself,7 EBM would permanently be insulated
from criticism. responsibility for the clinical consequences.
In bed with the BMJThe trouble with EBM
Criticisms of EBM are essentially three-fold, and One of the most striking features of EBM has been
the intimate relationship it has forged with the Britishconcern methodology, personnel and the ethical
framework.6 EBM involves the elevation of certain Medical Journal and its editorial staff. More than any
other factor, this has gained EBM doctrines themethodological principles—in particular the large
randomized mega-trial and (more recently) meta- academic credibility they needed to persuade
the NHS hierarchy of their validity.analysis—to ‘gold standard’ status as criteria against
which all other types of ‘evidence’ should be judged. The support of the BMJ for EBM began with
explicit endorsement by the editor and continuedThis doctrine excludes or relegates to inferior status
The rise and fall of EBM 373
with the commissioning of iterative series of ‘how to of the actual EBM group and its satellites (official
and unofficial), the Cochrane Collaboration, the NHSdo it’ articles on EBM techniques such a randomized
trials, systematic reviews, meta-analyses, ‘critical’ Centre for Reviews and Dissemination; but the main
recipients of bounty are the host of researchersreading skills and so on ad nauseam. BMJ champion-
ship has extended to books on the topic, and a employed by university departments and supported
by grants derived from NHS Research andwhole stable of generalist and specialist EBM journals
(from the BMJ’s publishers) which have been advert- Development, Health Authorities and the Department
of Health.ised using the BMJ editorial columns. BMJ-endorsed
conferences have been organized to promote the All this after just a few years. The prospect of
grabbing a thick slice of this still-expanding cake hasimplementation of EBM policies.
EBM and BMJ got into bed togetherboth ideolo- surely been a crucial factor in doctors acquiescing
to EBM—and deterring overt criticism. Perhaps thegically and financially—in a way and to a degree
which is unprecedented. It is also astonishing, given fear of alienating a rich source of patronage could
account for the otherwise inexplicable mismatchEBM’s pronounced pro-managerial and anti-clinician
stance and the BMJ’s proper role as the main organ between the near-universal, privately-expressed sus-
picion of EBM among clinicians, and the scarcity ofof British medical opinion. The BMJ now devotes
massively disproportionate attention to the views of published articles expressing this viewpoint?
a minority lobby of largely non-medical opinion.
Indeed, the whole publication policy of the BMJ has
shifted towards ‘second-order’ publications on statist-
Beyond EBM
ics, epidemiology, health economics, management,
policy and politics, health promotion—anything, it
EBM stands revealed as statistical rather than scient-
seems, except for articles by or for clinicians. In
ific; its success more to do with managerial domin-
essence, the BMJ has become the house journal of
ance than medical desirability. Any modest initial
the EBM workforce.
benefits have long since been outweighed by struc-
tural damage, wasted expenditure, and clinical power
without clinical responsibility. EBM has advanced
audit into the consultation, and offers the prospect
Above criticism
of an ‘evidence-based’ health service forcibly unified
Perhaps the most worrying feature of EBM, and the
under a single ‘quality assurance’ system—easily
one which most clearly betrays its non-scientific
regulated by politicians, bureaucrats and their statist-
nature, is the fact that its advocates do not answer
ical technicians.4,5,7
criticism. A magisterial attitude of lofty disdain for
Beyond EBM there lies a whole world of good
contradictory viewpoints is the norm in government
practice and real evidence which has been largely
circles where power is asymmetrically distributed
forgotten or obfuscated by rhetoric. Alternative, more
and the agenda is controlled. Similarly there has not
effective models of health service organization are
been any substantive debate about EBM, merely a
available—including self-regulating professionals
one-sided onslaught of NHS/BMJ-subsidized propa-
embedded in a facilitating administrative structure;
ganda. Dissenting views are muzzled, marginalized,
while superior modes of clinical investigation would
met by non-sequiturs, or disappear into an echoing
emphasize rigorous clinical science, close observa-
void. Backstairs wheeling-and-dealing has substituted
tion of practice including individual case studies,
for public discussion.
whole population studies and representative popula-
Avoidance of debate is related to the fact that EBM
tion sampling—with mega/meta-population epidemi-
has moved directly from being a ‘bright idea’, to the
ology again relegated to its proper, subordinate, role
implementation of this idea—leaving out the usual
of precise measurement.4,5,8,10
period of critique, evaluation and testing. The pros-
The time is ripe for the ‘evidence-based’ mantra
elytizing zeal of EBM proponents has attracted
to be silenced and dissenting voices to be heard.
comment.9 EBM enthusiasts see its benefits as self-
If EBM does not fall spontaneously, it may need to
evident; hence any disagreement is merely indicative
be pushed.
of a failure to understand—or else due to a more
sinister determination to practise medicine in a non-
evidence-based manner.
References
It is hard to estimate the number of people who
are already employed on EBM-related activities, or
1. Sackett DL, Haines RB, Tugwell P. Clinical epidemiology.
benefit financially to a substantial extent, but the
Boston, Little, Brown & Co, 1985.
trough is deep and its beneficiaries probably exceed
2. EBM Working Group. Evidence-based medicine. JAMA
1992; 268:2420–5.
ten thousand in number. There are direct employees
B.G. Charlton et al.374
3. Shahar E. A Popperian perspective of the term ‘evidence- 6. Charlton BG. Restoring the balance: evidence-based
medicine put in its place. J Eval Clin Pract 1997; 3:87–98.based medicine’. J Eval Clin Pract 1997; 3:109–16.
7. Power M. The audit society: rituals of verification. Oxford,
4. Miles A, Charlton BG. Evidence-based medicinea
Oxford University Press, 1997.
critique: 1 & 2. In: Miles A, Lugon M, Bentley P, eds.
Effectiveness and Efficiency in Clinical Practice.
8. Charlton BG. Natural kinds, natural history and the
London, Radcliffe Press, in Press.
clinician-researcher. Q J Med 1997; 90:707–9.
9. Lancet (editorial). Evidence-based medicine in its place.
5. Charlton BG. Infostat, cargo-cult science and the policy
Lancet 1995; 346:785.
sausage-machine: a critique of rationalist management in
the reformed National Health Service. In: Miles A, Lugon M, 10. Charlton BG. The future of clinical research: from megatrials
towards methodological rigour and representative sampling.Bentley P, eds. Effectiveness and Efficiency in Clinical
Practice. London, Radcliffe Press, in Press. J Eval Clin Pract 1996; 2:159–69.
... The revolution brought about by EBM with regard to the practice of medicine over the past few decades has been remarkable. 2 Because of the individualized treatment based on external evidence, EBM leans towards justifying the action with accountability; hence being labeled as the fourth revolution in American Medicine. 3 It must be borne in mind that EBM is a two-edged sword. ...
Article
Evidence-based medicine (EBM) is an approach by clinicians that involves conscientious, explicit, and judicious use of available evidence in deciding on the care of individual patients.1 With the digital revolution and easy access to the available literature, EBM , which was not very practical a few decades ago due to the difficulty in assessing the resources, has been practiced with increasing success nowadays, even in the developing world. The revolution brought about by EBM with regard to the practice of medicine over the past few decades has been remarkable.2 Because of the individualized treatment based on external evidence, EBM leans towards justifying the action with accountability; hence being labeled as the fourth revolution in American Medicine.3
... Evidence-based medicine practices, as provided by clinical audits, have been critiqued by some researchers. [30,31] Many reports indicate, however, that blood transfusion audits are important for the quality improvement of transfusion services in hospitals. This includes their effectiveness in identifying and in turn reducing inappropriate transfusions, improving bedside blood administration procedures, reducing unnecessary crossmatch tests, reducing outdating of donor blood, and avoiding the risk of blood shortages by providing information on service quality levels, profitability, and development. ...
Article
Full-text available
A clinical audit is a quality improvement process that seeks to improve services and outcomes through a systematic review of care against explicit criteria. It is now a recognized tool for improving clinical quality of care. However, in transfusion medicine, they have been utilized in a limited manner. This review intends to discuss the methodology of carrying out a clinical audit systematically. Clinical audit is not research and focuses on the improvement of ordinary and routine practices. Various methodologies for selecting and prioritizing a good audit topic can be employed. Based on the Donabedian model, process-based audits from donor selection to the actual bedside transfusion could be audited to bring in improvement. Likewise, transfusion processes can be audited based on the dimensions of quality in the context of timeliness, effectiveness, and appropriateness. Prioritization of a topic can be done through a quality impact assessment. The objectives help quantify the aim of the audit, while the standards include criteria that are quantified against targets, based on the current evidence for the best possible care. A snapshot sample (20–50 cases) is sufficient to carry out a clinical audit. Where targets are not met, root-cause analysis and quality improvement tools guide the implementation of changes in transfusion practices. To ensure that change is implemented and internalized, it is necessary to have the entire team and the management on board; communication with all stakeholders is key. Re-audit, after the change has been internalized, is an essential part of all clinical audits. Meticulously planning and proper implementation ensure improvement of the care that transfused patients receive.
... Jest tak nieprzypadkowo, ponieważ z założenia nurt ten ma zaopatrywać specjalistów w intuicyjne i skuteczne narzędzie działania w bardzo zindywidualizowanych warunkach leczenia 2 . W kolejnych latach, po ogłoszeniu EBM, nowy paradygmat stanowił przedmiot rozległej krytyki (Duggan, 1992;Charlton, Miles, 1998;Williams, 2010;Horwitz, Singer, 2017;Fava, 2017). Czołowi proponenci EBM przypomnieli o niej z okazji 25-lecia nurtu, wskazując na kilka najczęściej wysuwanych zarzutów. ...
... To some researchers, contemporary biomedical science seems to be especially focused on statistical studies and probabilistic modelling, at the expense of mechanistic and observational evidence. Following this provocative interpretation, it could be argued that the current pandemic clearly exhibits the lurking clash between, on the one hand, 'statistical technocrats' [Charlton & Miles (1998)] with their smug prioritisation of medical evidence and, on the other, 'old-fashioned' clinicians and mechanistic scientists whose focus is on the causal interaction between the patientorganism and the disease-pathogen. We do not believe that statistical technocrats want to rule the world. ...
Article
Full-text available
In order to justify their policies during the Covid-19 pandemic, governments have implicitly appealed, especially in the early phases, to a biased 'evidence-based' philosophy of medicine heavily relying on computational and statistical evidence. This approach shows an important weakness: it largely ignores clinical and mechanistic evidence that could greatly contribute to the understanding and management of the disease. We shall argue that a pluralistic approach to evidence focused on integration could better support the fight against this and future pandemics.
Article
Contralateral prophylactic mastectomy (CPM) is a controversial breast cancer treatment in which both breasts are removed when only one is affected by cancer. Rates of CPM have been rising since the late 1990s, despite surgeons’ strong agreement that the procedure should not be performed for average-risk women. This essay analyses that agreement as it is demonstrated in the surgical literature on CPM, arguing that it forms a ‘rhetoric of certainty’ built on the stark epistemological divide between objective and subjective forms of knowledge that operates in some areas of medicine. Further, the essay argues that this rhetoric of certainty has the potential to function as a kind of eristic rhetoric in which the right conclusion is known prior to any rhetorical exchange. As a way to ‘crack open’ this certainty, the essay compares the rhetoric of the surgical literature on CPM to the rhetoric of uncertainty in the radiological literature on breast cancer screening for women with a personal history of the disease. The goal of this comparison is not to suggest surgeons should support all choices for CPM. Rather, the aim is to demonstrate that choices against the procedure are not as straightforward as the surgical literature indicates and that the uncertainty affecting women’s preferences for CPM is not solely the result of patient misunderstanding and/or emotional instability.
Article
Background/aim: Adverse drug reactions (ADRs) represent a major concern leading to significant increases in both morbidity and mortality globally. Providing healthcare professionals (HCPs) and patients with real-world data on drug safety is imperative to facilitate informed decision-making. The study aimed to determine the feasibility of creating comparative safety charts for medicines by mapping ADR reporting onto prescribing data. Materials and methods: Data on serious and fatal ADR reports from the Yellow Card database was mapped onto general practice prescription data in England. The rate of serious and fatal ADR reports per million items prescribed was calculated for commonly-prescribed medicines. Results: Quantitative comparative analyses for 137 medicines belonging to 26 therapeutic classes were conducted. Significant differences were observed within most therapeutic classes for the rate of serious and fatal ADR reports per prescribing unit. Conclusion: Despite the limitations of ADR reporting and prescribing databases, the study provides a proof-of-concept for the feasibility of mapping ADR reporting onto prescribing data to create comparative safety charts that could support evidence-based decision-making around formulary choices.
Chapter
Full-text available
This book is intended as an intellectual resource for clinicians and healthcare professionals who are interested in digging deeper into the philosophical foundations of their daily practice. It is a tool for understanding some of the philosophical motivations and rationality behind the way medicine and healthcare are studied, evaluated and practiced. In particular, this book illustrates the impact that our thinking about causality, both philosophically and conceptually, has on the clinical encounter. The aim is to engage and empower healthcare professionals to take part in changing and defining the premises for their own practice. After all, if clinical decisions should be based on evidence, this ought to be evidence that is relevant and well-suited for the clinic. The book has two parts, Philosophical Framework and Application to the Clinic. The first part is written from the philosophical perspective and presents a singular overall framework. The second part is written primarily by clinicians who address some implications of the philosophical framework for different aspects of their own practice.
Article
A powerful impetus behind the rise of the ‘megatrial’ (a large, simple, usually multi-centred randomized controlled trial analysed by ‘intention to treat’) has been the desire for ever-increasing precision in the measurement of therapeutic effectiveness. However, the demand for precision has been allowed to override other and more important methodological considerations. Megatrials have progressively abandoned the pursuit of scientifically rigorous experimentation, valid measurement and optimal epidemiological sampling in favour of recruiting and processing large numbers of subjects. This is a mistaken strategy which leads inevitably to error, because investigators are seeking a primarily statistical, rather than clinically or scientifically relevant, notion of exactness. We are now in a position to describe a clinical research strategy which offers many advantages over a megatrial-led approach. Research should be planned with an awareness that the validity and applicability of estimates is more important than their numerical precision, and that this requires both an unselected denominator population database of all incident cases, and maximally controlled randomized trials and other studies. The Population-Adjusted Clinical Epidemiology (PACE) strategy is suggested as exemplifying the twin principles of clinically useful research: rigorous science and representative epidemiology.
Article
If the term ‘evidence-based medicine’ conveys more than is conveyed by the word medicine, then there must be a way to distinguish between evidence-based medicine and non-evidence-based medicine. In particular, there must be a logically acceptable way to classify medical decisions as justified or unjustified by scientific evidence. In this essay I examine the nature of medical theories, the nature of the evidence that is produced by empirical tests of medical theories, and the relation of medical decisions to both. I conclude that attempts to classify medical decisions as justified or unjustified by scientific evidence have no foundation in logic and that the term ‘evidence-based medicine’ is logically indistinguishable from the term ‘medicine’. The use of the term ‘evidence-based medicine’ calls for a new type of authoritarianism in medical practice.
Article
Since the early 1980s there has been an explosion of auditing activity in the United Kingdom and North America. In addition to financial audits there are now medical audits, technology audits, value for money audits, environmental audits, quality audits, teaching audits, and many others. Why has this happened? What does it mean when a society invests so heavily in an industry of checking and when more and more individuals find themselves subject to formal scrutiny? The Audit Society argues that the rise of auditing has its roots in political demands for accountability and control. At the heart of a new administrative style internal control systems have begun to play an important public role and individual and organizational performance has been increasingly formalized and made auditable. Michael Power argues that the new demands and expectations of audits live uneasily with their operational capabilities. Not only is the manner in which they produce assurance and accountability open to question but also, by imposing their own values, audits often have unintended and dysfunctional consequences for the audited organization. Available in OSO: http://www.oxfordscholarship.com/oso/public/content/management/9780198296034/toc.html
Article
Recent medical research has been based on a flawed rationale of clinical innovation (here termed the 'basic-to-mega model') which neglects the human organism as a vital focus of clinical scientific study. The consequent over-concentration upon cellular and population levels of analysis has probably damaged the rate of therapeutic progress. The key role in medical research should be acknowledged to lie with clinician-researchers whose 'experimental animal' is the patient and whose 'end-points' are health and disease. The distinctive strength of the clinician-researcher derives from an ability to combine understanding of the 'natural kinds' (i.e. true biological categories) relevant to human disease, with experience of the 'natural history' of disease (i.e. its longitudinal pattern, including the response to interventions). Such knowledge is explicitly formalized by the activities of clinical science and clinical epidemiology. A sufficient supply of active clinician-researchers is the catalyst of innovation, and an insufficient supply is currently a rate-limiting factor in therapeutic progress.
The audit society: rituals of verification. Oxford, 4. Miles A, Charlton BG. Evidence-based medicine-a
  • M Power
Power M. The audit society: rituals of verification. Oxford, 4. Miles A, Charlton BG. Evidence-based medicine-a Oxford University Press, 1997. critique: 1 & 2. In: Miles A, Lugon M, Bentley P, eds. Effectiveness and Efficiency in Clinical Practice.
sausage-machine: a critique of rationalist management in the reformed National Health Service
  • B G Charlton
  • Infostat
Charlton BG. Infostat, cargo-cult science and the policy Lancet 1995; 346:785. sausage-machine: a critique of rationalist management in the reformed National Health Service. In: Miles A, Lugon M, 10. Charlton BG. The future of clinical research: from megatrials towards methodological rigour and representative sampling.
Clinical epidemiology. benefit financially to a substantial extent, but the Boston, Little, Brown & Co, 1985. trough is deep and its beneficiaries probably exceed 2. EBM Working Group. Evidence-based medicine
  • D L Sackett
  • R B Haines
  • P Tugwell
employed on EBM-related activities, or 1. Sackett DL, Haines RB, Tugwell P. Clinical epidemiology. benefit financially to a substantial extent, but the Boston, Little, Brown & Co, 1985. trough is deep and its beneficiaries probably exceed 2. EBM Working Group. Evidence-based medicine. JAMA 1992; 268:2420-5.
clinician-researcher
  • B G Charlton
Charlton BG. Natural kinds, natural history and the London, Radcliffe Press, in Press. clinician-researcher. Q J Med 1997; 90:707-9.