A systematic review to evaluate the accuracy of electronic adverse drug event detection

Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.
Journal of the American Medical Informatics Association (Impact Factor: 3.93). 01/2012; 19(1):31-8. DOI: 10.1136/amiajnl-2011-000454
Source: PubMed

ABSTRACT Adverse drug events (ADEs), defined as adverse patient outcomes caused by medications, are common and difficult to detect. Electronic detection of ADEs is a promising method to identify ADEs. We performed this systematic review to characterize established electronic detection systems and their accuracy.
We identified studies evaluating electronic ADE detection from the MEDLINE and EMBASE databases. We included studies if they contained original data and involved detection of electronic triggers using information systems. We abstracted data regarding rule characteristics including type, accuracy, and rationale.
Forty-eight studies met our inclusion criteria. Twenty-four (50%) studies reported rule accuracy but only 9 (18.8%) utilized a proper gold standard (chart review in all patients). Rule accuracy was variable and often poor (range of sensitivity: 40%-94%; specificity: 1.4%-89.8%; positive predictive value: 0.9%-64%). 5 (10.4%) studies derived or used detection rules that were defined by clinical need or the underlying ADE prevalence. Detection rules in 8 (16.7%) studies detected specific types of ADEs.
Several factors led to inaccurate ADE detection algorithms, including immature underlying information systems, non-standard event definitions, and variable methods for detection rule validation. Few ADE detection algorithms considered clinical priorities. To enhance the utility of electronic detection systems, there is a need to systematically address these factors.


Available from: Alison Jennings, Jun 10, 2015
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Harmful reactions that are caused by the intake of medication are known as Adverse Drug Reactions (ADRs). Early detection of ADRs associated with drugs in their post-approval periods is a crucial challenge for pharmacovigilance research. Pharmacovigilance is defined as “the science and activities relating to the detection, assessment, understanding and prevention of adverse effects or any other drug problem” [1]. The process of pharmacovigilance begins during the pre-approval clinical trials conducted for a drug and continues after the drug is released into the market. Due to the various limitations of pre-approval clinical trials, it is not possible to fully assess the consequences of the use of a particular drug before it is released [2]. Recent studies have shown that adverse reactions caused by drugs following their release into the market is a major public health problem: with deaths and hospitalizations numbering in millions (up to 5% hospital admissions, 28% emergency visits, and 5% hospital deaths), and associated costs of about seventy-five billion dollars annually [3], [4] and [5]. Thus, post-marketing surveillance of drugs is of paramount importance for drug manufacturers, national bodies such as the U.S. Food and Drug Administration (FDA), and international organizations such as the World Health Organization (WHO) [6].
    Journal of Biomedical Informatics 02/2015; 91. DOI:10.1016/j.jbi.2015.02.004 · 2.48 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Efforts to improve patient safety have largely focused on inpatient or emergency settings, but the importance of patient safety in ambulatory care is increasingly being recognized as a key component of overall health care quality. Care gaps in outpatient settings may include missed diagnoses, medication errors, or insufficient monitoring of patients with chronic conditions or on certain medications. Further, care gaps may occur across a wide range of clinical conditions. We report here an innovative approach to improve patient safety in ambulatory settings - the Kaiser Permanente Southern California (KPSC) Outpatient Safety Net Program - which leverages electronic health information to efficiently identify and address a variety of potential care gaps across different clinical conditions. Between 2006 and 2012, the KPSC Outpatient Safety Net Program implemented 24 distinct electronic clinical surveillance programs, which routinely scan the electronic health record to identify patients with a particular condition or event. For example, electronic clinical surveillance may be used to scan for harmful medication interactions or potentially missed diagnoses (e.g., abnormal test results without evidence of subsequent care). Keys to the success of the program include strong leadership support, a proactive clinical culture, the blame-free nature of the program, and the availability of electronic health information. The Outpatient Safety Net Program framework may be adopted by other organizations, including those who have electronic health information but not an electronic health record. In the future, the creation of a forum to share electronic clinical surveillance programs across organizations may facilitate more rapid improvements in outpatient safety.
    06/2014; 2(1):1056. DOI:10.13063/2327-9214.1056
  • [Show abstract] [Hide abstract]
    ABSTRACT: Background: Errors related to medication seriously affect patient safety and the quality of healthcare. It has been widely argued that various types of such errors may be prevented by introducing Clinical Decision Support Systems (CDSSs) at the point of care. Objectives: Although significant research has been conducted in the field, still medication safety is a crucial issue, while few research outcomes are mature enough to be considered for use in actual clinical settings. In this paper, we present a clinical decision support framework targeting medication safety with major focus on adverse drug event (ADE) prevention. Methods: The novelty of the framework lies in its design that approaches the problem holistically, i.e., starting from knowledge discovery to provide reliable numbers about ADEs per hospital or medical unit to describe their consequences and probable causes, and next employing the acquired knowledge for decision support services development and deployment. Major design features of the framework's services are: a) their adaptation to the context of care (i.e. patient characteristics, place of care, and significance of ADEs), and b) their straightforward integration in the healthcare information technologies (IT) infrastructure thanks to the adoption of a service-oriented architecture (SOA) and relevant standards. Results: Our results illustrate the successful interoperability of the framework with two commercially available IT products, i.e., a Computerized Physician Order Entry (CPOE) and an Electronic Health Record (EHR) system, respectively, along with a Web prototype that is independent of existing healthcare IT products. The conducted clinical validation with domain experts and test cases illustrates that the impact of the framework is expected to be major, with respect to patient safety, and towards introducing the CDSS functionality in practical use. Conclusions: This study illustrates an important potential for the applicability of the presented framework in delivering con- textualized decision support services at the point of care and for making a substantial contribution towards ADE prevention. Nonetheless, further research is required in order to quantitatively and thoroughly assess its impact in medication safety.
    Methods of Information in Medicine 11/2014; 53(6). DOI:10.3414/ME14-01-0027 · 1.08 Impact Factor