Comparison of computerized surveillance and manual chart review for adverse events

Department of Biomedical Informatics, University of Utah, Salt Lake City, Utah 84112, USA.
Journal of the American Medical Informatics Association (Impact Factor: 3.57). 07/2011; 18(4):491-7. DOI: 10.1136/amiajnl-2011-000187
Source: PubMed

ABSTRACT To understand how the source of information affects different adverse event (AE) surveillance methods.
Retrospective analysis of inpatient adverse drug events (ADEs) and hospital-associated infections (HAIs) detected by either a computerized surveillance system (CSS) or manual chart review (MCR).
Descriptive analysis of events detected using the two methods by type of AE, type of information about the AE, and sources of the information.
CSS detected more HAIs than MCR (92% vs 34%); however, a similar number of ADEs was detected by both systems (52% vs 51%). The agreement between systems was greater for HAIs than ADEs (26% vs 3%). The CSS missed events that did not have information in coded format or that were described only in physician narratives. The MCR detected events missed by CSS using information in physician narratives. Discharge summaries were more likely to contain information about AEs than any other type of physician narrative, followed by emergency department reports for HAIs and general consult notes for ADEs. Some ADEs found by MCR were detected by CSS but not verified by a clinician.
Inability to distinguish between CSS false positives and suspected AEs for cases in which the clinician did not document their assessment in the CSS.
The effect that information source has on different surveillance methods depends on the type of AE. Integrating information from physician narratives with CSS using natural language processing would improve the detection of ADEs more than HAIs.

1 Bookmark
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The Food and Drug Administration's (FDA) Adverse Event Reporting System (FAERS) is a repository of spontaneously-reported adverse drug events (ADEs) for FDA-approved prescription drugs. FAERS reports include both structured reports and unstructured narratives. The narratives often include essential information for evaluation of the severity, causality, and description of ADEs that are not present in the structured data. The timely identification of unknown toxicities of prescription drugs is an important, unsolved problem. The objective of this study was to develop an annotated corpus of FAERS narratives and biomedical named entity tagger to automatically identify ADE related information in the FAERS narratives. We developed an annotation guideline and annotate medication information and adverse event related entities on 122 FAERS narratives comprising approximately 23,000 word tokens. A named entity tagger using supervised machine learning approaches was built for detecting medication information and adverse event entities using various categories of features. The annotated corpus had an agreement of over .9 Cohen's kappa for medication and adverse event entities. The best performing tagger achieves an overall performance of 0.73 F1 score for detection of medication, adverse event and other named entities. In this study, we developed an annotated corpus of FAERS narratives and machine learning based models for automatically extracting medication and adverse event information from the FAERS narratives. Our study is an important step towards enriching the FAERS data for postmarketing pharmacovigilance.
    01/2014; 2(1):e10. DOI:10.2196/medinform.3022
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Introduction. Anti-tumor necrosis factor (TNF) agents are effective for several immunologic conditions (rheumatoid arthritis (RA), Crohn's disease (CD), and psoriasis). The purpose of this study was to evaluate the efficacy and safety of anti-TNF agents via chart review. Methods. Single-site, retrospective cohort study that evaluated the efficacy and safety of anti-TNF agents in veterans initiated between 2010 and 2011. Primary aim evaluated response at 12 months post-index date. Secondary aims evaluated initial response prior to 12 months post-index date and infection events. Results. A majority of patients were prescribed anti-TNF agents for CD (27%) and RA (24%). Patients were initiated on etanercept (41%), adalimumab (40%), and infliximab (18%) between 2010 and 2011. No differences in patient demographics were reported. Response rates were high overall. Sixty-five percent of etanercept patients, 82% of adalimumab patients, and 59% of infliximab patients were either partial or full responders, respectively. Approximately 16%, 11%, and 12% of etanercept, adalimumab, and infliximab were non-responders, respectively. Infections between the groups were non-significant. Etanercept and adalimumab patients had higher but non-significant odds of being a responder relative to infliximab. Conclusions. Most patients initiated with anti-TNF agent were responders at 12 months follow-up for all indications in a veteran population.
    05/2014; 2:e385. DOI:10.7717/peerj.385
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The measurement and examination of adverse events (AEs) that occur in children during hospital admissions is essential if we are to prevent, reduce or ameliorate the harm experienced. The UK Paediatric Trigger Tool (UKPTT) is a method of retrospective case note review that measures harm in hospitalised children. Objectives: To examine the harm resulting from the processes of healthcare in hospitalised children from centres providing data to the National Health Service (NHS) Institute UKPTT data portal, to understand the positive predictive values of triggers and to make recommendations for the further development of the trigger tool. Setting: 25 hospitals across the UK, including secondary, tertiary and quaternary paediatric centres. Participants: Randomly selected children who were admitted to hospital for longer than 24 h. Outcome measures: The primary outcome measure was the rate of harm (the percentage of children experiencing one or more AEs during a hospital admission). Secondary measures were the severity of harm and performance of triggers. Results: Data from 3992 patient admissions were reviewed across the hospitals and submitted to the trigger tool portal from February 2008 to November 2011. At least one AE was reported for 567 (14.2%) patients, with 211 (5.3%) experiencing more than one event. There were 1001 AEs identified. Where harm occurred, it was considered temporary for 923 (92.2%) AEs; however, 43 (4.3%) AEs resulted in the need for life-sustaining interventions, 18 (1.8%) AEs led to permanent harm and for 17 children (1.7% of AEs) the AE was believed to have contributed to death. Conclusions: There is a significant, measurable level of harm experienced by children admitted to hospitals in the UK. While most of this harm is temporary, some of it is serious. The UKPTT offers organisations the means to measure and examine the AEs occurring in their hospital in order to reduce harm.
    BMJ Open 07/2014; 4(7):e005066. DOI:10.1136/bmjopen-2014-005066 · 2.06 Impact Factor

Full-text (2 Sources)

Available from
Jul 3, 2014