Rare Adverse Medical Events in VA Inpatient Care: Reliability Limits to Using Patient Safety Indicators as Performance Measures

VA Outcomes Group REAP, VA Medical Center, White River Junction, VT 05009, USA.
Health Services Research (Impact Factor: 2.78). 03/2008; 43(1 Pt 1):249-66. DOI: 10.1111/j.1475-6773.2007.00760.x
Source: PubMed


To assess Agency for Healthcare Research and Quality's Patient Safety Indicators (PSIs) as performance measures using Veterans Administration hospitalization data. DATA SOURCES STUDY SETTING: Nine years (1997-2005) of all Veterans Health Administration (VA) administrative hospital discharge data.
Retrospective analysis using diagnoses and procedures to derive annual rates and standard errors for 13 PSIs.
For either hospitals or hospital networks (Veterans Integrated Service Networks [VISNs]), we calculated the percentages whose PSI rates were consistently high or low across years, as well as 1-year lagged correlations, for each PSI. We related our findings to the average annual number of adverse events that each PSI represents. We also assessed time trends for the entire VA, by VISN, and by hospital.
PSI rates are more stable for VISNs than for individual hospitals, but only for those PSIs that reflect the most frequent adverse events. Only the most frequent PSIs yield significant time trends, and only for larger systems.
Because they are so rare, PSIs are not reliable performance measures to compare individual hospitals. The most frequent PSIs are more stable when applied to hospital networks, but needing large patient samples nullifies their potential value to managers seeking to improve quality locally or to patients seeking optimal care.

Download full-text


Available from: James P Bagian, Aug 12, 2014
  • Source

    Health Services Research 10/2008; 43(5 Pt 1):1457-63. DOI:10.1111/j.1475-6773.2008.00903.x · 2.78 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Epidemiologic data on anesthesia-related complications occurring during labor and delivery are essential for measuring and evaluating the safety and quality of obstetric anesthesia care but are lacking. We aimed to fill this research gap by exploring the epidemiologic patterns and risk factors of anesthesia-related complications in a large sample of women giving birth in New York hospitals. Using the Healthcare Cost and Utilization Project State Inpatient Databases files, we identified all discharge records for labor and delivery from New York hospitals between 2002 and 2005. We then identified women who experienced any recorded anesthesia-related complication during labor and delivery as determined by International Classification of Diseases, Ninth Revision, Clinical Modification codes. The incidence of anesthesia-related complications was calculated by demographic and clinical characteristics. Multivariate logistic regression was performed to assess risk factors of anesthesia-related complications. Of the 957,471 deliveries studied, 4438 (0.46%) had at least one anesthesia-related complication. The majority (55%) of anesthesia-related events occurring during labor and delivery were spinal complications, followed by systemic complications (43%) and overdose or adverse effects (2%). Multivariate logistic regression revealed five risk factors of anesthesia-related complications: cesarean delivery (odds ratio [OR] 2.51, 95% confidence interval [CI] 2.36-2.68), rural area (OR 1.33, 95% CI 1.21-1.46), Charlson-Deyo Comorbidity Index >or=1 (OR 1.47, 95% CI 1.28-1.69), Caucasian race (OR 1.37, 95% CI 1.24-1.52), and scheduled admission (OR 1.10, 95% CI 1.03-1.18). Anesthesia-related complications were associated with about a one-day increase in the average length of stay (3.89 +/- 3.69 [mean +/- SD] days vs 2.92 +/- 2.38 days for deliveries without anesthesia-related complications, P < 0.0001) and a 22-fold increased risk of maternal mortality (OR 22.26, 95% CI 11.20-44.24). The incidence of anesthesia-related complications during labor and delivery seems to be low but remains a cause of concern, particularly in women undergoing cesarean delivery, living in rural areas, or having preexisting medical conditions.
    Anesthesia and analgesia 10/2009; 109(4):1174-81. DOI:10.1213/ane.0b013e3181b2ef75 · 3.47 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: to examine the effects of the present on admission (POA) indicator on the prevalence of and factors associated with postsurgical adverse events in older patients. this is a secondary data analysis of 82,898 surgical patients aged 65 years or older in 252 acute care hospitals in California in 2004. Four adverse events were counted using the Agency for Healthcare Research and Quality's Patient Safety Indicator (PSI) definitions with and without using the POA indicator. We also examined the effects of the POA indicator on the relationships between patient- and hospital-level factors and adverse events, using generalized linear mixed models. the use of the POA indicator resulted in a marked reduction in the estimated rates of all 4 adverse event rates. Adjustment for POA conditions also influenced factors associated with adverse events. Compared with those with newly occurring adverse events only, admissions with only POA conditions were more likely to be admitted through the emergency department, be unplanned, and belong to patients with one or more preceding admissions or those with multiple admissions within the same year. adverse event rates estimated from discharge abstracts using PSI methodology could be overstated when the POA indicator was not used. The POA indicator could influence predictors of adverse events. Studies on geriatric safety and outcomes using large administrative data sets should consider using the POA indicator. Further studies are needed on how to determine POA conditions.
    The Gerontologist 12/2010; 50(6):810-20. DOI:10.1093/geront/gnq045 · 3.21 Impact Factor
Show more