Validity of Selected AHRQ Patient Safety Indicators Based on VA National Surgical Quality Improvement Program Data

UC Davis Division of General Medicine and Center for Healthcare Policy and Research, 4150 V Street, PSSB Suite 2400, Sacramento, CA 95817, USA.
Health Services Research (Impact Factor: 2.49). 10/2008; 44(1):182-204. DOI: 10.1111/j.1475-6773.2008.00905.x
Source: PubMed

ABSTRACT To examine the criterion validity of the Agency for Health Care Research and Quality (AHRQ) Patient Safety Indicators (PSIs) using clinical data from the Veterans Health Administration (VA) National Surgical Quality Improvement Program (NSQIP).
Fifty five thousand seven hundred and fifty two matched hospitalizations from 2001 VA inpatient surgical discharge data and NSQIP chart-abstracted data.
We examined the sensitivities, specificities, positive predictive values (PPVs), and positive likelihood ratios of five surgical PSIs that corresponded to NSQIP adverse events. We created and tested alternative definitions of each PSI.
FY01 inpatient discharge data were merged with 2001 NSQIP data abstracted from medical records for major noncardiac surgeries.
Sensitivities were 19-56 percent for original PSI definitions; and 37-63 percent using alternative PSI definitions. PPVs were 22-74 percent and did not improve with modifications. Positive likelihood ratios were 65-524 using original definitions, and 64-744 using alternative definitions. "Postoperative respiratory failure" and "postoperative wound dehiscence" exhibited significant increases in sensitivity after modifications.
PSI sensitivities and PPVs were moderate. For three of the five PSIs, AHRQ has incorporated our alternative, higher sensitivity definitions into current PSI algorithms. Further validation should be considered before most of the PSIs evaluated herein are used to publicly compare or reward hospital performance.

Download full-text


Available from: Patrick S Romano, Aug 27, 2015
1 Follower
  • Source
    • "g fusion surgery has not been rigorously validated through a comparison of chart reviews . However , readmission , infections , mortality , and life - threaten - ing complications are part of the National Surgical Quality Improvement Program ( NSQIP ) , which has been used as the gold standard to improve the validity of patient safety indicators ( Romano et al . 2009 ) . Furthermore , our estimates for repeat surgery and mortality following fusion surgery are similar to those reported in both administrative and clinical studies ( Malter et al . 1998 ; Martin et al . 2007 , 2011 ; Juratli et al . 2009 ) . Future research efforts should focus on the validation and improvement of claims - based methods"
    [Show abstract] [Hide abstract]
    ABSTRACT: OBJECTIVE: To identify factors that account for variation in complication rates across hospitals and surgeons performing lumbar spinal fusion surgery. DATA SOURCES: Discharge registry including all nonfederal hospitals in Washington State from 2004 to 2007. STUDY DESIGN: We identified adults (n = 6,091) undergoing an initial inpatient lumbar fusion for degenerative conditions. We identified whether each patient had a subsequent complication within 90 days. Logistic regression models with hospital and surgeon random effects were used to examine complications, controlling for patient characteristics and comorbidity. PRINCIPAL FINDINGS: Complications within 90 days of a fusion occurred in 4.8 percent of patients, and 2.2 percent had a reoperation. Hospital effects accounted for 8.8 percent of the total variability, and surgeon effects account for 14.4 percent. Surgeon factors account for 54.5 percent of the variation in hospital reoperation rates, and 47.2 percent of the variation in hospital complication rates. The discretionary use of operative features, such as the inclusion of bone morphogenetic proteins, accounted for 30 and 50 percent of the variation in surgeons' reoperation and complication rates, respectively. CONCLUSIONS: To improve the safety of lumbar spinal fusion surgery, quality improvement efforts that focus on surgeons' discretionary use of operative techniques may be more effective than those that target hospitals.
    Health Services Research 06/2012; 48(1). DOI:10.1111/j.1475-6773.2012.01434.x · 2.49 Impact Factor
  • Source
  • [Show abstract] [Hide abstract]
    ABSTRACT: This paper presents the maximum likelihood estimate of the time delay between two signals with random relative phase shift. The analysis applies for both broad-band and narrowband signals and incorporates a parametric representation of the spread of the phase variation which allows the examination of all cases ranging from uniformly distributed phase shift to known phase shift. A realization of the ML estimator is presented which illustrated the difference between optimum processing for random phase shift and no phase shift. The Cramer-Rao bound is also derived and the performance degradation is discussed.
    Acoustics, Speech, and Signal Processing, IEEE International Conference on ICASSP '81.; 05/1981
Show more