Improving American College of Surgeons National Surgical Quality Improvement Program Risk Adjustment: Incorporation of a Novel Procedure Risk Score

Division of Research and Optimal Patient Care, American College of Surgeons, Chicago, IL 60611-3211, USA.
Journal of the American College of Surgeons (Impact Factor: 4.45). 12/2010; 211(6):715-23. DOI: 10.1016/j.jamcollsurg.2010.07.021
Source: PubMed

ABSTRACT Risk-adjusted evaluation is a key component of the American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP). The purpose of this study was to improve standard ACS NSQIP risk adjustment using a novel procedure risk score.
Current Procedural Terminology codes (CPTs) represented in ACS NSQIP data were assigned to 136 procedure groups. Log odds predicted risk from preliminary logistic regression modeling generated a continuous risk score for each procedure group, used in subsequent modeling. Appropriate subsets of 271,368 patients in the 2008 ACS NSQIP were evaluated using logistic models for overall 30-day morbidity, 30-day mortality, and surgical site infection (SSI). Models were compared when including either work Relative Value Unit (RVU), RVU and the standard ACS NSQIP CPT range variable (CPT range), or RVU and the newly constructed CPT risk score (CPT risk), plus routine ACS NSQIP predictors.
When comparing the CPT risk models with the CPT range models for morbidity in the overall general and vascular surgery dataset, CPT risk models provided better discrimination through higher c statistics at earlier steps (0.81 by step 3 vs 0.81 by step 46), more information through lower Akaike's information criterion (127,139 vs 130,019), and improved calibration through a smaller Hosmer-Lemeshow chi-square statistic (48.76 vs 116.79). Improved model characteristics of CPT risk over CPT range were most apparent for broader patient populations and outcomes. The CPT risk and standard CPT range models were moderately consistent in identification of outliers as well as assignment of hospitals to quality deciles (weighted kappa ≥ 0.870).
Information from focused, clinically meaningful CPT procedure groups improves the risk estimation of ACS NSQIP models.

1 Follower
  • [Show abstract] [Hide abstract]
    ABSTRACT: The relationship between timing of postoperative complications on mortality is unknown. We investigated the time-variable mortality risks of common surgical complications.
    Journal of Surgical Research 08/2014; 193(1). DOI:10.1016/j.jss.2014.08.025 · 2.12 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Background. Most studies and national programs aggregate the different types of surgical site infections (SSIs) potentially masking and misattributing risk. Determining that risk factors for superficial, deep, and organ space SSIs are unique is essential to improve SSI rates. Methods. This cohort study utilized data of 59,365 patients who underwent colon resection at hospitals participating in the American College of Surgeons National Surgical Quality Improvement Program from 2007 to 2009. Four independent, multivariable, predictive models were developed to assess the unique associations between risk factors and each SSI group: Superficial, deep, organ space, and an aggregate of all 3 types of SSIs. Results. Overall, 13% of colon cases developed SSIs: Superficial (8%), deep (1.4%), and organ space (3.8%). Each model was different. Morbidly obese patients were more likely to develop SSIs than normal weight patients across all models; however, risk factors common to all models (eg, body mass index [BMI], duration of operation, wound class, laparoscopic approach) had very different levels of risk. Unique risks for superficial SSIs include diabetes, chronic obstructive pulmonary disease, and dyspnea. Deep SSIs had the greatest magnitude of association with BMI and the greatest incidence of wound disruption (19.8%). Organ space SSIs were often owing to anastomotic leaks and were uniquely associated with disseminated cancer, preoperative dialysis, preoperative radiation treatment, and a bleeding disorder, suggesting a physically frail or compromised patient may put the anastomosis at risk. Conclusion. Risk factors for superficial, deep, and organ space SSI differ. More effective prevention strategies may be developed by reporting and examining each type of SSI separately.
    Surgery 08/2014; 156(5). DOI:10.1016/j.surg.2014.05.010 · 3.11 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Background. We sought to identify risks for 30-day readmission in patients undergoing colorectal surgery. Methods. We reviewed 2011 American College of Surgery National Surgical Quality Improvement Program data to identify patients readmitted after colorectal surgery. We found 3,228 readmissions from 30,412 records. Using statistically suggestive variables from logistic regression (P < .1), we built conditional inference trees (CTREES) with subsampled records to identify combined risks. Results. Logistic regression identified 27 potentially significant variables. Using these in new logistic regression and CTREES, we found classification accuracies of 0.70 and 0.63, respectively. CTREES predicted that the majority of patients who required reoperation during their hospitalization were predicted to require readmission (n = 496), along with the majority of patients who developed organ space infection (n = 671). Patients with deep infections discharged pound 10 days from their index operation required readmission in 443 of 459 of records; this approach predicted a >99% risk of readmission in patients with these infections who were discharged 5 pound days (220/222). Additionally, >90% (253/271) of patients who returned to the operating room and were discharged 8 pound days from the first operation are predicted to return. Conclusion. Subgroups identified using the CTREES model demonstrate that patients with deep space infections or who return to the operating room have a greater readmission rate if they are discharged early. Modeled patients found to have organ space infections and who returned to the operating room had 30-day readmission risks of >50%, with those discharged a rate of >90%. We show herein that CTREES can be used with retrospective data on surgery populations to bring hidden patterns into relief.
    Surgery 10/2014; 156(4):842-8. DOI:10.1016/j.surg.2014.07.020 · 3.11 Impact Factor