Hospital performance reports based on severity adjusted mortality rates in patients with cirrhosis depend on the method of risk adjustment

Liver Unit, Division of Gastroenterology and Hepatology, Department of Medicine, University of Calgary, Alberta, Canada.
Annals of hepatology: official journal of the Mexican Association of Hepatology (Impact Factor: 2.19). 07/2012; 11(4):526-35.
Source: PubMed

ABSTRACT Hospital outcome report cards are used to judge provider performance, including for liver transplantation. We aimed to determine the impact of the choice of risk adjustment method on hospital rankings based on mortality rates in cirrhotic patients.
We identified 68,426 cirrhotic patients hospitalized in the Nationwide Inpatient Sample database. Four risk adjustment methods (the Charlson/Deyo and Elixhauser algorithms, Disease Staging, and All Patient Refined Diagnosis Related Groups) were used in logistic regression models for mortality. Observed to expected (O/E) death rates were calculated for each method and hospital. Statistical outliers with higher or lower than expected mortality were identified and rankings compared across methods.
Unadjusted mortality rates for the 553 hospitals ranged from 1.4 to 30% (overall, 10.6%). For 163 hospitals (29.5%), observed mortality differed significantly from expected when judged by one or more, but not all four, risk adjustment methods (25.9% higher than expected mortality and 3.6% lower than expected mortality). Only 28% of poor performers and 10% of superior performers were consistently ranked as such by all methods. Agreement between methods as to whether hospitals were flagged as outliers was moderate (kappa 0.51-0.59), except the Charlson/Deyo and Elixhauser algorithms which demonstrated excellent agreement (kappa 0.75).
Hospital performance reports for patients with cirrhosis require sensitivity to the method of risk adjustment. Depending upon the method, up to 30% of hospitals may be flagged as outliers by one, but not all methods. These discrepancies could have important implications for centers erroneously labeled as high mortality outliers.

1 Follower
  • [Show abstract] [Hide abstract]
    ABSTRACT: International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes capture comorbidities that can be used to risk adjust nonrandom patient groups. We explored the accuracy of capturing comorbidities associated with one risk adjustment method, the Elixhauser Comorbidity Measure (ECM), in patients with chronic heart failure (CHF) at one Veterans Affairs (VA) medical center. We explored potential reasons for the differences found between the original codes assigned and conditions found through retrospective review. This descriptive, retrospective study used a cohort of patients discharged with a principal diagnosis coded as CHF from one VA medical center in 2003. One admission per patient was used in the study; with multiple admissions, only the first admission was analyzed. We compared the assignment of original codes assigned to conditions found in a retrospective, manual review of the medical record conducted by an investigator with coding expertise as well as by physicians. Members of the team experienced with assigning ICD-9-CM codes and VA coding processes developed themes related to systemic reasons why chronic conditions were not coded in VA records using applied thematic techniques. In the 181-patient cohort, 388 comorbid conditions were identified; 305 of these were chronic conditions, originally coded at the time of discharge with an average of 1.7 comorbidities related to the ECM per patient. The review by an investigator with coding expertise revealed a total of 937 comorbidities resulting in 618 chronic comorbid conditions with an average of 3.4 per patient; physician review found 872 total comorbidities with 562 chronic conditions (average 3.1 per patient). The agreement between the original and the retrospective coding review was 88 percent. The kappa statistic for the original and the retrospective coding review was 0.375 with a 95 percent confidence interval (CI) of 0.352 to 0.398. The kappa statistic for the retrospective coding review and physician review was 0.849 (CI, 0.823-0.875). The kappa statistic for the original coding and the physician review was 0.340 (CI, 0.316-0.364). Several systemic factors were identified, including familiarity with inpatient VA and non-VA guidelines, the quality of documentation, and operational requirements to complete the coding process within short time frames and to identify the reasons for movement within a given facility. Comorbidities within the ECM representing chronic conditions were significantly underrepresented in the original code assignment. Contributing factors potentially include prioritization of codes related to acute conditions over chronic conditions; coders' professional training, educational level, and experience; and the limited number of codes allowed in initial coding software. This study highlights the need to evaluate systemic causes of underrepresentation of chronic conditions to improve the accuracy of risk adjustment used for health services research, resource allocation, and performance measurement.
    Perspectives in health information management / AHIMA, American Health Information Management Association 01/2013; 10:1b.
  • [Show abstract] [Hide abstract]
    ABSTRACT: Little is known about geographic variations in health care for patients with cirrhosis. We studied geographic and hospital-level variations in care of patients with cirrhosis in the United States (US), using inpatient mortality as an outcome for comparing hospitals. We also aimed to identify features of patients and hospitals associated with lower mortality.
    Clinical Gastroenterology and Hepatology 09/2014; 13(3). DOI:10.1016/j.cgh.2014.09.038 · 6.53 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Severe alcoholic hepatitis (AH) is associated with a substantial risk for short-term mortality. To identify prognostic factors and validate well-known prognostic models in a Canadian population of patients hospitalized for AH. In the present retrospective study, patients hospitalized for AH in Calgary, Alberta, between January 2008 and August 2012 were included. Stepwise logistic regression models identified independent risk factors for 90-day mortality, and the discrimination of prognostic models (Model for End-stage Liver Disease [MELD] and Maddrey discriminant function [DF]) were examined using areas under the ROC curves. A total of 122 patients with AH were hospitalized during the study period; the median age was 49 years (interquartile range [IQR] 42 to 55 years) and 60% were men. Median MELD score and Maddrey DF on admission were 21 (IQR 18 to 24) and 45 (IQR 26 to 62), respectively. Seventy-three percent of patients received corticosteroids and⁄or pentoxifylline, and the 90-day mortality was 17%. Independent predictors of mortality included older age, female sex, international normalized ratio, MELD score and Maddrey DF (all P<0.05). For discrimination of 90-day mortality, the areas under the ROC curves of the prognostic models (MELD 0.64; Maddrey DF 0.68) were similar (P>0.05). At optimal cut-offs of ≥22 for MELD score and ≥37 for Maddrey DF, both models excluded death with high certainty (negative predictive values 90% and 96%, respectively). In patients hospitalized for AH, well-known prognostic models can be used to predict 90-day mortality, particularly to identify patients with a low risk for death.
    04/2015; 29(3):131-8.