Evaluation of the agency for healthcare research and quality pediatric quality indicators.

Division of Pediatric Critical Care, Medical College of Wisconsin, Milwaukee, Wisconsin, USA.
PEDIATRICS (Impact Factor: 5.3). 07/2008; 121(6):e1723-31. DOI: 10.1542/peds.2007-3247
Source: PubMed

ABSTRACT Pediatric quality indicators were developed in 2006 by the Agency for Healthcare Research and Quality to identify potentially preventable complications in hospitalized children. Our objectives for this study were to (1) apply these algorithms to an aggregate children's hospital's discharge abstract database, (2) establish rates for each of the pediatric quality indicator events in the children's hospitals, (3) use direct chart review to investigate the accuracy of the pediatric quality indicators, (4) calculate the number of complications that were already present on admission and, therefore, not attributable to the specific hospitalization, and (5) evaluate preventability and calculate positive predictive value for each of the indicators. In addition, we wanted to use the data to set priorities for ongoing clinical investigation.
The Agency for Healthcare Research and Quality pediatric quality indicator algorithms were applied to 76 children's hospital's discharge abstract data (1794675 discharges) from 2003 to 2005. Rates were calculated for 11 of the pediatric quality indicators from all 3 years of discharge data: accidental puncture or laceration, decubitus ulcer, foreign body left in during a procedure, iatrogenic pneumothorax in neonates at risk, iatrogenic pneumothorax in nonneonates, postoperative hemorrhage or hematoma, postoperative respiratory failure, postoperative sepsis, postoperative wound dehiscence, selected infections caused by medical care, and transfusion reaction. Subsequently, clinicians from 28 children's hospitals reviewed 1703 charts in which complications had been identified. They answered questions as to correctness of secondary diagnoses that were associated with the indicator, whether a complication was already present on admission, and whether that complication was preventable, nonpreventable, or uncertain.
Across 3 years of data the rates of pediatric quality indicators ranged from a low of 0.01/1000 discharges for transfusion reaction to a high of 35/1000 for postoperative respiratory failure, with a median value of 1.85/1000 for the 11 pediatric quality indicators. Indicators were often already present on admission and ranged from 43% for infection caused by medical care to 0% for iatrogenic pneumothorax in neonates, with a median value of 16.9%. Positive predictive value for the subset of pediatric quality indicators occurring after admission was highest for decubitus ulcer (51%) and infection caused by medical care (40%). Because of the very large numbers of cases identified and its low preventability, the indicator postoperative respiratory failure is particularly problematic. The initial definition includes all children on ventilators postoperatively for >4 days with few exclusions. Being on a ventilator for 4 days would be a normal occurrence for many children with extensive surgery; therefore, the majority of the time does not indicate a complication and makes the indicator inappropriate.
A subset of pediatric quality indicators derived from administrative data are reasonable screening tools to help hospitals prioritize chart review and subsequent improvement projects. However, in their present form, true preventability of these complications is relatively low; therefore, the indicators are not useful for public hospital comparison. Identifying which complications are present on admission versus those that occur within the hospitalization will be essential, along with adequate risk adjustment, for any valid comparison between institutions. Infection caused by medical care and decubitus ulcers are clinically important indicators once the present-on-admission status is determined. These complications cause significant morbidity in hospitalized children, and research has shown a high level of preventability. The pediatric quality indicator software can help children's hospitals objectively review their cases and target improvement activities appropriately. The postoperative-respiratory-failure indicator does not represent a complication in the majority of cases and, therefore, should not be included for hospital screening or public comparison. Chart review should become part of the development process for quality indicators to avoid inappropriate conclusions that misdirect quality-improvement resources.

1 Bookmark
  • [Show abstract] [Hide abstract]
    ABSTRACT: The purpose of this study was to examine risk-adjusted associations between race and gender on postoperative morbidity, mortality, and resource utilization in pediatric surgical patients within the United States. 101,083 pediatric surgical patients were evaluated using the U.S. national KID Inpatient Database (2003 and 2006): appendectomy (81.2%), pyloromyotomy (9.8%), intussusception (6.2%), decortication (1.9%), congenital diaphragmatic hernia repair (0.7%), and colonic resection for Hirschsprung's disease (0.2%). Patients were stratified according to gender (male: 63.1%, n=63,783) and race: white (n=58,711), Hispanic (n=26,118), black (n=9,103), Asian (n=1,582), Native American (n=474), and other (n=5,096). Multivariable logistic regression modeling was utilized to evaluate risk-adjusted associations between race, gender, and outcomes. After risk adjustment, race was independently associated with in-hospital death (p=0.02), with an increased risk for black children. Gender was not associated with mortality (p=0.77). Postoperative morbidity was significantly associated with gender (p<0.001) and race (p=0.01). Gender (p=0.003) and race (p<0.001) were further associated with increased hospital length of stay. Importantly, these results were dependent on operation type. Race and gender significantly affect postoperative outcomes following pediatric surgery. Black patients are at disproportionate risk for postoperative mortality, while black and Hispanic patients have increased morbidity and hospital resource utilization. While gender does not affect mortality, gender is a determinant of both postoperative morbidity and increased resource utilization.
    Journal of Pediatric Surgery 08/2013; 48(8):1650-6. · 1.31 Impact Factor
  • Research in Social and Administrative Pharmacy 05/2013; 9(3):237-239. · 2.35 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: PURPOSE: /st>The purposes were to find and synthesize available literature on explicit or implicit standards for the design and conduct of a national activity that involves measuring and facilitating improvement of the quality of patient care, such as a national clinical audit or a quality improvement (QI) study, and to develop proposed standards for the design and conduct of the national activity. DATA SOURCES: selection and analysisThe literature was searched to identify key aspects of good practice in the conduct of national or international clinical audits, QI studies, performance or quality indicator measurements or equivalent national initiatives that have the purpose of driving improvement in the quality of care provided in a healthcare system. Key aspects of good practice in design or operation of these activities were abstracted from the literature, and organized logically into standard statements according to the stages in the design or conduct of such an activity. RESULTS: /st>Thirty standards for the design and conduct of a national clinical audit or QI study were derived from the published literature. The standards are on structural, process and outcome aspects of any national activity that involves measuring and improving healthcare services. Most of the standards focus on measurement processes. CONCLUSION: /st>It is hoped that these proposed standards for a national clinical audit or QI study will facilitate debate on how to assure the quality of these national activities. Activities that meet accepted standards may be more effective in influencing participating sites to achieve improvements in the quality of care.
    International Journal for Quality in Health Care 05/2013; · 1.79 Impact Factor