Shrinkage Estimators for a Composite Measure of Quality Conceptualized as a Formative Construct

School of Management, Boston University, Boston, MA.
Health Services Research (Impact Factor: 2.78). 06/2012; 48(1). DOI: 10.1111/j.1475-6773.2012.01437.x
Source: PubMed


To demonstrate the value of shrinkage estimators when calculating a composite quality measure as the weighted average of a set of individual quality indicators.
Rates of 28 quality indicators (QIs) calculated from the minimum dataset from residents of 112 Veterans Health Administration nursing homes in fiscal years 2005–2008.
We compared composite scores calculated from the 28 QIs using both observed rates and shrunken rates derived from a Bayesian multivariate normal-binomial model.
Shrunken-rate composite scores, because they take into account unreliability of estimates from small samples and the correlation among QIs, have more intuitive appeal than observed-rate composite scores. Facilities can be profiled based on more policy-relevant measures than point estimates of composite scores, and interval estimates can be calculated without assuming the QIs are independent. Usually, shrunken-rate composite scores in 1 year are better able to predict the observed total number of QI events or the observed-rate composite scores in the following year than the initial year observed-rate composite scores.
Shrinkage estimators can be useful when a composite measure is conceptualized as a formative construct.

3 Reads
  • [Show abstract] [Hide abstract]
    ABSTRACT: Objective: To examine variation in culture change to a person-centered care (PCC) model, and the association between culture change and a composite measure of quality in 107 Department of Veterans Affairs nursing homes. Methods: We examined the relationship between a composite quality measure calculated from 24 quality indicators (QIs) from the Minimum Data Set (that measure unfavorable events), and PCC summary scores calculated from the 6 domains of the Artifact of Culture Change Tool, using 3 different methods of calculating the summary scores. We also use a Bayesian hierarchical model to analyze the relationship between a latent construct measuring extent of culture change and the composite quality measure. Results: Using the original Artifacts scores, the highest performing facility has a 2.9 times higher score than the lowest. There is a statistically significant relationship between the composite quality measure and each of the 3 summary Artifacts scores. Depending on whether original scores, standardized scores, or optimal scores are used, a facility at the 10th percentile in terms of culture change compared with one at the 90th percentile has 8.0%, 8.9%, or 10.3% more QI events. When PCC implementation is considered as a latent construct, 18 low performance PCC facilities have, on an average, 16.3% more QI events than 13 high performance facilities. Conclusions: Our results indicate that culture change to a PCC model is associated with higher Minimum Data Set-based quality. Longitudinal data are needed to better assess whether there is a causal relationship between the extent of culture change and quality.
    Medical care 11/2012; 51(2). DOI:10.1097/MLR.0b013e3182763230 · 3.23 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Background:Composite measures are useful for distilling quality data into summary scores; yet, there has been limited use of composite measures for cancer care.Objective:Compare multiple approaches for generating cancer care composite measures and evaluate how well composite measures summarize dimensions of cancer care and predict survival.Study Design:We computed hospital-level rates for 13 colorectal, lung, and prostate cancer process measures in 59 Veterans Affairs hospitals. We computed 4 empirical-factor (based on an exploratory factor analysis), 3 cancer-specific (colorectal, lung, prostate care), and 3 care modality-specific (diagnosis/evaluation, surgical, nonsurgical treatments) composite measures. We assessed correlations among all composite measures and estimated all-cause survival for colon, rectal, non-small cell lung, and small cell lung cancers as a function of composite scores, adjusting for patient characteristics.Results:Four factors emerged from the factor analysis: nonsurgical treatment, surgical treatment, colorectal early diagnosis, and prostate treatment. We observed strong correlations (r) among composite measures comprised of similar process measures (r=0.58-1.00, P<0.0001), but not among composite measures reflecting different care dimensions. Composite measures were rarely associated with survival.Conclusions:The empirical-factor domains grouped measures variously by cancer type and care modality. The evidence did not support any single approach for generating cancer care composite measures. Weak associations across different care domains suggest that low-quality and high-quality cancer care delivery may coexist within Veterans Affairs hospitals.
    Medical Care 11/2014; 53(1). DOI:10.1097/MLR.0000000000000257 · 3.23 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: To examine effects of workforce characteristics on resident infections in Veterans Affairs (VA) Community Living Centers (CLCs). A 6-year panel of monthly, unit-specific data included workforce characteristics (from the VA Decision Support System and Payroll data) and characteristics of residents and outcome measures (from the Minimum Data Set). A resident infection composite was the dependent variable. Workforce characteristics of registered nurses (RN), licensed practical nurses (LPN), nurse aides (NA), and contract nurses included: staffing levels, skill mix, and tenure. Descriptive statistics and unit-level fixed effects regressions were conducted. Robustness checks varying workforce and outcome parameters were examined. Average nursing hours per resident day was 4.59 hours (SD=1.21). RN tenure averaged 4.7 years (SD=1.64) and 4.2 years for both LPN (SD=1.84) and NA (SD=1.72). In multivariate analyses RN and LPN tenure were associated with decreased infections by 3.8% (incident rate ratio [IRR]=0.962, P<0.01) and 2% (IRR=0.98, P<0.01) respectively. Robustness checks consistently found RN and LPN tenure to be associated with decreased infections. Increasing RN and LPN tenure are likely to reduce CLC resident infections. Administrators and policymakers need to focus on recruiting and retaining a skilled nursing workforce.
    Medical Care 01/2015; 53(3). DOI:10.1097/MLR.0000000000000316 · 3.23 Impact Factor