Does methodology affect the ability to monitor tobacco control activities? Implications for HEDIS and other performance measures

Harvard University, Cambridge, Massachusetts, United States
Preventive Medicine (Impact Factor: 3.09). 08/2003; 37(1):33-40. DOI: 10.1016/S0091-7435(03)00054-9
Source: PubMed


It is unclear whether methodological differences in sample size, survey methods, and analysis approach significantly affect the ability to accurately monitor tobacco control activities and to make rate comparisons.
Questionnaires were sent to 64,764 members of nine health plans in diverse settings soon after their visit to a primary care clinician. Of these 41,677 completed responses were received. We compared responses received by mail and by telephone follow-up for the percentage of smokers, characteristics of smokers, and their rates of reporting physician cessation counseling.
Overall, 10.2% were current cigarette smokers, but the proportion was 8.6% for mail responders and 17.2% for phone follow-up responders. Smokers identified by phone follow-up were different from mail responders in most demographic and smoking characteristics and their reports of clinical smoking cessation activities differed for six of nine clinician smoking cessation actions. Calculating advice rates as a proportion of visits produced lower rates with more dispersion among plan rates than doing so without accounting for visit variation.
Smoking surveys using only mailed questionnaires dramatically undersample smokers, especially in some demographic groups. Comparisons of tobacco counseling among health plans can be improved by ensuring an adequate sample size and response rate and by analyzing by frequency of quit advice.

8 Reads
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: This report examines the experiences of five provider organizations in developing, testing, and implementing quality-of-care indicators, based on data collected from their electronic health record (EHR) systems. HealthPartners used the EHR to compile blood pressure measurements, Park Nicollet Health Services developed a composite measure for care of people with diabetes, Billings Clinic tested an automatic alert on potential interactions between antibiotics and the anticoagulant warfarin, Kaiser Permanente used a natural-language processing tool for counseling about tobacco use, and Geisinger Health System explored ways of reconciling Problem Lists and provider-visit notes regarding high-impact chronic-disease diagnoses. Common themes emerged from these case studies. They included challenges—of ensuring the validity and reliability of data, efficient workflow, and staff support—but the providers' successes in implementing their respective EHR-based quality measures demonstrated that such measures are adaptable to different EHR systems, amenable to improvement, and worth pursuing.
  • Source

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: To use physician reports to evaluate their awareness of health plan tobacco control guidelines and cessation support coverage and to validate the extent to which health plan cessation support material had been disseminated and implemented in clinical settings. Comparison of survey responses of physicians with tobacco control activities reported by key informants in the health plans with which those physicians were associated. A total of 100 primary care physicians in the care delivery organizations associated with 9 nonprofit health plans were randomly selected to receive a survey asking about their health plan's tobacco cessation guidelines, coverage, and support for clinician action. Their responses were compared to data reported by the plan with which they were associated. Responses were obtained from 91%. Although 88% were aware of their health plan's tobacco cessation guidelines, considerably fewer were correctly aware of whether the health plan covered medications and cessation classes or counseling. Physician reports of cessation supports during care bore little relationship to health plan reports of those supports. Physician reports may be a useful way to verify health plan dissemination and implementation of tobacco control activities. Even these relatively high-performing plans have ample room for further improvement.
    The American journal of managed care 04/2004; 10(3):193-8. · 2.26 Impact Factor
Show more