Comparing Web-based with Mail Survey Administration of the Consumer Assessment of Healthcare Providers and Systems (CAHPS(®)) Clinician and Group Survey

Allina Health, Mail route 10307, Minneapolis, Minnesota, USA.
Primary health care : open access 04/2013; 3. DOI: 10.4172/2167-1079.1000132
Source: PubMed


The CAHPS(®) survey instruments are widely used to assess patient experiences with care but there is limited information about web-based data collection with them.
To compare web-based data collection with standard mail survey mode of collection of CAHPS(®) Clinician and Group survey data.
We randomized mode of data collection (web versus mail) of the CAHPS(®) Clinician and Group Survey to patients who had visited one of six clinics over a four-month period in Minnesota. A total of 410 patients responded to the web-based survey (14% response rate) and 982 patients responded to the mail survey (33% response rate).
Responses to CAHPS(®) survey dimensions and individual question responses, response rates, and participant characteristics.
There were no significant differences in CAHPS(®) survey composites and individual question responses by mode, except for those addressing access. Those responding via the web reported less positive experiences with access to an appointment for urgent care as soon as needed, getting an appointment for routine care as soon as needed, getting answers to medical questions as soon as needed, and follow-up on test results (t's=-3.64, -7.15, -2.58, -2.23; p's=0.0003, <0.0001, 0.01, 0.03, respectively). Web respondents had more positive experiences about office wait time for the most recent visit (t = 2.32, p=0.021). Those who participated in the study tended to be older than those that did not (ƛ(2)=247.51, df=8, p<0.0001 for mail; ƛ(2)= 4.56, df=8, p<0.0001 for the web). Females were significantly more likely than males to respond to the survey overall (24% vs. 18%, ƛ(2)=6.45, 1 df, p=0.011) and relatively more likely than males to respond to web (15% vs. 13%, ƛ(2)=1.32, 1 df, p=0.25) than mail (34% vs. 30%, ƛ(2)=5.42, 1 df, p=0.02). Mail respondents were more likely than web respondents to be male (28% versus 18%, ƛ(2)=16.27, 1 df, p<0.0001) and older (27% of the mail respondents and 19% of the web respondents were 65 or older, ƛ(2)=10.88, 1 df, p=0.001). Costs of web-based surveys were less than mailed surveys and were returned more quickly than mailed surveys. The correlations between reports and ratings of clinicians and clinics by mode were unreliable because of the relatively small number of web responses.
Web-based surveys yielded comparable results to mail (except for questions addressing access) more quickly at lower costs. The low response rates in this study are a concern although this was not intended as a test of increasing response rates. Strategies to increase response rates will be a key element of web-based data collection. The differences in costs will be an incentive for organizations to continue to pursue web-based surveying. Further studies are needed to evaluate the generalizability of the results of this one.

Download full-text


Available from: Tracy Laibson, Mar 25, 2015
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: In an informative article on the assessment of patient care experiences, Zimlichman, Rozenblum, and Millenson describe the evolving use of surveys that elicit patient reports about medical care experiences in Israel, a trend that parallels developments in the U.S. This commentary summarizes some of experiences in the U.S. that might inform the development of more consistent and extensive strategies for assessing and promoting patient-centered care in Israel. More comprehensive patient experience surveys, the results of which would be publicly available, as Zimlichman and colleagues advocate, would facilitate quality improvements, especially if users are provided with support for the use and interpretation of the data. Developing more efficient survey methods will facilitate the broader use of such surveys, although it is important to use methods that yield results that are as representative of the target population as possible and to account for survey mode effects when data are reported. Although the surveys need to be appropriate for the Israeli context, the use of standard questions used in other countries would facilitate comparisons that could help to identify best practices that can be adopted in different settings. Those who work on assessing patient-centered care in the U.S. look forward to learning from the work of their Israeli colleagues. This is a commentary on
    Full-text · Article · Sep 2013 · Israel Journal of Health Policy Research
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: In the Netherlands, human papillomavirus (HPV) vaccination is part of a national program equally accessible for all girls invited for vaccination. To assess possible inequalities in vaccine uptake, we investigated differences between vaccinated and unvaccinated girls with regard to various characteristics, including education and ethnicity, (both associated with non-attendance to the national cervical screening program), sexual behaviour and knowledge of HPV. In 2010, 19,939 nationwide randomly-selected 16-17 year-old girls (2009 vaccination campaign) were invited to fill out an online questionnaire. A knowledge scale score and multivariable analyses identified variables associated with vaccination status. 2989 (15%) of the selected girls participated (65% vaccinated, 35% unvaccinated). The participants were comparable with regard to education, ethnicity, most sexual risk behaviour and had similar knowledge scores on HPV transmission and vaccination. However, unvaccinated girls lived in more urbanised areas and were more likely to have a religious background. Irrespective of vaccination status, 81% of the girls were aware of the causal relationship between HPV and cervical cancer, but the awareness of the necessity of cervical screening despite being vaccinated was limited. HPV vaccine uptake was not associated with knowledge of HPV and with factors that are known to be associated with non-attendance to the cervical cancer screening program in the Netherlands. Furthermore, most sexual behaviour was not related to vaccination status meaning that teenage unvaccinated girls were not at a disproportionally higher risk of being exposed to HPV. Routine HPV vaccination may reduce the social inequity of prevention of cervical cancer.
    Full-text · Article · Mar 2014 · BMC Public Health
  • [Show abstract] [Hide abstract]
    ABSTRACT: An evaluation scale of medical services quality was developed on the basis of "patients' experience". The questionnaires were developed by, among others, searching relevant literature, collecting well-established assessment scales, measuring patients' experience and satisfaction, brain-storming, literature analysis. Delphi method was adopted for expert consultation. Scale items were screened and revised. The key indexes were converted. Field surveys were conducted for testing the reliability and validity of the scale. Our modified evaluation scale for measuring medical services quality based on "patients' experience" included 6 dimensions (tangibility, reliability, responsiveness, assurance, empathy and continuity), and 50 items. The novel scale based on "patients' experience" may better serve the purpose of assessing medical services quality.
    No preview · Article · Apr 2014 · Journal of Huazhong University of Science and Technology
Show more