Representativeness of the Patient-Reported Outcomes Measurement Information System Internet panel

UCLA Department of Medicine, Division of General Internal Medicine & Health Services Research, University of California-Los Angeles, 911 Broxton Plaza, Los Angeles, CA 90095, USA.
Journal of clinical epidemiology (Impact Factor: 5.48). 11/2010; 63(11):1169-78. DOI: 10.1016/j.jclinepi.2009.11.021
Source: PubMed

ABSTRACT To evaluate the Patient-Reported Outcomes Measurement Information System (PROMIS), which collected data from an Internet polling panel, and to compare PROMIS with national norms.
We compared demographics and self-rated health of the PROMIS general Internet sample (N=11,796) and one of its subsamples (n=2,196) selected to approximate the joint distribution of demographics from the 2000 U.S. Census, with three national surveys and U.S. Census data. The comparisons were conducted using equivalence testing with weights created for PROMIS by raking.
The weighted PROMIS population and subsample had similar demographics compared with the 2000 U.S. Census, except that the subsample had a higher percentage of people with higher education than high school. Equivalence testing shows similarity between PROMIS general population and national norms with regard to body mass index, EQ-5D health index (EuroQol group defined descriptive system of health-related quality of life states consisting of five dimensions including mobility, self-care, usual activities, pain/discomfort, anxiety/depression), and self-rating of general health.
Self-rated health of the PROMIS general population is similar to that of existing samples from the general U.S. population. The weighted PROMIS general population is more comparable to national norms than the unweighted population with regard to subject characteristics. The findings suggest that the representativeness of the Internet data is comparable to those from probability-based general population samples.

Download full-text


Available from: Richard Gershon, Jul 26, 2015
  • Source
    • "At the end of each of the four weeks, these 3 domains were assessed with PROMIS CATs that were set to administer no less than 4 and no more than 12 items and to terminate when N.90 score reliability (SE b 3 T-score points) was achieved. The scores are reported on a T-score metric (mean = 50; standard deviation = 10) that is anchored to the distribution of scores in the U.S. general population [25] [26]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: This study examined the ecological validity and clinical utility of NIH Patient Reported-Outcomes Measurement Information System (PROMIS®) instruments for anger, depression, and fatigue in women with premenstrual symptoms. One-hundred women completed daily diaries and weekly PROMIS assessments over 4weeks. Weekly assessments were administered through Computerized Adaptive Testing (CAT). Weekly CATs and corresponding daily scores were compared to evaluate ecological validity. To test clinical utility, we examined if CATs could detect changes in symptom levels, if these changes mirrored those obtained from daily scores, and if CATs could identify clinically meaningful premenstrual symptom change. PROMIS CAT scores were higher in the pre-menstrual than the baseline (ps<.0001) and post-menstrual (ps<.0001) weeks. The correlations between CATs and aggregated daily scores ranged from .73 to .88 supporting ecological validity. Mean CAT scores showed systematic changes in accordance with the menstrual cycle and the magnitudes of the changes were similar to those obtained from the daily scores. Finally, Receiver Operating Characteristic (ROC) analyses demonstrated the ability of the CATs to discriminate between women with and without clinically meaningful premenstrual symptom change. PROMIS CAT instruments for anger, depression, and fatigue demonstrated validity and utility in premenstrual symptom assessment. The results provide encouraging initial evidence of the utility of PROMIS instruments for the measurement of affective premenstrual symptoms.
    Journal of psychosomatic research 04/2014; 76(4):300-6. DOI:10.1016/j.jpsychores.2014.01.010 · 2.84 Impact Factor
  • Source
    • "PROMIS uses a 7-day recall period for the domains in this study (anger, fatigue, depression). The scores are normed on a T-score metric, which is scaled to have a mean of 50 and a standard deviation of 10 in the U.S. general population [3] [25]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Patient-reported outcome measures with reporting periods of a week or more are often used to evaluate the change of symptoms over time, but the accuracy of recall in the context of change is not well understood. This study examined whether temporal trends in symptoms that occur during the reporting period impact the accuracy of 7-day recall reports. Women with premenstrual symptoms (n=95) completed daily reports of anger, depression, fatigue, and pain intensity for 4weeks, as well as 7-day recall reports at the end of each week. Latent class growth analysis was used to categorize recall periods based on the direction and rate of change in the daily reports. Agreement (level differences and correlations) between 7-day recall and aggregated daily scores was compared for recall periods with different temporal trends. Recall periods with positive, negative, and flat temporal trends were identified and they varied in accordance with weeks of the menstrual cycle. Replicating previous research, 7-day recall scores were consistently higher than aggregated daily scores, but this level difference was more pronounced for recall periods involving positive and negative trends compared with flat trends. Moreover, correlations between 7-day recall and aggregated daily scores were lower in the presence of positive and negative trends compared with flat trends. These findings were largely consistent for anger, depression, fatigue, and pain intensity. Temporal trends in symptoms can influence the accuracy of recall reports and this should be considered in research designs involving change.
    Journal of psychosomatic research 08/2013; 75(2):160-6. DOI:10.1016/j.jpsychores.2013.06.006 · 2.84 Impact Factor
  • Source
    • "), and were summed to create a total pain interference score. Pain interference scores were converted to t scores in order to be consistent with the PROMIS metric, in which scores for the general U.S. population have a mean of 50 and a standard deviation of 10 (Liu et al., 2010). This allows for a meaningful comparison of a person or group's mean level on any given domain with the general U.S. population. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Objective: Chronic pain acceptance has been shown to be related to positive adjustment to chronic pain in patients presenting with pain as a primary problem. However, the role of pain acceptance in adjustment to chronic pain secondary to a neurological disorder that is often associated with physical disability has not been determined. The purpose of this study was to examine whether two domains of chronic pain acceptance-activity engagement and pain willingness-predict adjustment to pain, controlling for pain intensity and key demographic and clinical variables in individuals with muscular dystrophy (MD), multiple sclerosis (MS), post-polio syndrome (PPS), or spinal cord injury (SCI). Method: Participants were 508 community-dwelling adults with a diagnosis of MD, MS, PPS, or SCI who also endorsed a chronic pain problem. Participants completed self-report measures of pain acceptance, quality of life, pain interference, pain intensity, depression, and social role satisfaction. Results: Hierarchical linear regressions indicated that activity engagement predicted lower pain interference and depression, and greater quality of life and social role satisfaction. Pain willingness predicted less pain interference and depression. Together, the two pain acceptance subscales accounted for more variance in outcomes than did self-reported pain intensity. Conclusions: Findings correspond with the broader pain acceptance literature, although activity engagement appears to be a more robust predictor of adjustment than does pain willingness. This research supports the need for future studies to determine the extent to which treatments that increase acceptance result in positive outcomes in persons with chronic pain secondary to neurological disorders. (PsycINFO Database Record (c) 2013 APA, all rights reserved).
    Rehabilitation Psychology 02/2013; 58(1):1-9. DOI:10.1037/a0031727 · 1.91 Impact Factor
Show more