Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS). J Clin Epidemiol

Health Assessment Lab and QualityMetric Incorporated, 275 Wyman Street, Waltham, MA 02451, USA.
Journal of Clinical Epidemiology (Impact Factor: 3.42). 01/2008; 61(1):17-33. DOI: 10.1016/j.jclinepi.2006.06.025
Source: PubMed


The Patient-Reported Outcomes Measurement Information System (PROMIS) was initiated to improve precision, reduce respondent burden, and enhance the comparability of health outcomes measures. We used item response theory (IRT) to construct and evaluate a preliminary item bank for physical function assuming four subdomains.
Data from seven samples (N=17,726) using 136 items from nine questionnaires were evaluated. A generalized partial credit model was used to estimate item parameters, which were normed to a mean of 50 (SD=10) in the US population. Item bank properties were evaluated through Computerized Adaptive Test (CAT) simulations.
IRT requirements were fulfilled by 70 items covering activities of daily living, lower extremity, and central body functions. The original item context partly affected parameter stability. Items on upper body function, and need for aid or devices did not fit the IRT model. In simulations, a 10-item CAT eliminated floor and decreased ceiling effects, achieving a small standard error (< 2.2) across scores from 20 to 50 (reliability >0.95 for a representative US sample). This precision was not achieved over a similar range by any comparable fixed length item sets.
The methods of the PROMIS project are likely to substantially improve measures of physical function and to increase the efficiency of their administration using CAT.

Download full-text


Available from: Jakob B Bjorner,
79 Reads
  • Source
    • "Although often extensively validated, key limitations of these traditional questionnaires remain their static nature and limited measurement range and measurement precision, frequently leading to ceiling and floor effects and limited sensitivity to change [3]–[8]. Recent studies have suggested that these shortcomings may be overcome by item response theory (IRT) based item banking [9], [10]. IRT calibrated item banks can serve as a platform for tailored assessment of patient-reported outcomes, through developing targeted short forms or computerized adaptive tests (CATs). "
    [Show abstract] [Hide abstract]
    ABSTRACT: To calibrate the Dutch-Flemish version of the PROMIS physical function (PF) item bank in patients with rheumatoid arthritis (RA) and to evaluate cross-cultural measurement equivalence with US general population and RA data. Data were collected from RA patients enrolled in the Dutch DREAM registry. An incomplete longitudinal anchored design was used where patients completed all 121 items of the item bank over the course of three waves of data collection. Item responses were fit to a generalized partial credit model adapted for longitudinal data and the item parameters were examined for differential item functioning (DIF) across country, age, and sex. In total, 690 patients participated in the study at time point 1 (T2, N = 489; T3, N = 311). The item bank could be successfully fitted to a generalized partial credit model, with the number of misfitting items falling within acceptable limits. Seven items demonstrated DIF for sex, while 5 items showed DIF for age in the Dutch RA sample. Twenty-five (20%) items were flagged for cross-cultural DIF compared to the US general population. However, the impact of observed DIF on total physical function estimates was negligible. The results of this study showed that the PROMIS PF item bank adequately fit a unidimensional IRT model which provides support for applications that require invariant estimates of physical function, such as computer adaptive testing and targeted short forms. More studies are needed to further investigate the cross-cultural applicability of the US-based PROMIS calibration and standardized metric.
    PLoS ONE 03/2014; 9(3):e92367. DOI:10.1371/journal.pone.0092367 · 3.23 Impact Factor
  • Source
    • "Some previous studies have suggested that the PF-10 and HAQ-DI, or a selection of its items used in the modified HAQ, do essentially measure the same concept [23,24]. However, studies that examined whether items from both scales could actually be calibrated on a common IRT metric did not unequivocally support either a unidimensional or multidimensional latent structure [25,26]. Moreover, these studies did not compare the performance of different IRT models to further examine the impact of multidimensionality. "
    [Show abstract] [Hide abstract]
    ABSTRACT: The SF-36 physical functioning scale (PF-10) and the Health Assessment Questionnaire disability index (HAQ-DI) are the most frequently used instruments for measuring self-reported physical function in rheumatoid arthritis (RA). The objective of this study was to develop a crosswalk between scores on the PF-10 and HAQ-DI in RA. Item response theory (IRT) methods were used to co-calibrate both scales using data from 1791 RA patients. The appropriateness of a Rasch-based crosswalk was evaluated by comparing it with crosswalks based on a two-parameter and a multi-dimensional IRT model. The accuracy of the final crosswalk was cross-validated using baseline (n = 532) and 6-month follow-up (n = 276) data from an independent cohort of early RA patients. The PF-10 and HAQ-DI adequately fit a unidimensional Rasch model. Both scales measured a wide range of functioning, although the HAQ-DI tended to better target lower levels of functioning. The Rasch-based crosswalk performed similarly to crosswalks based on the two-parameter and multidimensional IRT models. Agreement between predicted and observed scale scores in the cross-validation sample was acceptable for group-level comparisons. The longitudinal validity in discriminating between disease response states was similar between observed and predicted scores. The crosswalk developed in this study allows for converting scores from one scale to the other and can be used for group-level analyses in patients with RA.
    Health and Quality of Life Outcomes 11/2013; 11(1):199. DOI:10.1186/1477-7525-11-199 · 2.12 Impact Factor
  • Source
    • "To determine the size of the DIF, we determined the increase in Nagelkerkes R2 after including the DIF variable and DIF variable-sum score interaction. A value greater than 0.03 was considered a criterion for noticeable DIF (see [34]). "
    [Show abstract] [Hide abstract]
    ABSTRACT: While there are numerous instruments for capturing the symptoms of fibromyalgia syndrome (FMS) patients, there is a lack of questionnaires capable of measuring in detail FMS patients' participation and social functioning. It was our aim to develop and methodologically test a new patient questionnaire specific to FMS measuring these concepts (the "Fibromyalgia Participation Questionnaire" FPQ). We first conducted a qualitative prestudy (focus groups, N = 38) to identify which impairments FMS patients experience in daily life because of their illness. To analyze the data we developed a coding system that contained 10 supercategories and a total of 105 subcategories. Items for the FPQ were developed from the subcategories. The psychometric analysis was done on a sample of N = 256 FMS patients undergoing inpatient rehabilitation in Germany. The final version of the FPQ contained 27 items and three scales (participation in social life FPQ-S, 11 items; participation in daily life FPQ-D, 11 items, participation in work-life FPQ-W 5 items). The FPQ displays good distribution properties, all the scales are unidimensional, and the scales fit to the Rasch model. Cronbach's Alpha range from 0.85 to 0.94. We noted indications of construct validity in that the FPQ correlates as expected with the Fibromyalgia Impact Questionnaire (physical scale), Pain Disability Index and scales from the PROMIS(R) item banks for satisfaction with participation. The FPQ scales generally reveal greater responsiveness than other instruments. By linking FPQ items to the categories of the International Classification of Functioning, Disability and Health (ICF) we demonstrate content validity. The FPQ captures participation and social functioning in FMS patients. As its psychometric properties are good, it can be recommended for use in evaluation studies and clinical trials.
    Health and Quality of Life Outcomes 08/2013; 11(1):135. DOI:10.1186/1477-7525-11-135 · 2.12 Impact Factor
Show more