Impact of the Patient-Reported Outcomes Management Information System (PROMIS) upon the design and operation of multi-center clinical trials: a qualitative research study.
ABSTRACT New technologies may be required to integrate the National Institutes of Health's Patient Reported Outcome Management Information System (PROMIS) into multi-center clinical trials. To better understand this need, we identified likely PROMIS reporting formats, developed a multi-center clinical trial process model, and identified gaps between current capabilities and those necessary for PROMIS. These results were evaluated by key trial constituencies. Issues reported by principal investigators fell into two categories: acceptance by key regulators and the scientific community, and usability for researchers and clinicians. Issues reported by the coordinating center, participating sites, and study subjects were those faced when integrating new technologies into existing clinical trial systems. We then defined elements of a PROMIS Tool Kit required for integrating PROMIS into a multi-center clinical trial environment. The requirements identified in this study serve as a framework for future investigators in the design, development, implementation, and operation of PROMIS Tool Kit technologies.
- SourceAvailable from: Jeffrey Kaye[Show abstract] [Hide abstract]
ABSTRACT: We used a Guttman model to represent responses to test items over time as an approximation of what is often referred to as "points lost" in studies of cognitive decline or interventions. To capture this meaning of "point loss", over four successive assessments, we assumed that once an item is incorrect, it cannot be correct at a later visit. If the loss of a point represents actual decline, then failure of an item to fit the Guttman model over time can be considered measurement error. This representation and definition of measurement error also permits testing the hypotheses that measurement error is constant for items in a test, and that error is independent of "true score", which are two key consequences of the definition of "measurement error"--and thereby, reliability--under Classical Test Theory. We tested the hypotheses by fitting our model to, and comparing our results from, four consecutive annual evaluations in three groups of elderly persons: a) cognitively normal (NC, N = 149); b) diagnosed with possible or probable AD (N = 78); and c) cognitively normal initially and a later diagnosis of AD (converters, N = 133). Of 16 items that converged, error-free measurement of "cognitive loss" was observed for 10 items in NC, eight in converters, and two in AD. We found that measurement error, as we defined it, was inconsistent over time and across cognitive functioning levels, violating the theory underlying reliability and other psychometric characteristics, and key regression assumptions.PLoS ONE 02/2012; 7(2):e30019. DOI:10.1371/journal.pone.0030019 · 3.23 Impact Factor
- [Show abstract] [Hide abstract]
ABSTRACT: The Patient-Reported Outcomes Measurement Information System (PROMIS(®)) is a new, state-of-the-art assessment system for measuring patient-reported health and well-being of adults and children that has the potential to be more valid, reliable and responsive than existing PROMs. The PROMIS items can be administered in short forms or, more efficiently, through computerized adaptive testing. This paper describes the translation of 563 items from 17 PROMIS item banks (domains) for adults from the English source into Dutch-Flemish. The translation was performed by FACITtrans using standardized methodology and approved by the PROMIS Statistical Center. The translation included four forward translations, two back-translations, three to five independent reviews (at least two Dutch, one Flemish) and pre-testing in 70 adults (age range 20-77) from the Netherlands and Flanders. A small number of items required separate translations for Dutch and Flemish: physical function (five items), pain behaviour (two items), pain interference (one item), social isolation (one item) and global health (one item). Challenges faced in the translation process included: scarcity or overabundance of possible translations, unclear item descriptions, constructs broader/smaller in the target language, difficulties in rank ordering items, differences in unit of measurement, irrelevant items or differences in performance of activities. By addressing these challenges, acceptable translations were obtained for all items. The methodology used and experience gained in this study can be used as an example for researchers in other countries interested in translating PROMIS. The Dutch-Flemish PROMIS items are linguistically equivalent. Short forms will soon be available for use and entire item banks are ready for cross-cultural validation in the Netherlands and Flanders.Quality of Life Research 01/2014; 23(6). DOI:10.1007/s11136-013-0611-6 · 2.86 Impact Factor
- [Show abstract] [Hide abstract]
ABSTRACT: All nurses are interested in the effects of diseases and treatments on individuals. Patient reported outcome (PRO) measures are used to obtain self-reported information about symptoms, function, perceptions, and experiences. However, there are challenges to their use, including multiple measures of the same concept, widely varying quality, excessive length and complexity, and difficulty comparing findings across studies and conditions. To address these challenges, the National Institutes of Health funded the Patient-Reported Outcomes Measurement Information System (PROMIS®), a web-based repository of valid and reliable PRO measures of health concepts relevant to clinician and researchers. Through the PROMIS Assessment Center, clinicians and researchers can access PRO measures, administer computerized adaptive tests, collect self-report data, and report instant health assessments. The purpose of this paper is to summarize the development and validation of the PROMIS measures and to describe its current functionality as it relates to nursing science.Nursing Outlook 09/2014; 62(5). DOI:10.1016/j.outlook.2014.05.009 · 1.83 Impact Factor