Comparing the Responsiveness of Functional Outcome Assessment Measures for Trauma Registries

Department of Epidemiology and Preventive Medicine, Monash University, Melbourne, Australia.
The Journal of trauma (Impact Factor: 2.96). 03/2011; 71(1):63-8. DOI: 10.1097/TA.0b013e31820e898d
Source: PubMed


Measuring long-term disability and functional outcomes after major trauma is not standardized across trauma registries. An ideal measure would be responsive to change but not have significant ceiling effects. The aim of this study was to compare the responsiveness of the Glasgow Outcome Scale (GOS), GOS-Extended (GOSE), Functional Independence Measure (FIM), and modified FIM in major trauma patients, with and without significant head injuries.
Patients admitted to two adult Level I trauma centers in Victoria, Australia, who survived to discharge from hospital, were aged 15 years to 80 years with a blunt mechanism of injury, and had an estimated Injury Severity Score >15 on admission, were recruited for this prospective study. The instruments were administered at baseline (hospital discharge) and by telephone interview 6 months after injury. Measures of responsiveness, including effect sizes, were calculated. Bootstrapping techniques, and floor and ceiling effects, were used to compare the measures.
Two hundred forty-three patients participated, of which 234 patients (96%) completed the study. The GOSE and GOS were the most responsive instruments in this major trauma population with effect sizes of 5.3 and 4.4, respectively. The GOSE had the lowest ceiling effect (17%).
The GOSE was the instrument with greatest responsiveness and the lowest ceiling effect in a major trauma population with and without significant head injuries and is recommended for use by trauma registries for monitoring functional outcomes and benchmarking care. The results of this study do not support the use of the modified FIM for this purpose.

1 Follower
6 Reads
  • Source
    • "Previous research has established that the GOS-E has sufficient responsiveness and a low ceiling effect (i.e. able to discriminate at higher functional levels) in a major trauma population[10]. Its reliability has also been established with neurological patients, but not yet with trauma patients[5] [11]. To address this knowledge gap, this study aimed to evaluate the inter-rater agreement of GOS-E scoring between an expert rater and trauma registry follow-up staff with a sample of detailed trauma case scenarios. "
    [Show abstract] [Hide abstract]
    ABSTRACT: To better evaluate the degree of ongoing disability in trauma patients, it has been recommended that trauma registries introduce routine long-term outcome measurement. One of the measures recommended for use is the Extended Glasgow Outcome Scale (GOS-E). However, few registries have adopted this measure and further research is required to determine its reliability with trauma populations. This study aimed to evaluate the inter-rater agreement of GOS-E scoring between an expert rater and trauma registry follow-up staff with a sample of detailed trauma case scenarios. Sixteen trauma registry telephone interviewers participated in the study. They were provided with a written summary of 15 theoretical adult trauma cases covering a spectrum of disability and asked to rate each case using the structured GOS-E interview. Their ratings were compared with those of an expert rater in order to calculate the inter-rater agreement for each individual rater-expert rater pair. Agreement was reported as the percentage of agreement, the kappa statistic, and weighted kappa. A multi-rater kappa value was also calculated for agreement between the 16 raters. Across the 15 cases, the percentage of agreement between individual raters and the expert ranged from 63% to 100%. Across the 16 raters, the percentage of agreement with the expert rater ranged from 73-100% (mean=90%). Kappa values ranged from 0.65 to 1.00 across raters (mean=0.86) and weighted kappa values ranged from 0.73 to 1.00 (mean=0.89) The multi-rater kappa value was 0.78 (95% CI: 0.66, 0.89). Sixteen follow-up staff achieved 'substantial' to 'almost perfect' agreement with an expert rater using the GOS-E outcome measure to score 15 sample trauma cases. The results of this study lend support to the use of the GOS-E within trauma populations and highlight the importance of ongoing training where multiple raters are involved to ensure reliable outcome reporting. It is also recommended that the structured GOS-E interview guide be used to achieve better agreement between raters. Ensuring the reliability of trauma outcome scores will enable more accurate evaluation of patient outcomes, and ultimately, more targeted trauma care. Copyright © 2015 Elsevier Ltd. All rights reserved.
    Injury 08/2015; DOI:10.1016/j.injury.2015.08.002 · 2.14 Impact Factor
  • Source
    • "Quality of survival ranks as high priority for trauma system research [10]. Although limited to a very few centres, there is some data on post-trauma quality of survival [11] [12] [13] [14] [15] [16] [17], and some very limited evidence that the implementation of a trauma system improves post-trauma functional recovery and quality of life in patients with major lower limb trauma, and in major trauma in general [18] [19]. Although trauma systems focus on major trauma, many patients in the system have moderate injury, which has not been evaluated. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Trauma care systems aim to reduce both death and disability, yet there is little data on post-trauma health status and functional outcome. To evaluate baseline, discharge, six month and 12 month post-trauma quality of life, functional outcome and predictors of quality of life in Hong Kong. Multicentre, prospective cohort study using data from the trauma registries of three regional trauma centres in Hong Kong. Trauma patients with an ISS≥9 and aged≥18 years were included. The main outcome measures were the physical component summary (PCS) score and mental component summary (MCS) scores of the Short-Form 36 (SF36) for health status, and the extended Glasgow Outcome Scale (GOSE) for functional outcome. Between 1 January 2010 and 31 September 2010, 400 patients (mean age 53.3 years; range 18-106; 69.5% male) were recruited to the study. There were no statistically significant differences in baseline characteristics between responders (N=177) and surviving non-responders (N=163). However, there were significant differences between these groups and the group of patients who died (N=60). Only 16/400 (4%) cases reported a GOSE≥7. 62/400 (15.5%) responders reached the HK population norm for PCS. 125/400 (31%) responders reached the HK population norm for MCS. If non-responders had similar outcomes to responders, then the percentages for GOSE≥7 would rise from 4% to 8%, for PCS from 15.5% to 30%, and for MCS from 31% to 60%. Univariate analysis showed that 12-month poor quality of life was significantly associated with age>65 years (OR 4.77), male gender (OR 0.44), pre-injury health problems (OR 2.30), admission to ICU (OR 2.15), ISS score 26-40 (OR 3.72), baseline PCS (OR 0.89), one-month PCS (OR 0.89), one-month MCS (OR 0.97), 6-month PCS (OR 0.76) and 6-month MCS (OR 0.97). For patients sustaining moderate or major trauma in Hong Kong at 12 months after injury<1 in 10 patients had an excellent recovery, ≤3 in 10 reached a physical health status score≥Hong Kong norm, although as many as 6 in 10 patients had a mental health status score which is≥Hong Kong norm.
    Injury 11/2013; 45(5). DOI:10.1016/j.injury.2013.11.006 · 2.14 Impact Factor
  • Source
    • "Survivors to discharge in VOTOR are followed-up by standardised telephone interview at 12-months post-injury to collect disability outcomes [18]. The outcome of interest for this study was the Glasgow Outcome Scale – Extended (GOS-E) which rates a person’s function on an 8-level scale from 1 (death) to 8 (upper good recovery) [21] .The GOS-E is recommended for measurement of trauma patient outcomes [22,23], has demonstrated high levels of responsiveness to change in patients without head injury [24], and considers the patient’s pre-injury function in the scoring process [21]. The GOS-E was dichotomised with a score <7 representing ongoing disability and 7–8 “recovery”. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Background Understanding the factors that impact on disability is necessary to inform trauma care and enable adequate risk adjustment for benchmarking and monitoring. A key consideration is how to adjust for pre-existing conditions when assessing injury outcomes, and whether the inclusion of comorbidity is needed in addition to adjustment for age. This study compared different approaches to modelling the impact of comorbidity, collected as part of the routine hospital episode data, on disability outcomes following orthopaedic injury. Methods 12-month Glasgow Outcome Scale – Extended (GOS-E) outcomes for 13,519 survivors to discharge were drawn from the Victorian Orthopaedic Trauma Outcomes Registry, a prospective cohort study of admitted orthopaedic injury patients. ICD-10-AM comorbidity codes were mapped to four comorbidity indices. Cases with a GOS-E score of 7–8 were considered “recovered”. A split dataset approach was used with cases randomly assigned to development or test datasets. Logistic regression models were fitted with “recovery” as the outcome and the performance of the models based on each comorbidity index (adjusted for injury and age) measured using calibration (Hosmer-Lemshow (H-L) statistics and calibration curves) and discrimination (Area under the Receiver Operating Characteristic (AUC)) statistics. Results All comorbidity indices improved model fit over models with age and injuries sustained alone. None of the models demonstrated acceptable model calibration (H-L statistic p < 0.05 for all models). There was little difference between the discrimination of the indices for predicting recovery: Charlson Comorbidity Index (AUC 0.70, 95% CI: 0.68, 0.71); number of ICD-10 chapters represented (AUC 0.70, 95% CI: 0.69, 0.72); number of six frequent chronic conditions represented (AUC 0.70, 95% CI: 0.69, 0.71); and the Functional Comorbidity Index (AUC 0.69, 95% CI: 0.68, 0.71). Conclusions The presence of ICD-10 recorded comorbid conditions is an important predictor of long term functional outcome following orthopaedic injury and adjustment for comorbidity is indicated when assessing risk-adjusted functional outcomes over time or across jurisdictions.
    BMC Health Services Research 01/2013; 13(1):30. DOI:10.1186/1472-6963-13-30 · 1.71 Impact Factor
Show more