Assessing reliable and clinically significant change on Health of the Nation Outcome Scales: method for displaying longitudinal data.

Unit of Epidemiology and Social Psychiatry, 'Mario Negri' Institute for Pharmacological Research, Via Eritrea 62, 20157 Milan, Italy.
Australian and New Zealand Journal of Psychiatry (Impact Factor: 3.77). 09/2005; 39(8):719-25. DOI: 10.1111/j.1440-1614.2005.01656.x
Source: PubMed

ABSTRACT Many authors recommended that reliable and clinically significant change (RCSC) should be calculated when reporting results of interventions. To test the reliability of the Health of the Nation Outcome Scales (HoNOS) in identifying RCSC, we applied the Jacobson and Truax model to two HoNOS assessments in a large group of people evaluated in 10 community mental health services in Lombardy, Italy, in 2000.
The HoNOS was administered to 9817 patients; of these, 4759 (48%) were re-assessed. Reliable change (RC) was calculated using Cronbach's alpha (alpha), as a parameter of the reliability of the measure. Clinical significance cut-offs were calculated using a classification of severity based on HoNOS items.
In the whole sample, the clinical improvement cut-off was 11 and the remission cut-off was 5. Considering the severe patients, the clinical improvement cut-off was 12. The RC index calculated on the whole group and on the subgroup of severe patients indicated that eight-point and seven-point changes, respectively, were needed to be confident that a real change had occurred. Longitudinal changes were depicted on two-dimensional graphs as examples of reporting RCSC on HoNOS total scores in a routine data collection: 91.6% of the whole sample (4361) was stable, 5.6% (269) improved and 1.8% (129) worsened.
Our study proposes a methodological framework for computing RCSC normative data on a widely used outcome scale and for identifying different degrees of clinical change.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Abstract: This study set out to evaluate the effectiveness of a sailing and learning-to-sail rehabilitation protocol in a sample of patients diagnosed with severe mental disorders. The study was a randomized, crossover, waiting-list controlled trial, following recruitment in the Departments of Mental Health of South Sardinia. Participants were outpatients diagnosed with severe mental disorders, recruited through announcements to the directors of the Departments of Mental Health of South Sardinia. Out of the 40 patients enrolled in the study, those exposed to rehabilitation with sailing during a series of guided and supervised sea expeditions near the beach of Cagliari (Sardinia), where the aim to explore the marine environment while sailing was emphasized, showed a statistically significant improvement of their clinical status (measured by BPRS) and, as well, of their general functioning (measured by HoNOS Scale) against the control group. The improvement was maintained at follow-up for some months only: after 12 months, the patients returned to their baseline values on the measures of psychopathology and showed a worsening trend of their quality of life. Sailing can represent a substitute of important experiences that the patients with severe mental disorders miss because of their illness.
    Clinical Practice and Epidemiology in Mental Health 07/2014; 10(1):73-79. DOI:10.2174/1745017901410010073
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Rationale, aims and objectivesThe aim of this study was to examine the validity of the Health of the Nation Outcome Scales (HoNOS) in terms of change in relation to sex, clinical characteristics and level of clinical change as assessed using other measures.Methods The sample consisted of N = 690 admissions from one Swiss psychiatric hospital who were assessed at admission and discharge using the HoNOS and the clinical global impression (CGI) scale. Repeated measures analyses of variance were conducted to compare changes in HoNOS scores over time stratified by sex, diagnostic category and CGI level of change, controlled for age and previous hospitalizations. Two-way interactions between time and these factors were calculated and post hoc t-tests were conducted to compare changes in HoNOS scores between admission and discharge at factor levels.ResultsHoNOS scores significantly decreased from admission to discharge in bivariate analyses although no main effect of time was found in multivariate models. Sex was found to moderate change in HoNOS behavioural subscale scores; primary diagnosis at admission moderated change in HoNOS total scores, the behavioural subscale and the social subscale; and CGI level of change moderated the change in all HoNOS scales.Conclusions Our findings confirmed the sensitivity to change of the HoNOS in psychiatric settings from admission to discharge. Furthermore, we found that this change reflected similar changes in the CGI, a well-established measure for the evaluation of clinical outcomes, which, in turn supports the validity of the HoNOS.
    Journal of Evaluation in Clinical Practice 02/2015; 21(2). DOI:10.1111/jep.12296 · 1.58 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Psychoses within the spectrum of schizophrenia are severe mental disorders with a high chance of long-term disability and a negative impact on the quality of life. Poor adherence to pharmacotherapy negatively affects the course and the outcome of these disorders, enhancing the risk of relapse and readmission. Falloon and coworkers developed a Psychoeducation Program aimed at improving communication and problem-solving abilities in patients and their families. This study set out to evaluate changes in adherence to pharmacotherapy in a sample of patients diagnosed with schizophrenia-spectrum psychoses, by comparing one group exposed to the Falloon Psychoeducation Program with another group exposed to family supportive therapy with generic information on the disorders. 340 patients diagnosed with schizophrenia and related disorders according to standardized criteria from 10 participating units distributed throughout the Italian National Health System, will be enrolled with 1:1 allocation by the method of blocks of randomized permutations. Patients will be reassessed at 6, 12 and 18 months after start of treatment (duration: 6 months).The primary objective is to evaluate changes in adherence to pharmacotherapy after psychoeducation. Adherence will be assessed at three-month intervals by measuring blood levels of the primary prescribed drug using high pressure liquid chromatography, and via the Medication Adherence Questionnaire and a modified version of the Adherence Interview. Secondary objectives are changes in the frequency of relapse and readmission, as the main indicator of the course of the disorder.Enrolled patients will be allocated to the Falloon Psychoeducation Program (yes/no) randomly, 1:1, in a procedure controlled by the coordinating unit; codes will be masked until the conclusion of the protocol (or the occurrence of a severe negative event). The raters assessing the outcomes will be blind to treatment allocation and will be tested for blinding after treatment completion. Intention-to-treat will be applied in considering the primary and secondary outcomes. Multiple imputations will be applied to integrate the missing data. The study will start recruitment in February 2013; the total duration of the study is 27 months. If the psychoeducation program proves effective in improving adherence to pharmacotherapy and in reducing relapse and readmissions, its application could be proposed as a standard adjunctive psychosocial treatment within the Italian National Health System.Trial registration: Protocol Registration System of NCT01433094; registered on 20 August 2011; first patient was randomized on 12 February 2013.
    Trials 10/2013; 14(1):323. DOI:10.1186/1745-6215-14-323 · 2.12 Impact Factor