Assessing Reliable and Clinically Significant Change on Health of the Nation Outcome Scales: Method for Displaying Longitudinal Data

Unit of Epidemiology and Social Psychiatry, 'Mario Negri' Institute for Pharmacological Research, Via Eritrea 62, 20157 Milan, Italy.
Australian and New Zealand Journal of Psychiatry (Impact Factor: 3.41). 09/2005; 39(8):719-25. DOI: 10.1111/j.1440-1614.2005.01656.x
Source: PubMed


Many authors recommended that reliable and clinically significant change (RCSC) should be calculated when reporting results of interventions. To test the reliability of the Health of the Nation Outcome Scales (HoNOS) in identifying RCSC, we applied the Jacobson and Truax model to two HoNOS assessments in a large group of people evaluated in 10 community mental health services in Lombardy, Italy, in 2000.
The HoNOS was administered to 9817 patients; of these, 4759 (48%) were re-assessed. Reliable change (RC) was calculated using Cronbach's alpha (alpha), as a parameter of the reliability of the measure. Clinical significance cut-offs were calculated using a classification of severity based on HoNOS items.
In the whole sample, the clinical improvement cut-off was 11 and the remission cut-off was 5. Considering the severe patients, the clinical improvement cut-off was 12. The RC index calculated on the whole group and on the subgroup of severe patients indicated that eight-point and seven-point changes, respectively, were needed to be confident that a real change had occurred. Longitudinal changes were depicted on two-dimensional graphs as examples of reporting RCSC on HoNOS total scores in a routine data collection: 91.6% of the whole sample (4361) was stable, 5.6% (269) improved and 1.8% (129) worsened.
Our study proposes a methodological framework for computing RCSC normative data on a widely used outcome scale and for identifying different degrees of clinical change.

Download full-text


Available from: Alberto Parabiaghi, Mar 19, 2014
  • Source
    • "The clinical status of the patients was measured at monthly intervals with the Health of the Nation Outcome Scale (HoNOS), to assess behavioral problems and disability [18, 19], and the 24-item Brief Psychiatric Rating Scale (BPRS), to assess general psychopathology [20, 21]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Abstract: This study set out to evaluate the effectiveness of a sailing and learning-to-sail rehabilitation protocol in a sample of patients diagnosed with severe mental disorders. The study was a randomized, crossover, waiting-list controlled trial, following recruitment in the Departments of Mental Health of South Sardinia. Participants were outpatients diagnosed with severe mental disorders, recruited through announcements to the directors of the Departments of Mental Health of South Sardinia. Out of the 40 patients enrolled in the study, those exposed to rehabilitation with sailing during a series of guided and supervised sea expeditions near the beach of Cagliari (Sardinia), where the aim to explore the marine environment while sailing was emphasized, showed a statistically significant improvement of their clinical status (measured by BPRS) and, as well, of their general functioning (measured by HoNOS Scale) against the control group. The improvement was maintained at follow-up for some months only: after 12 months, the patients returned to their baseline values on the measures of psychopathology and showed a worsening trend of their quality of life. Sailing can represent a substitute of important experiences that the patients with severe mental disorders miss because of their illness.
    Full-text · Article · Jul 2014 · Clinical Practice and Epidemiology in Mental Health
  • Source
    • "These items are grouped in four subscales: behavioral problems, impairment problems, symptoms problems and social problems [40]. Clinicians rate HoNOS before and after interventions, so that changes attributable to the interventions (outcomes) can be measured [41]. A higher score on each HoNOS subscale corresponds to greater occurrence of problems in the corresponding areas. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Psychoses within the spectrum of schizophrenia are severe mental disorders with a high chance of long-term disability and a negative impact on the quality of life. Poor adherence to pharmacotherapy negatively affects the course and the outcome of these disorders, enhancing the risk of relapse and readmission. Falloon and coworkers developed a Psychoeducation Program aimed at improving communication and problem-solving abilities in patients and their families. This study set out to evaluate changes in adherence to pharmacotherapy in a sample of patients diagnosed with schizophrenia-spectrum psychoses, by comparing one group exposed to the Falloon Psychoeducation Program with another group exposed to family supportive therapy with generic information on the disorders. 340 patients diagnosed with schizophrenia and related disorders according to standardized criteria from 10 participating units distributed throughout the Italian National Health System, will be enrolled with 1:1 allocation by the method of blocks of randomized permutations. Patients will be reassessed at 6, 12 and 18 months after start of treatment (duration: 6 months).The primary objective is to evaluate changes in adherence to pharmacotherapy after psychoeducation. Adherence will be assessed at three-month intervals by measuring blood levels of the primary prescribed drug using high pressure liquid chromatography, and via the Medication Adherence Questionnaire and a modified version of the Adherence Interview. Secondary objectives are changes in the frequency of relapse and readmission, as the main indicator of the course of the disorder.Enrolled patients will be allocated to the Falloon Psychoeducation Program (yes/no) randomly, 1:1, in a procedure controlled by the coordinating unit; codes will be masked until the conclusion of the protocol (or the occurrence of a severe negative event). The raters assessing the outcomes will be blind to treatment allocation and will be tested for blinding after treatment completion. Intention-to-treat will be applied in considering the primary and secondary outcomes. Multiple imputations will be applied to integrate the missing data. The study will start recruitment in February 2013; the total duration of the study is 27 months. If the psychoeducation program proves effective in improving adherence to pharmacotherapy and in reducing relapse and readmissions, its application could be proposed as a standard adjunctive psychosocial treatment within the Italian National Health System.Trial registration: Protocol Registration System of NCT01433094; registered on 20 August 2011; first patient was randomized on 12 February 2013.
    Full-text · Article · Oct 2013 · Trials
  • Source
    • "This definition is similar to, but more restrictive than that proposed by Harvey et al. (2006). As for psychosocial functioning, we adopted HoNOS cut-off thresholds proposed by the authors who validated the Italian version of the scale (Parabiaghi et al., 2005) to identify meaningful functional change, defining patients as improved if their HoNOS total score decreased at least by 8 points after treatment and functionally normalized if their HoNOS total score at the end point was ≤5, starting from a baseline score N5. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Although the efficacy of cognitive remediation interventions has been demonstrated in several experimental studies on schizophrenia, few studies have investigated the predictors of response to such interventions. We were interested in determining what factors contribute to a positive outcome after cognitive rehabilitation and whether different factors are associated with different degrees of improvement in cognitive and real-world functioning in individual patients after cognitive remediation. The study sample consisted of 56 patients with schizophrenia who had completed a 6-month cognitive remediation intervention and showed different cognitive and functional outcomes. Measures of cognitive and functional amelioration after cognitive remediation were analyzed in relation to patients' clinical, neuropsychological and functional variables at baseline using logistic regression analysis. Lower antipsychotic intake at baseline predicted cognitive improvement, whereas lower antipsychotic intake, severity of specific symptoms, and higher neurocognitive functioning (particularly executive functions and verbal memory) at baseline were associated with cognitive normalization after remediation treatment. Functional improvement was predicted by lower patient age and type of cognitive remediation intervention, whereas functional normalization was related to lower baseline antipsychotic intake and, at a trend level, to higher executive functioning and type of cognitive remediation intervention. Cognitive remediation could be more effective in younger, less disorganized, and cognitively less impaired patients, who take a smaller amount of antipsychotics. The predictive role of lower antipsychotic dosage on cognitive and functional outcome after remediation suggests either that patients with less severe illness could gain better advantage from cognitive remediation interventions or that high dose or complex antipsychotic therapy may limit the effectiveness of such interventions.
    Full-text · Article · Aug 2013 · Schizophrenia Research
Show more