Rating the methodological quality of single-subject designs and n-of-1 trials: introducing the Single-Case Experimental Design (SCED) Scale.

Northern Clinical School, Faculty of Medicine, University of Sydney, Australia.
Neuropsychological Rehabilitation (Impact Factor: 2.01). 09/2008; 18(4):385-401. DOI: 10.1080/09602010802009201
Source: PubMed

ABSTRACT Rating scales that assess methodological quality of clinical trials provide a means to critically appraise the literature. Scales are currently available to rate randomised and non-randomised controlled trials, but there are none that assess single-subject designs. The Single-Case Experimental Design (SCED) Scale was developed for this purpose and evaluated for reliability. Six clinical researchers who were trained and experienced in rating methodological quality of clinical trials developed the scale and participated in reliability studies. The SCED Scale is an 11-item rating scale for single-subject designs, of which 10 items are used to assess methodological quality and use of statistical analysis. The scale was developed and refined over a 3-year period. Content validity was addressed by identifying items to reduce the main sources of bias in single-case methodology as stipulated by authorities in the field, which were empirically tested against 85 published reports. Inter-rater reliability was assessed using a random sample of 20/312 single-subject reports archived in the Psychological Database of Brain Impairment Treatment Efficacy (PsycBITE). Inter-rater reliability for the total score was excellent, both for individual raters (overall ICC = 0.84; 95% confidence interval 0.73-0.92) and for consensus ratings between pairs of raters (overall ICC = 0.88; 95% confidence interval 0.78-0.95). Item reliability was fair to excellent for consensus ratings between pairs of raters (range k = 0.48 to 1.00). The results were replicated with two independent novice raters who were trained in the use of the scale (ICC = 0.88, 95% confidence interval 0.73-0.95). The SCED Scale thus provides a brief and valid evaluation of methodological quality of single-subject designs, with the total score demonstrating excellent inter-rater reliability using both individual and consensus ratings. Items from the scale can also be used as a checklist in the design, reporting and critical appraisal of single-subject designs, thereby assisting to improve standards of single-case methodology.

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: In people with psychiatric disorders, particularly those suffering from schizophrenia and related illnesses, pronounced difficulties in social interactions are a key manifestation. These difficulties can be partly explained by impairments in social cognition, defined as the ability to understand oneself and others in the social world, which includes abilities such as emotion recognition, theory of mind (ToM), attributional style, and social perception and knowledge. The impact of several kinds of interventions on social cognition has been studied recently. The best outcomes in the area of social cognition in schizophrenia are those obtained by way of cognitive remediation programs. New strategies and programs in this line are currently being developed, such as RC2S (cognitive remediation of social cognition) in Lyon, France. Considering that the social cognitive deficits experienced by patients with schizophrenia are very diverse, and that the main objective of social cognitive remediation programs is to improve patients' functioning in their daily social life, RC2S was developed as an individualized and flexible program that allows patients to practice social interaction in a realistic environment through the use of virtual reality techniques. In the RC2S program, the patient's goal is to assist a character named Tom in various social situations. The underlying idea for the patient is to acquire cognitive strategies for analyzing social context and emotional information in order to understand other characters' mental states and to help Tom manage his social interactions. In this paper, we begin by presenting some data regarding the social cognitive impairments found in schizophrenia and related disorders, and we describe how these deficits are targeted by social cognitive remediation. Then we present the RC2S program and discuss the advantages of computer-based simulation to improve social cognition and social functioning in people with psychiatric disorders.
    Frontiers in Human Neuroscience 01/2014; 8:400. · 2.91 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Over the past 70 years, single-case design (SCD) research has evolved to include a broad array of methodological and analytic advances. In this article, we describe some of these advances and discuss how SCDs can be used to optimize behavioral health interventions. Specifically, we discuss how parametric analysis, component analysis, and systematic replications can be used to optimize interventions. We also describe how SCDs can address other features of optimization, which include establishing generality and enabling personalized behavioral medicine. Throughout, we highlight how SCDs can be used during both the development and dissemination stages of behavioral health interventions.
    Translational behavioral medicine. 09/2014; 4(3):290-303.
  • [Show abstract] [Hide abstract]
    ABSTRACT: Traumatic brain injury (TBI) results in complex cognitive (and other) sequelae. Impairments in executive function and self-awareness are among the most characteristic neuropsychological sequelae and can exert a profound effect on resuming previous life roles. An international group of researchers and clinicians (known as INCOG) convened to develop recommendations for interventions to improve impairments in executive functioning and self-awareness after TBI.
    The Journal of head trauma rehabilitation. 07/2014; 29(4):338-352.


Available from
Sep 24, 2014