Treatment Integrity in Psychotherapy Research: Analysis of the Studies and Examination of the Associated Factors

Department of Psychology, Yale University, USA.
Journal of Consulting and Clinical Psychology (Impact Factor: 4.85). 01/2008; 75(6):829-41. DOI: 10.1037/0022-006X.75.6.829
Source: PubMed


Treatment integrity refers to the degree to which an intervention is delivered as intended. Two studies evaluated the adequacy of treatment integrity procedures (including establishing, assessing, evaluating, and reporting integrity; therapist treatment adherence; and therapist competence) implemented in psychotherapy research, as well as predictors of their implementation. Randomized controlled trials of psychosocial interventions published in 6 influential psychological and psychiatric journals were reviewed and coded for treatment integrity implementation. Results indicate that investigations that systematically addressed treatment integrity procedures are virtually absent in the literature. Treatment integrity was adequately addressed for only 3.50% of the evaluated psychosocial interventions. Journal of publication and treatment approach predicted integrity implementation. Skill-building treatments (e.g., cognitive-behavioral) as compared with non-skill-building interventions (e.g., psychodynamic, nondirective counseling) were implemented with higher attention to integrity procedures. Guidelines for implementation of treatment integrity procedures need to be reevaluated.

Full-text preview

Available from:
  • Source
    • "As with any EBP, in order to evaluate the R 3 supervision strategy, a standardized method of determining if R 3 is what is being delivered is needed. Fidelity includes an assessment of adherence and competency in delivering an intervention (Perepletchikova et al. 2007), and although the measurement of fidelity is challenging, it is essential. The ability to measure the quality of delivery of R 3 is key to identifying what aspects of the intervention are important to achieve outcomes, and for determining if those aspects are delivered well. "
    [Show abstract] [Hide abstract] ABSTRACT: Opportunities to evaluate strategies to create system-wide change in the child welfare system (CWS) and the resulting public health impact are rare. Leveraging a real-world, system-initiated effort to infuse the use of evidence-based principles throughout a CWS workforce, a pilot of the R(3) model and supervisor-targeted implementation approach is described. The development of R(3) and its associated fidelity monitoring was a collaboration between the CWS and model developers. Outcomes demonstrate implementation feasibility, strong fidelity scale measurement properties, improved supervisor fidelity over time, and the acceptability and perception of positive change by agency leadership. The value of system-initiated collaborations is discussed.
    Full-text · Article · Mar 2016 · Administration and Policy in Mental Health and Mental Health Services Research
  • Source
    • "We monitored any adverse psychological reactions experienced by participants . We will evaluate treatment fidelity (adherence to ACHD-CARE manual/program) using both indirect and direct methods [112]. As an indirect approach, counselors completed checklists of session procedures at the end of each session. "
    [Show abstract] [Hide abstract] ABSTRACT: Introduction: One-third of North American adults with congenital heart disease (CHD) have diagnosable mood or anxiety disorders and most do not receive mental health treatment. There are no published interventions targeting the psychosocial needs of patients with CHD of any age. We describe the development of a group psychosocial intervention aimed at improving the psychosocial functioning, quality of life, and resilience of adults with CHD and the design of a study protocol to determine the feasibility of a potential full-scale randomized controlled trial (RCT). Methods/design: Drawing upon our quantitative and qualitative research, we developed the Adult CHD-Coping And REsilience (ACHD-CARE) intervention and designed a feasibility study that included a 2-parallel arm non-blinded pilot RCT. Eligible participants (CHD, age ≥18years, no planned surgery, symptoms suggestive of a mood and/or anxiety disorder) were randomized to the ACHD-CARE intervention or Usual Care (1:1 allocation ratio). The group intervention was delivered during eight 90-minute weekly sessions. Feasibility will be assessed in the following domains: (i) process (e.g. recruitment and retention), (ii) resources, (iii) management, (iv) scientific outcomes, and (v) intervention acceptability. Discussion: This study underscores the importance of carefully developing and testing the feasibility of psychosocial interventions in medical populations before moving to full-scale clinical trials. At study conclusion, we will be poised to make one of three determinations for a full-scale RCT: (1) feasible, (2) feasible with modifications, or (3) not feasible. This study will guide the future evaluation and provision of psychosocial treatment for adults with CHD.
    Full-text · Article · Nov 2015 · Contemporary clinical trials
  • Source
    • "829). A study investigating psychosocial interventions published in six prominent psychological and psychiatric journals found that treatment integrity was adequately assessed for only 3.5% of the interventions (Perepletchikova et al., 2007). This may imply that the vast majority of treatment studies published to date do not include measures of whether the treatments in research trials are conducted as intended. "
    [Show abstract] [Hide abstract] ABSTRACT: The aim of the present study was to evaluate the psychometric properties of the Competence and Adherence Scale for Cognitive Behavioral Therapy (CAS-CBT). The CAS-CBT is an 11-item scale developed to measure adherence and competence in cognitive-behavioral therapy (CBT) for anxiety disorders in youth. A total of 181 videotapes from the treatment sessions in a randomized controlled effectiveness trial (Wergeland et al., 2014) comprising youth (N = 182, M age = 11.5 years, SD = 2.1, range 8-15 years, 53% girls, 90.7% Caucasian) with mixed anxiety disorders were assessed with the CAS-CBT to investigate interitem correlations, internal consistency, and factor structure. Internal consistency was good (Cronbach's alpha = .87). Factor analysis suggested a 2-factor solution with Factor 1 representing CBT structure and session goals (explaining 46.9% of the variance) and Factor 2 representing process and relational skills (explaining 19.7% of the variance). The sum-score for adherence and competence was strongly intercorrelated, r = .79, p < .001. Novice raters (graduate psychology students) obtained satisfactory accuracy (ICC > .40, n = 10 videotapes) and also good to excellent interrater reliability when compared to expert raters (ICC = .83 for adherence and .64 for competence, n = 26 videotapes). High rater stability was also found (n = 15 videotapes). The findings suggest that the CAS-CBT is a reliable measure of adherence and competence in manualized CBT for anxiety disorders in youth. Further research is needed to investigate the validity of the scale and psychometric properties when used with other treatment programs, disorders and treatment formats. (PsycINFO Database Record
    Full-text · Article · Oct 2015 · Psychological Assessment
Show more