Kim de Jong

Kim de Jong
Leiden University | LEI · Institute of Psychology

PhD

About

73
Publications
46,627
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
2,662
Citations
Introduction
Research focused on improving outcomes in routine practice through both practice-based and experimental research. Two major research lines: progress feedback and therapist effects. Currently working on measuring Facilitative Interpersonal Skills in CBT therapists
Additional affiliations
September 2001 - August 2004
University of Amsterdam
Position
  • Professor
September 2013 - August 2014
University of Pennsylvania
Position
  • Researcher
April 2013 - present
Leiden University
Position
  • Professor (Assistant)

Publications

Publications (73)
Article
Full-text available
Therapists’ responses to challenging therapy situations on the Facilitative Interpersonal Skills (FIS) performance task are a significant predictor of therapists’ differences in treatment outcomes. The aim of this study was to assess whether the complexity of the therapy situation influenced the facilitative interpersonal skills of trainees. Traine...
Article
Full-text available
Objective The added value of systematic client feedback (SCF) to psychotherapy can be affected by patient perspectives, both in a positive and negative way, and is influenced by cultural factors as well. Current study explores patients’ perspectives on use and optimization of SCF in Dutch outpatient mental healthcare. Primary aim of present study i...
Article
Full-text available
We face increasing demand for greater access to effective routine mental health services, including telehealth. However, treatment outcomes in routine clinical practice are only about half the size of those reported in controlled trials. Progress feedback, defined as the ongoing monitoring of patients’ treatment response with standardized measures,...
Article
Full-text available
Objectives The therapist‐facilitative interpersonal skills (FIS) has shown to predict therapy outcomes, demonstrating that high FIS therapists are more effective than low FIS therapists. There is a need for more insight into the variability in strengths and weaknesses in therapist skills. This study investigates whether a revised and extended FIS‐s...
Article
Full-text available
Aimed at understanding and improving psychological therapies as they are conducted in clinical routine, practice-oriented research (POR) is now a well-established approach to the scientific foundations of mental health care services. Resting on the accumulation of a wide range of practice-based evidence related to treatment outcome and process, as...
Article
Full-text available
In the past decade, there has been an increase in research related to the routine collection and active use of standardized patient data in psychotherapy. Research has increasingly focused on personalization of care to patients, clinical skills and interventions that modulate treatment outcomes, and implementation strategies, all of which appear to...
Article
Full-text available
Feedback-Informed Group Treatment (FIGT) shows promise for improving outcomes, but results are mixed. The aim was investigating the feasibility, acceptability and effects of renewed FIGT on clinical outcomes and therapy processes. In a quasi-experimental pilot study, 65 patients with anxiety or depressive disorders and 15 therapists of interpersona...
Article
Background: Feedback-informed treatment (FIT) has been shown to reduce the gap between more and less effective therapists. However, interactions between therapist characteristics and feedback utilisation are under-researched and not well understood. Methods: The IAPT-FIT Trial was a clinical trial where therapists were randomly assigned to a FIT gr...
Article
Full-text available
Background Progress feedback, also known as measurement-based care (MBC), is the routine collection of patient-reported measures to monitor treatment progress and inform clinical decision-making. Although a key ingredient to improving mental health care, sustained use of progress feedback is poor. Integration into everyday workflow is challenging,...
Article
Full-text available
Objective: Therapist characteristics are known to affect treatment outcome in general and could also influence the use of systematic client feedback (SCF). The current study explores the effect of feedback orientation, regulatory focus, self-efficacy, attitude towards feedback resources and perceived feedback validity on the use and outcome of SCF...
Article
Anxiety-related disorders constitute the leading prevalent mental disorders, with major burden on patients, their relatives, and society. Moreover, there is considerable treatment nonadherence/nonresponse. We used routine outcome monitoring (ROM) data from outpatients covering four anxiety-related disorders (DSM-IV-R, N = 470) to examine their 6-mo...
Article
Full-text available
Objective: To provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic practice. Method: A narrative review of the three phases of ROM – data collection, feeding back data, and adapting therapy – and an overview of patient outcomes from 11 meta-analytic studies....
Article
Although studies have shown that client feedback can improve treatment outcome, little is known about which factors might possibly moderate the effects of such feedback. The present study investigated potential therapist variables that might influence whether frequent client feedback is effective, including the Big Five personality traits, internal...
Article
Routine outcome monitoring (ROM) involves measuring an outcome variable (e.g., symptoms and alliance) at a regular interval over time (e.g., before each session), using a standardized patient self‐report measure. Several computerized ROM system exists that also provide the therapist with benchmarks for these measures based on expected treatment res...
Article
Full-text available
Monitoring treatment progress by the use of standardized measures in individual therapy, also called feedback-informed treatment (FIT), has a small but significant effect on improving outcomes. Results of FIT in group therapy settings are mixed, possibly due to contextual factors. The goals of this study were to investigate the feasibility, accepta...
Article
Routine outcome monitoring (ROM) involves the use of patient‐reported standardized outcome measures to monitor progress throughout the course of treatment, followed by feedback of the patient's scores to the therapist. The potential benefits of ROM have been established, however, from our own experiences, we know that the implementation in clinical...
Article
Full-text available
Therapists, including group therapists, can systematically gather feedback from patients about how their group members are responding to treatment. However, results of research on using feedback-informed group treatment (FIGT) are mixed, and the underlying mechanisms responsible for positive patient changes remain unclear. Therefore, the present qu...
Article
Full-text available
Objective: Systematic client feedback (SCF), the regular monitoring and informing of patients’ progress during therapy to patient and therapist, has been found to have effects on treatment outcomes varying from very positive to slightly negative. Several prior studies have been biased by researcher allegiance or lack of an independent outcome measu...
Chapter
This chapter addresses fundamental issues of change in psychotherapy: how to measure, monitor, predict change, and provide feedback on treatment outcome. The chapter starts with a historical overview, covering several approaches applied to measure change in psychotherapy research. We proceed with a description of classical concepts to evaluate chan...
Article
Background Feedback-informed treatment (FIT) involves using computerized routine outcome monitoring technology to alert therapists to cases that are not responding well to psychotherapy, prompting them to identify and resolve obstacles to improvement. In this study, we present the first health economic evaluation of FIT, compared to usual care, to...
Article
Full-text available
With the motivation of investigating the replicability and transferability of the findings employing the Facilitative Interpersonal Skills (FIS) performance task beyond Anglophone countries, a set of Dutch FIS clips have been scripted and recorded. In this study the psychometric properties of the Dutch clips was tested. Furthermore, an additional s...
Article
Full-text available
Progress feedback is an intervention aimed at enhancing patient outcomes in routine clinical practice. This study reports a comprehensive multilevel meta-analysis on the effectiveness of progress feedback in psychological treatments in curative care. The short- and long-term effects of feedback on symptom reduction were investigated using 58 (rando...
Article
Full-text available
Objective: Previous studies have shown that feedback-informed treatment can improve outcomes of psychological treatments. This randomized controlled effectiveness trial evaluated the effect of progress feedback on treatment duration, symptom reduction, and dropout in individual cognitive behavioral therapies (CBTs). A control condition where CBT wa...
Article
Objective: Subjective well-being is a crucial variable for mental health practitioners. This study examines the influence of therapists’ attachment dimensions and self-reported reflective functioning on their perceived well-being. Further, it examines if reflective functioning mediates the association between attachment insecurity and well-being. M...
Article
Full-text available
Objectives: If patients change their perspective due to treatment, this may alter the way they conceptualize, prioritize, or calibrate questionnaire items. These psychological changes, also called "response shifts," may pose a threat to the measurement of therapeutic change in patients. Therefore, it is important to test the occurrence of response...
Article
Full-text available
Introduction The Partners for Change Outcome Management System (PCOMS) is a client feedback-system built on two brief visual analogue self-report scales. Prior studies of PCOMS have found effects varying from significant positive to negative. Aims of present study are; to test the predicted beneficial impact of PCOMS, while accounting for methodolo...
Article
Full-text available
BACKGROUND The Mini-International Neuropsychiatric Interview-Plus (MINI-Plus) is a widely used diagnostic tool, yet research on the psychometric properties is limited. AIM To investigate the inter-rater reliability of the MINI-Plus and to explore the concordance between MINI-Plus diagnoses and clinician-rated diagnoses. METHOD MINI-Plus interviews...
Article
Full-text available
There is evidence that progress feedback combined with a clinical support tool (CST) improves treatment outcome in individual psychotherapy. This study examined the effect of feedback in combination with a CST in outpatient group psychotherapy. A prospective cohort study was performed with patients meeting diagnostic criteria for a major depressive...
Article
Full-text available
Background: Previous research suggests that using outcome feedback technology can enable psychological therapists to identify and resolve obstacles to clinical improvement. This study aimed to evaluate the effectiveness of an outcome feedback quality assurance system applied in stepped care psychological services. Methods: This multi-site cluster r...
Article
To the Editor In their Viewpoint, Drs Leichsenring and Steinert¹ questioned the status of CBT as the gold standard for psychotherapy and called for “plurality in treatment and research” because of several limitations of current treatment outcome research in CBT. Although we agree that outcome research may have limitations and must be appropriately...
Article
Full-text available
Aims: This study evaluated the impact of applying computerized outcome feedback (OF) technology in a stepped care psychological service offering low and high intensity therapies for depression and anxiety. Methods: A group of therapists were trained to use OF based on routine outcome monitoring using depression (PHQ-9) and anxiety (GAD-7) measures....
Article
This study aimed to evaluate the differential effect of outcome monitoring feedback to therapists and to patients on outcomes in cluster B, cluster C, and personality disorder not otherwise specified (PD-NOS) patients. Day treatment patients (n = 112) and inpatients (n = 94) were randomly assigned to a feedback to therapist (FbT), feedback to thera...
Article
Full-text available
Purpose: In the absence of measurement invariance across measurement occasions, change scores based on pretest-posttest measurements may be inaccurate representations of real change on the latent variable. In this study, we examined whether measurement invariance held in the Dutch version of Outcome Questionnaire-45 (OQ-45). Method: Using second...
Article
Key practitioner message: This is the first study to investigate the psychometric properties of the Treatment Support Measure (TSM) Parent and Youth versions, which are created to help clinicians with actionable feedback when youths are not making sufficient progress in treatment. The Dutch TSM Parent and TSM Youth have moderate to good psychometr...
Article
Hoewel er inmiddels diverse artikelen zijn verschenen met behandelresultaten in ggz-instellingen in diverse landen, is er nog weinig bekend over de behandelresultaten bij vrijgevestigden. In dit artikel worden behandelresultaten geanalyseerd uit een grote dataset van vrijgevestigde psychologen en psychotherapeuten. Tevens is gekeken of er voorspell...
Article
Full-text available
Background: Routine outcome monitoring of common mental health disorders (CMHDs), using patient reported outcome measures (PROMs), has been promoted across primary care, psychological therapy and multidisciplinary mental health care settings, but is likely to be costly, given the high prevalence of CMHDs. There has been no systematic review of the...
Article
Full-text available
This commentary on the articles published in the special section on the development and implementation of measurement feedback systems (MFSs) discusses three challenging themes in the process of MFS implementation: design and planning, organizational context, and sustainability and unintended consequences. It is argued that the implementation of MF...
Article
Steeds meer disciplines in de gezondheidszorg meten behandeluitkomsten (PROM). Niet alle behandelaars gebruiken deze metingen echter om de behandeling van de individuele patiënten te verbeteren. Dit artikel geeft een samenvatting van het onderzoek naar verschillen tussen behandelaars in het omgaan met routinematige uitkomstmetingen.
Article
Full-text available
Objective: Feedback from clients on their view of progress and the therapeutic relationship can improve effectiveness and efficiency of psychological treatments in general. However, what the added value is of client feedback specifically within cognitive-behavioural therapy (CBT), is not known. Therefore, the extent to which the outcome of CBT can...
Article
The Outcome Questionnaire-45 (OQ-45; Lambert et al., ) has been designed for frequent assessment of a patient's functioning during the course of psychotherapy and has become one of the most frequently used outcome measures in the Netherlands. The OQ-45 was originally normed on outpatients in secondary care only, but is applied in a wide variety of...
Article
Full-text available
In the last 15 years feedback interventions have had a significant impact on the field of psychotherapy research and have demonstrated their potential to enhance treatment outcomes, especially for patients with an increased risk of treatment failure. This article serves as an introduction to the special issue on "Patient-focused and feedback resear...
Article
Despite research on its effectiveness, many therapists still have negative attitudes toward using outcome monitoring feedback. The current study aims to investigate how the perceived match between values of an individual and those of the organization (Person-Organization fit; PO fit), and motivation to prevent failure or to achieve success (regulat...
Article
We applied item response theory based person-fit analysis (PFA) to data of the Outcome Questionnaire-45 (OQ-45) to investigate the prevalence and causes of aberrant responding in a sample of Dutch clinical outpatients. The [Formula: see text] person-fit statistic was used to detect misfitting item-score patterns and the standardized residual statis...
Article
Outcome monitoring feedback is a promising intervention to enhance outcomes of clinical practice. However, effective implementation can be tough and research suggests that feedback is not equally effective under all circumstances. In this article, feedback theory, research and experience from clinical practice is used to provide implementation stra...
Article
Full-text available
Objective: Outcome monitoring feedback has become popular, but its effect on treatment outcome has been mixed. Feedback seems most effective for patients who are not progressing well ("not on track" (NOT) cases). There are some indications that patient feedback has an additional effect and that feedback effects differentiate between short- and lon...
Article
Iedere psychotherapeut loopt er tegenaan dat zich in de behandelkamer soms situaties voordoen waar hij of zij niet direct raad mee weet. De meeste therapeuten blijven daarom supervisie of intervisie volgen, zodat zij de mening en steun van een collega kunnen vragen bij dergelijke situaties. Jerome Blackman, psychiater en hoogleraar klinische psychi...
Article
Full-text available
Background: Patient self-report allows collecting comprehensive data for the purpose of performing economic evaluations. The aim of the current study was to assess the feasibility, reliability and a part of the construct validity of a commonly applied questionnaire on healthcare utilization and productivity losses in patients with a psychiatric di...
Article
Full-text available
• Dit onderzoek richt zich op verschillen in effectiviteit tussen therapeuten in Nederland en op therapeutfactoren die deze verschillen in effectiviteit kunnen verklaren. Bij een groep van zestien therapeuten werd de behandeleffectiviteit bepaald. De therapeuten werden verdeeld in ‘meest effectieve’ en ‘minst effectieve’ therapeuten, waarbij de mee...
Article
Full-text available
is onderzoeker bij de, en psycholoog bij Psychologie La Croix te Amsterdam. Zij is redacteur van dit tijdschrift. is docent bij het, en psychotherapeut in eigen praktijk te Schoonhoven. Hij is redacteur van dit tijdschrift.
Article
Full-text available
Providing outcome monitoring feedback to therapists seems to be a promising approach to improve outcomes in clinical practice. This study aims to examine the effect of feedback and investigate whether it is moderated by therapist characteristics. Patients (n=413) were randomly assigned to either a feedback or a no-feedback control condition. There...
Article
Full-text available
BACKGROUND. Routine outcome monitoring (rom) can only improve the quality of mental health care if the therapist is prepared to accept rom-feedback. However, most implementation procedures tend to focus on the organisation of the measurements rather than on the role of the therapist. AIM. To obtain a better understanding of the characteristics of t...
Article
Full-text available
BACKGROUND. The structural measurement of the results of treatment under the Dutch mental health services and a comparison of these results between mental health centres help to provide insight into the effectiveness of treatment in general practice. AIM. To provide an overview of the issues that require attention when the results of mental health...
Article
Full-text available
Routine outcome monitoring (ROM) can only improve the quality of mental health care if the therapist is prepared to accept ROM-feedback. However, most implementation procedures tend to focus on the organisation of the measurements rather than on the role of the therapist. To obtain a better understanding of the characteristics of the therapist whic...
Article
Full-text available
This study described the psychometric properties of the Swedish version of the Outcome Questionnaire (OQ-45.2) in a substance abuse sample (N=227). The test properties were satisfactory except for somewhat low internal consistency in the social role subscale. The results were similar to those obtained in other countries but systematic international...
Article
Full-text available
Over the last few years, three-level longitudinal models have become more common in psychotherapy research, particularly in therapist-effect or group-effect studies. Thus far, limited attention has been paid to power analysis in these models. This article demonstrates the effects of intraclass correlation, level of randomization, sample size, covar...
Article
Full-text available
The cross-cultural validity of the OQ in the Dutch population has been examined by comparing the psychometric properties and equivalence in factor structure and normative scores of the Dutch OQ with the original American version. Data were collected at university (N = 268), in community (N = 810) and in three mental health care organizations (N = 1...
Article
Full-text available
The Dutch version of the Outcome Questionnaire (OQ-45): a cross-cultural validation The cross-cultural validity of the OQ in the Dutch population has been examined by comparing the psychometric properties and equivalence in factor structure and normative scores of the Dutch OQ with the original American version. Data were collected at university (...
Article
The cross-cultural validity of the Outcome Questionnaire (OQ) in the Dutch population has been examined by comparing the psychometric properties and equivalence in factor structure and normative scores of the Dutch OQ with the original American version. Data were collected from a university (n = 268), in a community (n = 810) and from three mental...
Article
Full-text available
The cross-cultural validity of the Outcome Questionnaire (OQ) in the Dutch population has been examined by comparing the psychomet-ric properties and equivalence in factor structure and normative scores of the Dutch OQ with the original American version. Data were collected from a university (n = 268), in a community (n = 810) and from three mental...
Article
Full-text available
In de geestelijke-gezondheidszorg is er momenteel toenemende aandacht voor de uitkomsten van behandelingen. Dit hangt samen met ontwikkelingen in het kwaliteitsdenken (Walburg & Brinkmann, 2001; Bering, 2003) en wordt gevoed door recente bezuinigingen op de vergoedingen voor psychotherapie (Ministerie van vws, 2003). Ook onderzoekstrends op het geb...

Questions

Questions (5)
Question
A colleague and I are working on a meta-analysis on outcome monitoring feedback and are looking for unpublished and in press papers to include. We explicitly invite non-randomized trials, as well as RCTs. We would like the study to be as up to date as possible. Please contact me if you have any potential papers for our analysis.
Question
A couple of years ago, I looked into the concept of mental health. WHO defines mental health as "A state of well-being in which the individual realises his or her own abilities, can cope with the normal stresses of life, can work productively and fruitfully and is able to make a contribution to his or her community" (WHO, 2001). However, in research, recovery is usually defined as being no longer mentally ill.
I have not found a generally accepted model of mental health so far, that is useful in research. Does anyone have useful suggestions? I have the Jacobson & Greenley model and the Taylor and Brown model, but those are rather old. Anything new on the market?
Question
The Society for Psychotherapy Research Student Services proudly presents the next webinar for early career scholars. The presenter will be dr. Wolfgang Lutz, professor in Clinical Psychology at Universität Trier. This webinar will be moderated by dr. John Ogrodniczuk.
Investigating change on a macro, meso and micro level: a three level psychotherapy research program – dr. Wolfgang Lutz – 8 September 2011 18:00 CET (12:00 EST)
In this presentation a research program on psychotherapeutic change will be presented, which has it’s focus on investigating change processes as well as progress and outcome on different levels of the psychotherapeutic endeavour. Furthermore, the integration of this research program within a clinical training program will be presented.
The macro-level is dealing with change on a services research level and covers topics as the modelling and prediction of individual patient change based on initial and early change information as well as feedback and therapist differences. This research area is also widely known as patient-focused research.
The meso level investigates change processes in terms of specific patterns of change. Those linear and non-linear change patterns are investigated also in relation to in-session change processes before and after discontinuous change happens. The assessments on that level are based on session progress and outcome reports as well as ratings of video-taped sessions.
Finally, the micro- level of change investigates change processes based on micro-interventions - a short technique specific intervention (e.g. reframing or relaxation) - with the goal to identify relevant change bits on a psychometric as well as psychobiological (EEG) level.
Access is free of charge for early career scholars, including students, postdocs and assistant professors.
Question
I follow Ask a Psychologist on Twitter, because of the interesting questions they tend to get and today I noticed that they are looking for a new member for their counseling team.
I think it may be most advantageous for psychologists that either have their own practice or write books for the general public and that are native speakers in English. It might be interesting to one of you. Check out the info at:
Question
The Society for Psychotherapy Research Student Services proudly presents the next webinar for early career scholars. The presenter will be dr. Wolfgang Lutz, professor in Clinical Psychology at Universität Trier. This webinar will be moderated by dr. John Ogrodniczuk.
This webinar is available for people that are in the early phase of their career, including undergraduates, graduate students, post-docs and assistant professors free of charge.
This is an early announcement, an invitation will follow two weeks before the event.
Investigating change on a macro, meso and micro level: a three level psychotherapy research program – dr. Wolfgang Lutz – 8 September 2011 18:00 CET (12:00 EST)
In this presentation a research program on psychotherapeutic change will be presented, which has it’s focus on investigating change processes as well as progress and outcome on different levels of the psychotherapeutic endeavour. Furthermore, the integration of this research program within a clinical training program will be presented.
The macro-level is dealing with change on a services research level and covers topics as the modelling and prediction of individual patient change based on initial and early change information as well as feedback and therapist differences. This research area is also widely known as patient-focused research.
The meso level investigates change processes in terms of specific patterns of change. Those linear and non-linear change patterns are investigated also in relation to in-session change processes before and after discontinuous change happens. The assessments on that level are based on session progress and outcome reports as well as ratings of video-taped sessions.
Finally, the micro- level of change investigates change processes based on micro-interventions - a short technique specific intervention (e.g. reframing or relaxation) - with the goal to identify relevant change bits on a psychometric as well as psychobiological (EEG) level.

Network

Cited By