ArticlePublisher preview available

Measuring and Facilitating Client Engagement with Financial Incentives: Implications for Improving Clinical Outcomes in a Mental Health Setting

Authors:
  • Skyland Trail
To read the full-text of this research, you can request a copy directly from the authors.

Abstract and Figures

Significant numbers of individuals with severe mental illnesses are difficult to engage in treatment services, presenting challenges for care. To be able to assess the relationship between engagement and discharge outcomes, we modified the ?Milestones of Recovery Scale?. This scale was modified for content to match the current clinical setting, evaluated for inter-rater reliability after modification in a sample of 233 cases receiving psychiatric rehabilitation, and then was administered to 423 additional psychiatric rehabilitation clients over a 24-month study period. In an effort to determine whether provision of financial incentives lead to sustained increases in client engagement, a cut off for client eligibility for financial incentives was evaluated on the basis of the reliability study and the course of engagement was related to receipt of this incentive and successful completion of treatment in a new sample of 423 patients. Of this sample, 78?% received an initial financial incentive during treatment (were initially engaged), and 93.3?% of that subgroup sustained this level of engagement it over their entire course of treatment. Of the 22?% of cases not receiving an initial incentive, only 5.4?% improved in their engagement to levels required for the incentive. Longitudinal analysis demonstrated that individuals who maintained or increased their level of engagement over time were more likely to complete treatment in accordance with planned treatment goals. The initial engagement and the course of engagement in treatment predicted successful completion, but incentives did not lead to increased engagement in initially poorly engaged patients. These data are interpreted in terms of the likely success of extrinsic rewards to increase engagement in mental health services.
This content is subject to copyright. Terms and conditions apply.
ORIGINAL PAPER
Raymond J. Kotwicki
rkotwicki@skylandtrail.org
Alexandra M. Balzer
abalzer@skylandtrail.org
Philip D. Harvey
pharvey@med.miami.edu
1 Skyland Trail, 1961 North Druid Hills Rd, NE, Atlanta,
GA 30329, USA
2 Leonard M. Miller Professor of Psychiatry and Behavioral
Sciences, University of Miami Miller School of Medicine,
1120 NW 14th Street, Suite 1450, Miami, FL 33136, USA
Received: 7 October 2015 / Accepted: 20 September 2016
© Springer Science+Business Media New York 2016
Measuring and Facilitating Client Engagement with Financial
Incentives: Implications for Improving Clinical Outcomes in a
Mental Health Setting
Raymond J. Kotwicki1 · Alexandra M. Balzer1 · Philip D. Harvey2
5.4 % improved in their engagement to levels required for
the incentive. Longitudinal analysis demonstrated that indi-
viduals who maintained or increased their level of engage-
ment over time were more likely to complete treatment
in accordance with planned treatment goals. The initial
engagement and the course of engagement in treatment
predicted successful completion, but incentives did not
lead to increased engagement in initially poorly engaged
patients. These data are interpreted in terms of the likely
success of extrinsic rewards to increase engagement in
mental health services.
Keywords Engagement · Incentives ·
Mental health services · Motivation
Introduction
The clients most in need of services in community mental
health settings are often the most difcult individuals to
engage in treatment (e.g., Gillespie et al. 2004; Sainsbury
Centre for Mental Health [SCMH] 1998; Tait et al. 2002,
2003; Wagstaff 2011). This is particularly true in indi-
viduals with psychosis, though some evidence suggests
that individuals with all severe mental illness diagnoses
must be continually engaged in treatment to achieve posi-
tive outcomes (Meaden et al. 2012; O’Brien et al. 2009;
Kreyenbuhl et al. 2009), particularly in young adults (Kim
et al. 2012) and in veterans (Hearne 2013; Stecker et al
2011). Several models of care have been developed to
increase levels of engagement in those identied as dif-
cult to treat, under names like ‘assertive outreach’ (Gil-
lespie et al. 2004; Priebe et al. 2005; SCMH 1998; Wright
et al. 2011), ‘therapeutic alliance,’ or ‘integrative’ models
of care, which attempt to foster a recovery style focused
Abstract Signicant numbers of individuals with severe
mental illnesses are difcult to engage in treatment ser-
vices, presenting challenges for care. To be able to assess
the relationship between engagement and discharge out-
comes, we modied the “Milestones of Recovery Scale”.
This scale was modied for content to match the current
clinical setting, evaluated for inter-rater reliability after
modication in a sample of 233 cases receiving psychiat-
ric rehabilitation, and then was administered to 423 addi-
tional psychiatric rehabilitation clients over a 24-month
study period. In an effort to determine whether provision
of nancial incentives lead to sustained increases in cli-
ent engagement, a cut off for client eligibility for nancial
incentives was evaluated on the basis of the reliability study
and the course of engagement was related to receipt of this
incentive and successful completion of treatment in a new
sample of 423 patients. Of this sample, 78 % received an
initial nancial incentive during treatment (were initially
engaged), and 93.3 % of that subgroup sustained this level
of engagement it over their entire course of treatment. Of
the 22 % of cases not receiving an initial incentive, only
1 3
Community Ment Health J (2017) 53:501–509
DOI 10.1007/s10597-016-0053-z
/ Published online: 26 September 2016
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
... We also did not examine the time course of engagement in treatment, so we cannot tell if patients with poor engagement can be identified immediately. In a previous study at this site, we found that lack of treatment engagement identified immediately after admission was not amenable to targeted interventions using tangible rewards aimed at increasing engagement (Kotwicki et al., 2017). Immediate lack of engagement also predicted worse treatment outcomes. ...
Article
Full-text available
Computerized cognitive training (CCT) interventions are increasing in their use in outpatient mental health settings. These interventions have demonstrated efficacy for improving functional outcomes when combined with rehabilitation interventions. It has recently been suggested that patients with more cognitive impairment have a greater therapeutic response and that reduced engagement in training can identify cases who manifest low levels of benefit from treatment. Participants were psychiatric rehabilitation clients, with diagnoses of major depression, bipolar disorder and schizophrenia. Newly admitted cases received CCT, delivered via Brain HQ, with cognitive functioning divided into groups on the basis of a BACS t-score of 40 or less vs. more. Training engagement was indexed by the number of training levels achieved per day trained. Forty-nine cases trained on average for 17 days and completed a mean of 150 levels. Overall, patients improved by an average of 4.4 points (0.44 SD) in BACS t-scores (p < .001). Improvements were positively correlated with training engagement (r = 0.30, p < .05), but not with days trained (r = 0.09) or levels earned (r = 0.03) alone. Patients with higher levels of baseline cognitive performance had reduced cognitive gains (p < .003), but did not have less training engagement (p = .97). Diagnoses did not predict cognitive gains (p = .93) or target engagement (p = .74). Poorer performance at baseline and higher levels of training engagement accounted for >10% in independent variance in cognitive gains. The mean level of cognitive improvement far exceeded practice effects. The index of engagement, levels achieved per training day, is easily extracted from the training records of patients, which would allow for early and continuous monitoring of treatment engagement in CCT activities and therapist intervention as needed to improve engagement.
... The perception of intrinsic benefits is often augmented by certain elements of the CRT training process, such as bridging and discussion groups. It has been hypothesized that provision of external rewards for participating in CRT, such as financial compensation for training sessions, may lead to reduced transfer to other outcomes; however, it has recently been shown in a large-scale study that financial incentives to engage in behavioral rehabilitation programs do not lead to increases in clinician-rated engagement in treatment (14). In this study, individuals who showed high levels of motivation prior to treatment engagement demonstrated the greatest gains, while less motivated individuals did not show increased motivation, even with a potential to obtain considerable financial gain for increased treatment engagement. ...
Article
Full-text available
Pharmacological approaches to cognitive enhancement have received considerable attention but have not had considerable success in improving their cognitive and functional targets. Other intervention strategies, such as cognitive remediation therapy (CRT), have been shown to enhance cognitive performance but have not been found to improve functional outcomes without additional psychosocial interventions. Recently, several studies have attempted to enhance the effects of CRT by adding pharmacological interventions to the CRT treatments. In addition, as CRT has been shown to synergistically improve the effects of psychosocial interventions, the combination of pharmacological therapies aimed at cognition and psychosocial interventions may itself provide a promising strategy for improving functional outcomes. This review and commentary examines the current state of interventions combining CRT and psychosocial treatments with pharmacological augmentation. Our focus is on the specific level of effect of the pharmacological intervention, which could be enhancing motivation, training efficiency, or the consolidation of therapeutic gains. Different pharmacological strategies (e.g., stimulants, plasticity-inducing agents, or attentional or alertness enhancers) may have the potential to lead to different types of gains when combined with CRT or psychosocial interventions. The relative potential of these different mechanisms for immediate and durable effects is considered.
... Active patient engagement in mental healthcare is important because treatment requires knowledge and skills to follow medication regimens, to practice self-care activities, and to participate in treatment decisions. Patient engagement in healthcare services, including mental health services, has been associated with positive patient health outcomes, higher quality patient-provider communication, better healthcare quality, and decreased costs (Alegria et al. 2014;Dixon et al. 2016;Kotwicki et al. 2016). ...
Article
This study explored the relationship between race and two key aspects of patient engagement—patient activation and working alliance—among a sample of African-American and White veterans (N = 152) seeking medication management for mental health conditions. After adjusting for demographics, race was significantly associated with patient activation, working alliance, and medication adherence scores. Patient activation was also associated with working alliance. These results provide support for the consideration of race and ethnicity in facilitating patient engagement and patient activation in mental healthcare. Minority patients may benefit from targeted efforts to improve their active engagement in mental healthcare.
Article
Full-text available
Background: Motivation and engagement are important factors associated with therapeutic outcomes in cognitive training for schizophrenia. The goals of the present report were to examine relations between objective treatment engagement (number of sessions attended, amount of homework completed) and self-reported motivation (intrinsic motivation and perceived competence to complete cognitive training) with neurocognitive and functional outcomes from cognitive training. Methods: Data from a clinical trial comparing two cognitive training approaches in schizophrenia-spectrum disorders were utilized in the current report (n = 38). Relations were examined between baseline intrinsic motivation, perceived competence, homework completion, and session attendance with improvements in neurocognition, functional competence, and community functioning. Results: Number of sessions attended (r = 0.38) and time doing homework (r = 0.51) were significantly associated with improvements in neurocognition. Homework completion was associated with change in community functioning at a trend-level (r = 0.30). Older age was associated with greater treatment engagement (β = 0.37) and male biological sex was associated with greater self-reported motivation (β = 0.43). Homework completion significantly mediated the relationship between session attendance and neurocognitive treatment outcomes. Conclusions: Objective measures of treatment engagement were better predictors of treatment outcomes than subjective measures of motivation. Homework completion was most strongly related to treatment outcomes and mediated the relationship between session attendance and treatment outcomes, suggesting continued engagement with cognitive stimulation may be an especially important component of cognitive remediation programs. Future research should examine methods to improve homework completion and session attendance to maximize therapeutic outcomes.
Article
Full-text available
Background. Psychiatric diagnoses are important for treatment planning. There are a number of current challenges in the area of psychiatric diagnosis with important treatment implications. In this study, we examined the differential usefulness of two semi-structured interviews of differing length compared to clinical diagnoses for generation of diagnoses that did not require modification over the course of treatment. Methods. We performed a three-year, three-cohort study at an outpatient psychiatric rehabilitation facility, comparing the stability of admission diagnoses when generated by unstructured procedures relying on referring clinician diagnosis, the SCID, and the MINI. We examined changes in diagnoses from admission to discharge (averaging 13 weeks) and, during the second two years, convergence between referring clinician diagnoses and those generated by structured interviews. The same three interviewers examined all patients in all three phases of the study. Results. Admission and discharge diagnoses were available for 313 cases. Diagnoses generated with the unstructured procedure were changed by discharge 74 percent of the time, compared to four percent for SCID diagnoses and 11 percent for MINI diagnoses. Referring clinician diagnoses were disconfirmed in Years 2 and 3 in 56 percent of SCID cases and 44 percent of MINI cases. The distinctions between unipolar and bipolar disorders were particular points of disagreement, with similar rates of under and over-diagnosis of bipolar disorder. The rate of confirmation of referring clinician diagnoses of schizoaffective disorder was 10 percent with the SCID and 11 percent with the MINI. Discussion. In this setting, there appears to be a reasonable trade-off between brevity and accuracy through the use of the MINI compared to the SCID, with substantial improvements in stability of diagnoses compared to clinician diagnoses. Clinical diagnoses were minimally overlapping with the results of structured diagnoses, suggesting that structured assessment, particularly early in the illness or in short term treatment settings, may improve treatment planning.
Article
Full-text available
The aim of the study is to explore and analyse the self concepts of people with a diagnosis of severe and enduring mental illness and a history of disengagement from mental health services and identify implications for research policy and practice. The study will be an exploratory, qualitative, phenomenological sudy, using in-depth, semi-structured interviews to gain access to participant’s views and experiences regarding the research questions; namely, an examination of the effects of the research participant’s self-concepts on their engagement with mental health services. Within the research the person’s beliefs are about themselves, their “illness” and, possibly, their substance use will be examined.
Book
Change is constant in everyday life. Infants crawl and then walk, children learn to read and write, teenagers mature in myriad ways, and the elderly become frail and forgetful. Beyond these natural processes and events, external forces and interventions instigate and disrupt change: test scores may rise after a coaching course, drug abusers may remain abstinent after residential treatment. By charting changes over time and investigating whether and when events occur, researchers reveal the temporal rhythms of our lives. This book is concerned with behavioral, social, and biomedical sciences. It offers a presentation of two of today's most popular statistical methods: multilevel models for individual change and hazard/survival models for event occurrence (in both discrete- and continuous-time). Using data sets from published studies, the book takes you step by step through complete analyses, from simple exploratory displays that reveal underlying patterns through sophisticated specifications of complex statistical models.
Article
Although the prevalence of mental health disorders in troops serving in Operation Enduring Freedom (OEF) and Operation Iraqi Freedom (OIF) is high, many OEF/OIF veterans appear to refuse or delay mental health treatment. To examine psychological and psychosocial predictors of engagement, this pilot study examined eight factors: age, ethnicity, gender, polytrauma status, time since military separation, alcohol use, substance use, and psychiatric comorbidity. Structured clinical interviews given to all OEF/OIF veterans enrolling at a large Veterans Affairs health care center from 2007 to 2010 were examined, as were all psychiatric visits for the next year. Surprisingly, 72% of the sample (N = 600) was diagnosed with a psychiatric disorder. Of those (n = 429), the majority agreed to an initial mental health referral and attended at least one appointment within the year (n = 229, 53%), but only a quarter (n = 113, 26%) attended eight or more appointments. Multinomial regression analysis indicated that psychiatric comorbidity, polytrauma exposure, and time since military separation were the best predictors of initial engagement in needed mental health treatment, and psychiatric comorbidity and age were the best predictors of treatment retention. Findings suggest that Veterans Affairs may further improve engagement by attending to time since separation.
Article
The purpose of the present study is to review empirical evidence of the effects of interventions designed to improve engagement in mental health services among adolescents, young adults and their families. Investigators searched relevant databases, prior reviews, and conducted hand searches for intervention studies that met the following criteria: (1) examined engagement in mental health services; (2) included a comparison condition; and (3) focused on adolescents and/or young adults. Effect sizes for all reported outcomes were calculated. Thirteen studies met inclusion criteria. Conceptualizations of engagement and measurement approaches varied throughout studies. Approaches to improving engagement varied in effectiveness based on level of intervention. Individual level approaches improved attendance during the initial stage of treatment. While family level engagement interventions increased initial attendance rates, the impact did not extend to the ongoing use of services, whereas service delivery level interventions were more effective at improving ongoing engagement. The review illuminated that engagement interventions framed in an ecological model may be most effective at facilitating engagement. Implications for future research and practice are discussed.
Article
Background: Studies have shown the effectiveness of assertive outreach services in engaging clients with severe mental health problems. However, there is little research examining this engagement process in more detail. Aims: This study developed a reliable self-report measure of engagement based on Hall, Meaden, Smith, & Jones' (2001) observer-rated measure of engagement. The study investigated whether a self-report measure predicted clients' engagement with assertive outreach services 6 months later. The research also compared client and keyworker perceptions of engagement. Method: Twenty-five clients and their keyworkers, from three assertive outreach teams were interviewed. Results: The engagement measure (self-report version) was found to have good test-retest and internal reliability. Staff and client ratings were correlated at Time 1 but not at Time 2. Staff ratings at Time 1 were predictive of staff ratings at Time 2. Client ratings were not predictive of client ratings 6 months later. Items on the measures had different correlations with overall engagement for clients and staff, although there was some overlap. Conclusions: The engagement measure (self-report version) is quick, easy and reliable and can be used in conjunction with the observer version. The measure has significant clinical and research value. Declaration of interest: None
Article
In this study, we extend the measurement of engagement begun in community assertive outreach to an in-patient rehabilitation population. We report the development of the Residential Rehabilitation Engagement Scale (RRES), which measures engagement in the context of the broader multidisciplinary team and the overall rehabilitation process. Twenty-six patients were assessed using the RRES to determine inter-rater reliability and test-retest reliability. A larger sample (N  =  92) was utilised to explore the internal consistency of the scale and to perform cluster analysis to examine item structure. The RRES demonstrated good inter-rater reliability, test-retest reliability and internal consistency. Cluster analysis revealed three independent potential subcategories of engagement. The RRES is a reliable measure of engagement, consisting of three potential dimensions: active participation and openness, agreement with treatment and basic relationships and medication compliance. The relevance of the findings to in-patient rehabilitation settings and clinical implications is discussed.
Article
Assertive outreach services have been central to community mental health policy within the UK. These multidisciplinary teams were established to engage with service users who have severe and enduring mental health problems and have found traditional community services unable to meet their needs. Mental health nurses have a pivotal role in these multidisciplinary teams, yet the nature of these relationships from the perspective of those who work in and receive care is poorly understood. This study set out to explore the nature and meaning of engagement for practitioners and service users within assertive outreach services. A qualitative approach, informed by philosophical hermeneutics, underpinned the study. Participants were recruited from a single assertive outreach team in the UK. To be eligible for the study, mental health practitioners needed to be employed within the assertive outreach team. All service users residing in the community and receiving care from the team were also eligible for inclusion. In total 14 interviews were conducted with mental health practitioners and 13 with service users. Data analysis was informed by Turner's method. Four themes emerged from the data; contact, dialogue, transformation and shared understanding. Meaningful engagement was found to manifest itself through experiences such as providing and receiving practical assistance, having a genuine two-way conversation and valuing the experiences and personal attributes of the other person. The findings indicate that engagement is an active, dynamic and skilled process, which leads practitioners and service users to transform together to create a new relationship.