ArticlePDF Available

Abstract

Objectives: Little is known about why clinicians seek training or about their willingness to invest in it. Methods: Results from a Web-based survey of 318 clinicians in a practice-based research network were used to examine factors that motivate clinicians to seek training or forgo training ("deal breakers") and their willingness to invest time and money in training. Results: Clinicians desired training that teaches advanced versus basic clinical skills, that covers an area they see as central to the needs of their clients, and that provides continuing education credit. Training that requires clinical supervision or the use of a manualized intervention was not a deal breaker for most clinicians. However, the amount of time and money most clinicians reported being willing to invest in training fell far short of the requirements for learning most evidence-based treatments. Conclusions: Training strategies that combine high intensity with lower cost may be needed.
Mental Health CliniciansMotivation
to Invest in Training: Results From a
Practice-Based Research Network Survey
Byron J. Powell, A.M.
J. Curtis McMillen, Ph.D.
Kristin M. Hawley, Ph.D.
Enola K. Proctor, Ph.D.
Objectives: Little is known about
why clinicians seek training or
about their willingness to invest in
it. Methods: Results from a Web-
based survey of 318 clinicians in
a practice-based research network
were used to examine factors that
motivate clinicians to seek training
or forgo training (deal breakers)
and their willingness to invest time
and money in training. Results:
Clinicians desired training that
teaches advanced versus basic
clinical skills, that covers an area
they see as central to the needs of
their clients, and that provides
continuing education credit.
Training that requires clinical
supervision or the use of a man-
ualized intervention was not
a deal breaker for most clinicians.
However, the amount of time and
money most clinicians reported
being willing to invest in training
fell far short of the requirements
for learning most evidence-based
treatments. Conclusions: Train-
ing strategies that combine high
intensity with lower cost may be
needed. (Psychiatric Services 64:
816818, 2013; doi: 10.1176/appi.
ps.003602012)
Evidence-based treatments hold
promise for meeting the mental
health needs of children and youths,
but only if clinicians implement them.
A growing body of literature focuses
on training professionals to deliver
evidence-based treatments (13). The
most consistent finding is that passive
approaches to training, such as one-
shot workshops or distribution of man-
uals, may increase provider knowledge
and predispose clinicians toward the
uptake of a treatment, but they do not
consistently produce provider behavior
change (15).
Effective training approaches seem
to involve multicomponent packages
of elements, such as a treatment man-
ual, multiple days of intensive work-
shop training, expert consultation, live
or taped review of client sessions,
supervisor training sessions, booster
training sessions, and completion
of one or more training cases (2).
Others assert that training should be
dynamic, active, and targeted to meet
the needs of individuals with different
learning styles (5); utilize behavioral
rehearsal (1); and include ongoing
supervision, consultation, and feed-
back (1,2,4).
These multicomponent approaches
require substantial investments of
time and money. Although previous
studies have noted that investments of
time and money are a potential barrier
to the receipt of training (6), a better
understanding of the clinician-level
factors that influence the receipt of
training is needed (2,3,7). The pur-
pose of this study was to examine what
motivates and deters clinicians from
participating in training and how
much time and money they are willing
to spend to learn new treatments. To
address these questions, we utilized
the Missouri Therapy Network (MTN),
a practice-based research network of
mental health clinicians who provide
psychological assessment or psycho-
therapy services for children and who
are reimbursed through Missouri
Medicaid.
Methods
In fall 2009, MTN members (N5816)
were contacted via e-mail and mail
and invited to complete a Web-based
survey related to clinical training. Of
the 816 clinicians who were sent the
survey, 364 (45%) responded. For this
study, we used the responses of 318
clinicians (39%) who had also com-
pleted an earlier survey detailing their
demographic characteristics, caseloads,
and income.
Because of the paucity of studies
on this topic, we developed a novel
survey that was informed by emerging
models of implementation research
(8,9) and was reviewed for relevance
by members of the MTNs clinician
advisory board. The survey consisted
of 18 items regarding the factors that
motivate a clinician to seek training,
22 items about potential deal break-
ers,and two questions about the
amount of time and money a clinician
Mr. Powell and Dr. Proctor are affiliated
with the Brown School of Social Work,
Washington University in St. Louis, One
Brookings Drive, Campus Box 1196, St.
Louis, MO 63130 (e-mail: bjpowell@wustl.
edu). Dr. McMillen is with the School of
Social Service Administration, University
of Chicago, Chicago. Dr. Hawley is with
the Department of Psychological Sciences,
University of Missouri, Columbia.
816 PSYCHIATRIC SERVICES 'ps.psychiatryonline.org 'August 2013 Vol. 64 No. 8
would be willing to invest to learn
a new therapy.
The items covering potential moti-
vators were scored on a 4-point Likert
scale that ranged from 1, very unlike
me, to 4, very much like me. Identi-
fication of deal breakers was based
on a dichotomous choice of yes or
no.
All survey data were downloaded in
Excel spreadsheets and converted to
SAS, version 9.2. Demographic data
were summarized by using frequen-
cies and percentages, and differences
between respondents and nonre-
spondents were calculated by using
chi square and t tests. Simple de-
scriptive statistics were used to report
data for both motivators and deal
breakers. Ordinary least-squares (OLS)
regression was used to determine
whether any of the demographic vari-
ables were predictive of the amount of
time or money that clinicians would
spend learning a new therapy.
Results
The 318 respondents had a mean6
SD age of 48.35611.13 and 14.146
8.82 years of practice experience. A
total of 238 (75%) were female, 285
(90%) were Caucasian, and 27 (8%)
were African American. They were
primarily masters- (N5226, 71%)
and doctoral-level (N581, 25%) clini-
cians holding licensure in counseling
(N5124, 39%), social work (N5119,
37%), psychology (N568, 21%), and
nursing (N57, 2%). They worked
primarily in urban areas in agency
(N5122, 38%), private (N5135, 42%),
and both agency and private (N561,
19%) settings. Approximately 41%
(N5129) of the clinicians earned over
$50,000 per year from their therapy
practice, and 52%633% of their clients
were enrolled in Medicaid.
Respondents were older than non-
respondents (48.35 versus 45.42
years, t53.50, df5783, p,.001),
had more years of professional expe-
rience (14.14 versus 11.91, t523.49,
df5767, p,.001), and practiced in
counties with a lower percentage of
the population living in urban areas
(10) (79% versus 85%, t53.07, df5725,
p,.01). There were no other significant
differences between respondents and
nonrespondents with respect to gen-
der, income, race-ethnicity, discipline,
percentage of clients enrolled in Med-
icaid, or type of practice setting.
Three of the most highly endorsed
motivators related to whether clini-
cians thought the training would be
a good fit for the kinds of clients that
they see. In addition, the clinicians
frequently endorsed the availability of
continuing education credit as a moti-
vator. Participants were not motivated
to attend training aimed at beginning
clinicians, nor were they motivated by
the opportunity to charge more money
for their services following training. [De-
scriptive statistics for the motivators and
deal breakers are available online in
a data supplement to this report.]
Approximately 25% of respondents
indicated providing training (N582)
and supervision (N577) solely over
the Internet was a deal breaker.
Twenty percent to 23% of clinicians
indicated that their deal breakers
included potential impingements
upon their autonomy, such as in-
congruities between their theoretical
orientation and the intervention cov-
ered by the training (N563) and
having to follow a session-by-session
treatment manual (N574). Clinicians
were willing to invest a wide range of
time to be trained (range 0 to 6,400
hours; median524). The number of
hours clinicians were willing to invest
(58.696369.08) was highly influ-
enced by three outliers. Recoding
the three highest values (720, 1,440,
and 6,400 hours) to the next highest
value (320 hours) reduced the mean
to 34.79645.20. We ran the OLS
regression with these values trans-
formed. Controlling for other varia-
bles, the regression showed that
nonwhite clinicians were willing to
spend 17.74 more hours in training
than white clinicians. Further, clini-
cians working in both agency and
private practice settings were willing
to spend 16.24 fewer hours in train-
ing than clinicians working only in
privatepractice(Table1).
The amount of money clinicians
would spend for training ($386.176
$503.53) was highly influenced by
a small number of outliers. Recoding
the four highest spenders to the next
highest spender ($1,500, which four
clinicians would pay) reduced the
amount to $359.446$343.76. The
OLS model used the four transformed
values (Table 1). For every 1% increase
in the percentage of clients in a clini-
cians caseload who were Medicaid
recipients, there was a $1.86 reduction
in the amount that they would pay for
training. Conversely, moving from an
annual salary of less than $50,000 to
greater than $50,000 was associated
with a willingness to pay $117.11 more
for training. Finally, clinicians who
worked in agency and private practice
were willing to spend $117.35 less on
training than clinicians who worked in
private practice exclusively.
Table 1
Association between characteristics of 318 clinicians and willingness to spend
time and money on training, by ordinary least-squares regression
Time (model 1)
a
Money (model 2)
b
Characteristic b SE (b) bb SE (b) b
Age .41 .29 .10 1.79 2.15 .06
Years of experience .06 .37 .01 2.51 2.76 .06
Medicaid-enrolled clients .15 .08 .11 1.86 .59 .18**
Urban practice 6.73 9.16 .04 101.45 68.55 .08
Gender 1.59 6.27 .02 1.97 46.91 .00
Income .$50,000 3.58 5.93 .04 117.11 44.41 .17**
Nonwhite 17.74 8.36 .12*17.37 62.52 .02
Psychologist 5.08 7.43 .05 18.02 55.63 .02
Counselor 9.96 5.95 .11 37.58 44.51 .05
Nurse 6.65 17.60 .02 61.28 131.70 .03
Agency only 7.15 5.73 .08 47.98 42.86 .07
Agency and private 16.24 6.95 .14*117.35 51.98 .13*
a
R
2
5.07, adjusted R
2
5.04
b
R
2
5.10,adjusted R
2
5.07
*p,.05, **p,.01
PSYCHIATRIC SERVICES 'ps.psychiatryonline.org 'August 2013 Vol. 64 No. 8 817
Discussion
Clinicians were willing to participate
in training with only a few caveats,
namely that it be relevant to their
clients, that it offer continuing educa-
tion credits, and that it not be aimed
at beginning clinicians. The latter
finding is consistent with research
showing that psychologists are not
interested in basictrainings (6) and
comports with the age and experience
of the respondents. Manualized treat-
ments and required supervision were
deal breakers for only a small number
of clinicians.
The clinicians, however, were not
willing to invest the time and money
that many evidence-based treatments
require. This was particularly true for
clinicians who served a higher per-
centage of Medicaid recipients, had
lower incomes, or who worked in both
agency and private settings, perhaps
due to financial necessity. Our results
highlight the need for more thought
about how to cover the costs of training.
It may be unrealistic for clinicians to
bearthefullcostoftraining;thecosts
may need to be paid by employers or
subsidized by governments and private
foundations.
Our results also suggest a need to
develop less expensive training initia-
tives that sacrifice little in terms of
intensity. One option is to deliver
training over the Internet (4,6). Di-
dactic approaches could be supple-
mented with expert supervision and
consultation, perhaps using a group
format to enhance cost-effectiveness
and efficiency. Our findings are con-
sistent with other studies that suggest
Web-based trainings are acceptable to
a majority of clinicians (2).
Several limitations of this study
should be considered. We obtained
a modest response rate, and it is
possible that response was related to
the variables of interest. For instance,
the respondents may have been more
motivated than nonrespondents to
invest in training, making the identi-
fied barriers to training all the more
salient. The survey was conducted in
a Midwestern state with no policy
mandate or support for evidence-based
treatments and may not be generaliz-
able to other states with different
policies. We were also unable to rely
upon an established measurement
protocol. It is possible that specifying
a specific treatment or diagnosis would
have influenced clinicianswillingness
to invest in training. Finally, there are
limits associated with self-report, given
that the extent to which attitudes
predict practice behavior is not well
established and that self-report has
been shown to be discordant with
observer ratings (11).
Conclusions
Further research should examine the
amount of time and money that
clinicians actually spend on training
and use qualitative methods to exam-
ine factors that may enhance clini-
ciansmotivation to attend training.
Ultimately, the successful implemen-
tation of evidence-based treatments
will necessitate innovative approaches
to financing and providing intensive
training.
Acknowledgments and disclosures
This work was supported in part by a Doris
Duke Fellowship for the Promotion of Child
Well-Being, by the Washington University In-
stitute of Clinical and Translational Sciences
grants UL1 RR024992 and TL1 RR024995
from the National Center for Research Resources,
and by the National Institute of Mental Health
(P30 MH068579, T32 MH019960, and F31
MH098478).
The authors report no competing interests.
References
1. Beidas RS, Kendall PC: Training thera-
pists in evidence-based practice: a critical
review of studies from a systems-contextual
perspective. Clinical Psychology: Science
and Practice 17:130, 2010
2. Herschell AD, Kolko DJ, Baumann BL,
et al: The role of therapist training in the
implementation of psychosocial treat-
ments: a review and critique with recom-
mendations. Clinical Psychology Review
30:448466, 2010
3. Lyon AR, Stirman SW, Kerns SEU, et al:
Developing the mental health workforce:
review and application of training approaches
from multiple disciplines. Administration
and Policy in Mental Health and Mental
Health Services Research 38:238253,
2011
4. Beidas RS, Edmunds JM, Marcus SC,
et al: Training and consultation to pro-
mote implementation of an empirically
supported treatment: a randomized tri-
al. Psychiatric Services 63:660665,
2012
5. Davis DA, Davis N: Educational inter-
ventions; in Knowledge Translation in
Health Care: Moving From Evidence to
Practice. Edited by Straus S, Tetroe J,
Graham ID. Oxford, United Kingdom,
Wiley-Blackwell, 2009
6. Stewart RE, Stirman SW, Chambless DL:
A qualitative investigation of practic-
ing psychologistsattitudes toward
research-informed practice: implications
for dissemination strategies. Professional
Psychology: Research and Practice 43:
100109, 2012
7. Stewart RE, Chambless DL: Interesting
practitioners in training in empirically
supported treatments: research reviews
versus case studies. Journal of Clinical
Psychology 66:7395, 2010
8. Gotham HJ: Diffusion of mental health
and substance abuse treatments: devel-
opment, dissemination, and implementa-
tion. Clinical Psychology: Science and
Practice 11:160176, 2004
9. Damschroder LJ, Aron DC, Keith RE,
et al: Fostering implementation of health
services research findings into practice:
a consolidated framework for advancing
implementation science. Implementation
Science 4:50, 2009
10. 2010 Census Urban and Rural Classifi-
cation and Urban Area Criteria. Wash-
ington, DC, United States Census Bureau,
2010. Available at www.census.gov/geo/
www/ua/2010urbanruralclass.html
11. Garland AF, Bickman L, Chorpita BF:
Change what? Identifying quality im-
provement targets by investigating usual
mental health care. Administration and
Policy in Mental Health and Mental
Health Services Research 37:1526,
2010
818 PSYCHIATRIC SERVICES 'ps.psychiatryonline.org 'August 2013 Vol. 64 No. 8
... On the other hand, when agency budgets are constrained, agency lead ers may be disinclined to adopt new programs and treatments that carry high training costs. Providers are shown to value training in evidence-based practices that have a good fit with their clients' needs, provide continuing educational opportunities, and are ad vanced beyond "beginning level" (Powell, McMillen, Hawley, & Proctor, 2013). Unlike pharmacology, where direct consumer marketing strives to increase patient demand for specific medications, the social services have paid too little attention to the potential role for clients in increasing demand for new and effective programs and treatments (Me givern et al., 2007). ...
... Testing the effectiveness of implementation strategies has been iden tified as a top research priority by the IOM (2009). Research to address this issue is found in practice-based research on implementation processes, trials of specific strate gies, and systematic reviews of strategy effectiveness (e.g., Powell et al., 2013). Captur ing implementation processes in action, Bunger et al. (2017) found that strategies like quality-improvement tools, using data experts, providing supervision, and sending clinical reminders were frequently used to facilitate delivery of behavioral health interventions within a child-welfare setting and were perceived by agency leadership as contributing to project success. ...
... Borkovec (2004) argued for develop ing practice research networks, providing an infrastructure for practice-based research and more efficient integration of research and practice. Powell et al. (2013) leveraged such a practice-based research network of Medicaid mental-health providers to learn more about their interests and willingness to participate in evidence-based practice train ing. ...
Chapter
Implementation science seeks to inform how to deliver evidence-based interventions, programs, and policies in real-world settings so their benefits can be realized and sustained. The aim of implementation science is building a base of evidence about the most effective processes and strategies for improving service delivery. Implementation research builds upon effectiveness research and then seeks to discover how to use specific implementation strategies and to move interventions into specific settings, extending their availability, reach, and benefits to clients and communities. This article provides an overview of implementation science as a component of research translation with an emphasis on traditional social work practice settings. The article begins by defining key terms, including implementation and evidence-based interventions. To inform conceptualization of implementation studies, the article continues with an overview of guiding implementation theories, models, and frameworks that explain the role of the multi-level practice context for implementation. Next, the article defines implementation strategies, identifies sources of implementation strategies, and provides recommendations for specifying and describing strategies that allow for replication. The article then describes methodological issues, including variable measurement, research design, and stakeholder engagement. Given the importance of designing implementation studies that optimize both internal and external validity, there is special attention to creative alternatives to traditional randomized controlled trials, and the potential for participatory and systems approaches. Finally, the article concludes with a discussion of future directions for implementation science in social work.
... However, the extent to which directto-consumer marketing campaigns affect private practice clinicians' behavior has not empirically been examined. Of note, there is evidence suggesting that clinicians working exclusively in private practice settings are willing to spend more time and money to learn new therapy approaches compared to clinicians working in other settings (Powell et al., 2013). This suggests that there are opportunities to leverage those resources to increase EBI use in private practice settings. ...
... Implementation strategies that support the development of peer consultation groups and that increase recognition of providers trained in EBIs may promote sustained EBI use. Additional strategies may be needed to recruit private practice providers to EBI-focused trainings, especially when those EBIs are perceived as not aligning with their theoretical orientation (Powell et al., 2013). Focused efforts to increase the reach of EBI training among private practice providers may improve the overall quality of client care in private practice settings. ...
Article
Full-text available
The private practice setting is understudied. Private practice includes settings in which mental health providers are unaffiliated with healthcare and hospital systems. Private practices may accept insurance (private and sometimes public) or no insurance (private pay). Increasing attention to this setting is critical to facilitating equitable access to mental health services, especially given enduring mental health workforce shortages and service waitlists. Further, there have been recent federal government calls to increase mental health and physical healthcare parity and to reduce out-of-pocket patient costs. Implementation science theories, models, frameworks, and methods can help illuminate determinants of private practice service availability and quality (e.g., evidence-based intervention delivery with fidelity), guide evaluation of implementation outcomes such as cost and acceptability of interventions to patients, and identify strategies to mitigate barriers to high-quality, affordable private practice services. This article suggests research questions to begin filling the private practice research gap using an implementation determinants framework — the Consolidated Framework for Implementation Research (CFIR) 2.0. Research questions are proposed across CFIR domains: outer context (e.g., policies impacting whether private practices accept insurance); individuals involved (e.g., provider professional experiences; direct-to-consumer marketing impacts on evidence-based intervention demand); innovation characteristics (e.g., appropriateness for private practice); inner context (e.g., organizational characteristics); and implementation processes (e.g., innovation sustainability). The illustrative research questions aim to begin a conversation amongst researchers and funders. Bringing an implementation science lens to the private practice context has the potential to improve the quality and affordability of mental health care for many.
... One key barrier to EBP implementation across multiple settings is insufficient training (Kilbourne et al., 2018;Whiteside et al., 2016). Lack of training may be due in part to a lack of access to training (Kobak et al., 2017) and costs associated with training (Powell et al., 2013;Stewart et al., 2012). Organizational support can facilitate training attendance and subsequent EBP implementation in community mental health settings Wolitzky-Taylor et al., 2018), but may be more limited in private practice (Frank et al., 2022). ...
... Availability of training in desired content areas, travel, cost, and time constraints were identified as key barriers to training attendance, while offering training online or "in-house", utilizing interactive training formats, and providing ongoing consultation and/ or certification after training were described as facilitating training attendance and content learning. These findings are consistent with previous studies examining training-related implementation determinants in private practice (Reid et al., 2017;Stewart et al., 2012) and other routine clinical settings (Herschell et al., 2014;Powell et al., 2013) and point to ways in which trainings may be modified to respond to clinician needs. Offering training online may reduce financial barriers and is likely equally effective as in-person training . ...
Article
Full-text available
Efforts to examine barriers to the implementation of evidence-based practices (EBPs) have largely focused on community mental health settings, although many people receive mental health services in private practice settings. Clinicians working in private practice likely face unique barriers to EBP implementation, but identifying strategies to increase EBP use in this setting is an understudied area of implementation research. The consolidated framework for implementation research (CFIR) provides an overview of multi-level determinants that influence implementation. The Characteristics of Individuals domain of the CFIR focuses on individual-level implementation determinants, such as perceptions of an intervention and self-efficacy in delivering it. Within the private practice context, little is known about how individual clinicians perceive EBPs and how this might influence their use of them. Thus, this study examined responses from qualitative interviews with 20 private practice clinicians to assess individual-level EBP implementation determinants in this context. Clinicians identified a range of attitudes towards EBPs and described how client factors influence their EBP use. Concerns about EBPs included perceptions that EBPs are too structured, are not generalizable to clinical practice, and are not suitable for a range of client populations. Clinicians also described several barriers and facilitators related to training in EBPs. Clinicians with training in exposure therapy (a well-established, but difficult-to-implement EBP) generally reported more positive attitudes, fewer barriers, and more frequent EBP use. Potential strategies to support EBP implementation in private practice are discussed.
... cw.org/)]. Much like other effective practices in child and adolescent behavioral health (Garland et al. 2010;Kohl et al. 2009;Raghavan et al. 2010;Zima et al. 2005), effective trauma interventions are underutilized, and even when organizations and systems adopt them, implementation challenges can limit their effectiveness Powell et al. 2013a). ...
... A thorough understanding of the factors that facilitate or impede effective implementation and the attainment of key implementation outcomes (e.g., adoption, fidelity, penetration, and sustainment) is needed to improve child and family outcomes and optimize the public health impact of traumafocused interventions. A number of studies have sought to understand barriers and facilitators to evidence-based interventions (Addis et al. 1999;Raghavan et al. 2007;Cook et al. 2009;Forsner et al. 2010;Rapp et al. 2010;Stein et al. 2013;Beidas 2016b;Powell et al. 2013aPowell et al. , 2013bPowell et al. , 2017a, and several conceptual frameworks in the field of implementation science have proposed an array of potential barriers and facilitators across levels (e.g., intervention, individual, team, organization, system, policy) and phases of implementation (e.g., exploration, preparation, implementation, and sustainment) Cane et al. 2012;Damschroder et al. 2009;Flottorp et al. 2013). These empirical and conceptual contributions highlight targets for implementation strategies that can promote the effective integration of evidence-based interventions into community settings (Powell et al. 2015). ...
Article
Full-text available
A systematic review was conducted to identify determinants (barriers and facilitators) of implementing evidence-based psychosocial interventions for children and youth who experience emotional or behavioral difficulties due to trauma exposure. Determinants were coded, abstracted, and synthesized using the Exploration, Preparation, Implementation, and Sustainment framework. Twenty-three articles were included, all of which examined implementation of Trauma-Focused Cognitive Behavioral Therapy or Cognitive-Behavioral Intervention for Trauma in Schools. This review identified multilevel and multiphase determinants that can be addressed by implementation strategies to improve implementation and clinical outcomes, and suggests how future studies might address gaps in the evidence base.
... In this day and age, it might be important to identify potential inexpensive and less timeconsuming training options that may produce similar results to an in-person training (B. J. Powell et al., 2013). ...
... This is problematic as the level of implementation is a key moderator of outcomes (Carroll et al., 2007). Researchers often attempt to optimize implementation through obtaining "buy in" from key stakeholders, the use of manuals, training and supervision and monitoring and feedback (Gearing et al., 2011;Powell et al., 2013). ...
Article
Full-text available
Objective A key challenge in delivering pragmatic trials of complex interventions is effective implementation within the study period and beyond. We describe a trial of an intervention to improve quality of life in mild dementia (Journeying through Dementia), describe some of the challenges raised in terms of implementation, and illustrate the methods used to ensure effective implementation. Method The intervention was delivered by staff within local services and supervised by more experienced clinicians within those services in order to test the intervention in real‐world settings and establish the potential for future embedding into practice. Researchers delivered training sessions for all facilitators and supervisors, met at regular intervals with intervention supervisors, and provided feedback on summaries of intervention sessions created by facilitators. We conducted a thematic analysis of the content of meetings and written correspondence between the researchers and intervention supervisors regarding implementation issues. Results Key themes relating to difficulties with implementation were: staff absences and staff leaving posts; participant lack of engagement with intervention; difficulties with delivery of supervision; difficult group dynamics; lack of time to deliver the intervention; and lack of adherence to the intervention and its ethos. Conclusion We provide guidance for researchers involved in the trialing of other complex interventions in how these challenges might be overcome. These include: recruiting additional staff to deliver the intervention; having clear protocols in place for managing staff absences; using supervision to problem solve participant attendance at intervention sessions and difficult group dynamics; monitoring staff engagement in supervision and addressing problems with engagement with staff and managers when this occurs; giving staff ring‐fenced time to deliver the intervention and engage in supervision; and regular monitoring and feedback in relation to the content of the intervention to ensure that it is consistent with ethos and content of the intervention manual.
Article
Occupational therapists are required to obtain CE units to ensure professional competency. This study examined occupational therapy practitioners to understand: What are OTPs’ perceived challenges and CE needs when working with populations with neurological impairments? And how can CE courses be tailored towards addressing these challenges and gaps in knowledge effectively? There were 14 responses and 6 themes identified. Participants indicated if they had access to supportive resources as well as their preferred mode of delivery for CE. The findings of this study can be used to identify the preferences, specific clinical skillsets currently used, and gaps in supportive resources. Keywords: continuing education, occupational therapy, perceptions, neurorehabilitation
Article
Full-text available
Effective, interactive trainings in evidence-based practices remain expensive and largely inaccessible to most practicing clinicians. To address this need, the current study evaluated the impact of a low-cost, multi-component, web-based training for Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT) on clinicians’ TF-CBT knowledge, strategy use, adherence and skill. Clinician members of a practice-based research network were recruited via email and randomized to either an immediate training group (N = 89 assigned) or waitlist control group (N = 74 assigned) that was offered access to the same training after six months, with half of each group further randomized to receive or not receive incentives for participation. Clinicians completed assessments at baseline, 6 months, and 12 months covering TF-CBT knowledge, strategy use, and for a subset of clinicians (n = 28), TF-CBT adherence and skill. Although significant differences in overall TF-CBT skillfulness and readiness were found, there were no significant differences between the training and waitlist control group on TF-CBT knowledge and strategy use at six months. However, there was considerable variability in the extent of training completed by clinicians. Subsequent post-hoc analyses indicated a significant, positive association between the extent of training completed by clinicians and clinician TF-CBT knowledge, strategy use, demonstrated adherence and skill across the three TF-CBT components, and overall TF-CBT readiness. We also explored whether incentives predicted training participation and found no differences in training activity participation between clinicians who were offered an incentive and those who were not. Findings highlight the limitations of self-paced web-based trainings. Implications for web-based trainings are discussed.
Article
Full-text available
Educational recommender systems offer benefits for workplace learning by tailoring the selection of learning activities to the individual’s learning goals. However, existing systems focus on the learner as the primary stakeholder of learning processes and do not consider the organization’s perspective. We conducted a systematic review to develop a categorization of workplace learning goals for multi-stakeholder recommender systems. Out of an initial set of 13,198 publications exported from databases, a final sample of 34 key publications was identified, according to predefined inclusion criteria. Content analysis and reflective exchange were deployed to synthesize workplace learning goals investigated in the key publications. We identified five categories of workplace learning goals that can be arranged along a dimension from intrinsic (goals set exclusively by the learner) to external (goals set exclusively by the organization). Our categorization provides a common language for multi-stakeholder recommender systems incorporating both the learner’s and the organization’s perspectives.
Article
Full-text available
Although advances have been made in facilitating the implementation of evidence-based treatments, little is known about the most effective way to sustain their use over time. The current study examined the sustainability of one evidence-based treatment, Parent–Child Interaction Therapy (PCIT), following a statewide implementation trial testing three training methods: Cascading Model, Learning Collaborative, and Distance Education. Participants included 100 clinicians and 50 administrators from 50 organizations across Pennsylvania. Clinicians and administrators reported on sustainability at 24-months, as measured by the number of clients receiving PCIT and the continued use of the PCIT protocol. Multi-level path analysis was utilized to examine the role of training on sustainability. Clinicians and administrators reported high levels of sustainability at 24-months. Clinicians in the Cascading Model reported greater average PCIT caseloads at 24-months, whereas clinicians in the Learning Collaborative reported greater full use of the PCIT protocol at 24-months. Attending consultation calls was associated with delivering PCIT to fewer families. Implications for the sustainable delivery of PCIT beyond the training year as well as for the broader field of implementation science are discussed.
Article
Full-text available
Theory and research regarding the diffusion of innovations and technology transfer have advanced our understanding of how new ideas and technologies are developed, disseminated, adopted, and implemented by individuals and organizations. Although diffusion has been studied in other fields, it is not often applied to mental health and substance abuse treatment. However, findings from diffusion-of-innovations research can assist in bridging research-practice gaps that lead to clients receiving treatments whose effectiveness has not been assessed or to clients not receiving the most effective treatments. This article reviews theory and research regarding the diffusion of innovations and highlights areas for application to mental health treatment, including the transportability of treatments into real-world settings, strategies to disseminate treatments, attributes of treatments that affect their adoption, and organizational change factors that affect implementation.
Article
Full-text available
This article presents the results of a qualitative analysis of interviews with 25 psychologists in independent practice, investigating everyday treatment decisions and attitudes about treatment outcome research and empirically supported treatments (ESTs). Clinicians noted positive aspects about treatment outcome research, such as being interested in what works. However, they had misgivings about the application of controlled research findings to their practices, were skeptical about using manualized protocols, and expressed concern that nonpsychologists would use EST lists to dictate practice. Clinicians reported practicing in an eclectic framework, and many reported including cognitive-behavioral elements in their practice. To improve their practice, they reported valuing clinical experience, peer networks, practitioner-oriented books, and continuing education when it was not too basic. Time and financial barriers concerned nearly all participants. Clinicians suggested they might be interested in ESTs if they could integrate them into their current frameworks, and if resources for learning ESTs were improved.
Article
Full-text available
The study evaluated the efficacy of three training modalities and the impact of ongoing consultation after training. Cognitive-behavioral therapy (CBT) for anxiety among youths, an empirically supported treatment, was used as the exemplar. Participants were randomly assigned to one of three one-day workshops to examine the efficacy of training modality: routine training (training as usual), computer training (computerized version of training as usual), and augmented training (training that emphasized active learning). After training, all participants received three months of ongoing consultation that included case consultation, didactics, and problem solving. Participants were 115 community therapists (mean age of 35.9 years; 90% were women). Outcome measures included the Adherence and Skill Checklist, used to rate a performance-based role-play; a knowledge test; and the Training Satisfaction Rating Scale. All three training modalities resulted in limited gains in therapist adherence, skill, and knowledge. There was no significant effect of modality on adherence, skill, or knowledge from pretraining to posttraining. Participants were more satisfied with augmented and routine training than with computer training. Most important, number of consultation hours after training significantly predicted higher therapist adherence and skill at the three-month follow-up. The findings suggest that training alone did not result in therapist behavior change. The inclusion of ongoing consultation was critical to influencing therapist adherence and skill. Implications for implementation science and mental health services research are discussed.
Article
Full-text available
Strategies specifically designed to facilitate the training of mental health practitioners in evidence-based practices (EBPs) have lagged behind the development of the interventions themselves. The current paper draws from an interdisciplinary literature (including medical training, adult education, and teacher training) to identify useful training and support approaches as well as important conceptual frameworks that may be applied to training in mental health. Theory and research findings are reviewed, which highlight the importance of continued consultation/support following training workshops, congruence between the training content and practitioner experience, and focus on motivational issues. In addition, six individual approaches are presented with careful attention to their empirical foundations and potential applications. Common techniques are highlighted and applications and future directions for mental health workforce training and research are discussed.
Article
Full-text available
Efforts to improve community-based children's mental health care should be based on valid information about effective practices and current routine practices. Emerging research on routine care practices and outcomes has identified discrepancies between evidence-based practices and "usual care." These discrepancies highlight potentially potent quality improvement interventions. This article reviews existing research on routine or "usual care" practice, identifies strengths and weaknesses in routine psychotherapeutic care, as well as gaps in knowledge, and proposes quality improvement recommendations based on existing data to improve the effectiveness of children's mental health care. The two broad recommendations for bridging the research-practice gap are to implement valid, feasible measurement feedback systems and clinician training in common elements of evidence-based practice.
Article
Theory and research regarding the diffusion of innovations and technology transfer have advanced our understanding of how new ideas and technologies are developed, disseminated, adopted, and implemented by individuals and organizations. Although diffusion has been studied in other fields, it is not often applied to mental health and substance abuse treatment. However, findings from diffusion-of-innovations research can assist in bridging research-practice gaps that lead to clients receiving treatments whose effectiveness has not been assessed or to clients not receiving the most effective treatments. This article reviews theory and research regarding the diffusion of innovations and highlights areas for application to mental health treatment, including the transportability of treatments into real-world settings, strategies to disseminate treatments, attributes of treatments that affect their adoption, and organizational change factors that affect implementation.
Chapter
“Education” is a broad and holistic term: while it conjures up a traditional didactic activity, the effective education of health professionals can be seen as an intervention, often with predisposing, enabling, and reinforcing strategies. This chapter describes educational interventions designed to promote the incorporation of best evidence into the practices of health professionals. It encompasses educational interventions more commonly considered as formal continuing education (CE) or continuing professional development (CPD). The chapter comprises: a theoretical basis for physician learning and education; an outline of effective large group methods; innovations in formal education employing high (and low) technology strategies; and finally, future trends in CE and health professional education.
Chapter
Globally health care systems are experiencing the challenges of improving the quality of care and decreasing the risk of adverse events. The “know-do” gap in health care practice and health systems management creates an “ethical urgency” for both the practice and science of knowledge translation (KT) to answer the challenges and optimize the return on investment in research. This chapter begins with the definition of KT, and explains the concepts of end of grant KT and integrated KT research. It discusses the importance of KT, and the determinants of KT. The practice of KT focuses on implementing research evidence and evaluating its impact. It is very much focused on the “doing” of KT and while the science of KT can be advanced alongside, it is not essential
Article
[Clin Psychol Sci Prac 17: 1–30, 2010] Evidence-based practice (EBP), a preferred psychological treatment approach, requires training of community providers. The systems-contextual (SC) perspective, a model for dissemination and implementation efforts, underscores the importance of the therapist, client, and organizational variables that influence training and consequent therapist uptake and adoption of EBP. This review critiques the extant research on training in EBP from an SC perspective. Findings suggest that therapist knowledge improves and attitudinal change occurs following training. However, change in therapist behaviors (e.g., adherence, competence, and skill) and client outcomes only occurs when training interventions address each level of the SC model and include active learning. Limitations as well as areas for future research are discussed.
Article
Evidence-based treatments (EBT) are underutilized in community settings, where consumers are often seen for treatment. Underutilization of EBTs may be related to a lack of empirically informed and supported training strategies. The goals of this review are to understand the state of the literature for training therapists in psychotherapy skills and to offer recommendations to improve research in this area. Results of this review of 55 studies evaluating six training methods indicate that multi-component trainings have been studied most often and have most consistently demonstrated positive training outcomes relative to other training methods. Studies evaluating utility of reading, self-directed trainings, and workshops have documented that these methods do not routinely produce positive outcomes. Workshop follow-ups help to sustain outcomes. Little is known about the impact of train-the-trainer methods. Methodological flaws and factors that may influence training outcome and future directions are also reviewed.