ArticlePDF Available

The Science of Training: A Decade of Progress



This chapter reviews the training research literature reported over the past decade. We describe the progress in five areas of research including training theory, training needs analysis, antecedent training conditions, training methods and strategies, and posttraining conditions. Our review suggests that advancements have been made that help us understand better the design and delivery of training in organizations, with respect to theory development as well as the quality and quantity of empirical research. We have new tools for analyzing requisite knowledge and skills, and for evaluating training. We know more about factors that influence training effectiveness and transfer of training. Finally, we challenge researchers to find better ways to translate the results of training research into practice.
December 11, 2000 22:54 Annual Reviews AR120-18
Annu. Rev. Psychol. 2001. 52:471–99
2001 by Annual Reviews. All rights reserved
of Progress
Eduardo Salas
and Janis A. Cannon-Bowers
Department of Psychology and Institute for Simulation & Training,
University of Central Florida, Orlando, Florida 32816-1390;
Naval Air Warfare Center Training Systems Division, Orlando,
Florida 32826-3224; e-mail:
Key Words training design, training evaluation, distance training, team training,
transfer of training
Abstract This chapter reviews the training research literature reported over the
pastdecade. Wedescribetheprogressinfiveareasofresearchincludingtrainingtheory,
trainingneedsanalysis, antecedenttrainingconditions, trainingmethodsandstrategies,
and posttraining conditions. Our review suggests that advancements have been made
that help us understand better the design and delivery of training in organizations, with
respect to theory developmentas well as the quality and quantity of empirical research.
We have new tools for analyzing requisite knowledge and skills, and for evaluating
training. We know more about factors that influence training effectiveness and transfer
of training. Finally, we challenge researchers to find better ways to translate theresults
of training research into practice.
INTRODUCTION ................................................ 472
Initial Observations
............................................. 473
Theoretical Developments
......................................... 473
..................................... 475
Organizational Analysis
.......................................... 475
Job/Task Analysis
............................................... 476
............................. 477
Individual Characteristics
......................................... 478
Training Motivation
............................................. 479
Training Induction and Pretraining Environment
......................... 480
Specific Learning Approaches
...................................... 482
Learning Technologies and Distance Training
........................... 483
Simulation-Based Training and Games
................................ 484
Team Training
................................................. 485
December 11, 2000 22:54 Annual Reviews AR120-18
POST-TRAINING CONDITIONS .................................... 486
Training Evaluation
............................................. 487
Transfer of Training
............................................. 488
Inthe 30yearssincethefirstreviewoftraining intheAnnualReviewofPsychology,
things have progressed dramatically in terms of both the science and practice
of training. On the practice side, socio-cultural, technological, economic, and
politicalpressureshave all combined to force modern organizationsto take a closer
look at their human capital in general, and training in particular (Thayer 1997,
Howard 1995). In fact, now more than ever, organizations must rely on workplace
learning and continuous improvement in order to remain competitive (London &
Moore 1999). In addition, organizations have shifted their views about training
from a separate, stand-alone event to a fully integrated, strategic component of the
organization. New training-related approaches, including action learning, just-in-
time training, mentoring, coaching, organizational learning, and managing skill
portfoliosareallcurrentlybeingexplored.Finally, modernorganizationsmustcope
both an older and more diverse workforce can be expected as we move into the
new millennium.
It is important to note that improved training comes at a cost. Recent esti-
mates suggest that the investment in training activities in organizations ranges
from $55.3 billion to $200 billion annually (Bassi & Van Buren 1999, McKenna
1990), an investment that has not only created a growing interest in training, but
also in learning technologies and performance-improvement processes, practices,
and services. In fact, there is an increasing concern in organizations that the in-
vestment made in training must be justified in terms of improved organizational
performance—increased productivity, profit, or safety; reduced error, enhanced
market share (e.g. Huselid 1995, Martocchio & Baldwin 1997, Salas et al 2000).
The past 30 years have also witnessed tremendous growth in training research.
This trend has been so pronounced that we are led to conclude that there has
been nothing less than an explosion in training-related research in the past 10
years. More theories, models, empirical results, reviews, and meta-analyses are
available today than ever before. Whether this research is having an effect on
training practice—that is, a meaningful impact on how organizations actually
train—is a matter of some debate. We return to this issue after documenting the
many advances in training research over the past decade.
This is the sixth review of training and development to appear in the Annual
Review of Psychology(see Campbell 1971, Goldstein 1980, Wexley 1984, Latham
1988, Tannenbaum & Yukl 1992). In this review, we focus on research published
from1992 to January 2000. Similar to Tannenbaum & Yukl’s (1992), our reviewis
December 11, 2000 22:54 Annual Reviews AR120-18
selectiveanddescriptive. We focusprimarilyontheresearchthatisconcernedwith
the design, delivery, and evaluation of training in work organizations. Our review
is organized as follows. We first discuss the recent theoretical advancements in
training over the past decade. Then we address the relevant research on training
needs analysis, including organization, job/task, and person analysis. Following
this, we address antecedent training conditions (i.e. pretraining variables) that
may enhance or disrupt learning. Next we turn our discussion to research on
training methods and instructional strategies. In this section we discuss recent
developments in simulation-based training, learning approaches, team training,
and the influence of technology on training research and practice. Finally we
review the research on post-training conditions. This includes a discussion of
training evaluation and transfer of training. Wherever appropriate we point out
the research needs and gaps. We conclude with a few observations and trends
and a word about the future. Consistent with previous reviews, this review does
not cover basic issues involved in skill acquisition and learning, organizational
development, socialization in organizations, or educational psychology. We also
do not synthesize the large literature in practitioner-oriented publications.
Initial Observations
Our first observation is that in 30 years of documenting the progress of training
research, it is clear that the field, by any measure, has changed dramatically—
for the better. Now, as recent reviews have documented, training-related theories
abound. As noted earlier, there is also more empirical training-related research
going on—in the field as well as in the lab—than ever before. Researchers are
adopting a systems view of training and are more concerned with the organiza-
tionalcontext. Thereare newmodels, constructs(e.g.opportunitytoperform), and
influences(e.g. technology)inthereported research.Thetraditional trainingevalu-
ationparadigmhasbeen expanded,andtherearemoreevaluationsbeingconducted
and reported. There are better tools with which to conduct training evaluations,
and better (and more practical) experimental designs have emerged. The field can
now offer sound, pedagogically based principles and guidelines to practitioners
and instructional developers. Furthermore, the impact of training on performance
and organizational effectiveness is being felt (Bassi & Van Buren 1999), although
clearly more documentation is needed here. Finally, there are more books and
textbooks related to training (e.g. Ford et al 1997, Quinones & Ehrestein 1997,
Noe 1999, Wexley & Latham 2000, Goldstein 1993; plus over 20 more that have
been reviewed in Personnel Psychology). The science of training has progressed
and matured—it is now truly an exciting and dynamic field. As evidence for this
assertion, we summarize some of the latest theoretical advancesinthenextsection.
Theoretical Developments
There have been some influential theories developed about training since 1992.
In fact, the past decade has offered us myriad new and expanded theoretical
December 11, 2000 22:54 Annual Reviews AR120-18
frameworks, as well as concepts and constructs. This thinking is deeper, richer,
more comprehensive, and more focused. More importantly, the field has been
energized by these developments so that empirical work has followed. Some of
these frameworks and concepts are broad, general, and integrating. For example,
Tannenbaum and colleagues provided an integrative framework for all the vari-
ablesthatinfluencethedesignanddelivery of training (see Tannenbaum et al 1993,
Cannon-Bowers et al 1995). The framework outlines in detail the pretraining and
during-training conditions that may influence learning, as well as the factors that
may facilitate the transfer of skills after training. Kozlowski & Salas (1997), draw-
ing from organizational theory, discussed the importance of characterizing the
factors and processes in which training interventions are implemented and trans-
ferred in organizations. Moreover, Kozlowski and colleagues (Kozlowski et al
2000) consider organizational system factors and training design issues that influ-
ence the effectiveness of vertical transfer processes. Vertical transfer refers to the
upwardpropagationofindividual-leveltraining outcomesthatemergeasteam-and
yet is suggested to be crucial to training effectiveness. Similarly, researchers have
they implement training (Dipboye 1997, Salas et al 1999). In other work,
Kraiger et al (1993) provided new conceptualizations of learning and evalua-
tion theory, approaches, and measurement. These authors expanded Kirkpatrick’s
(1976) evaluation typology by incorporating recent notions in cognitive
Other conceptual developments are more focused. For example, Ford et al
(1997) invoked “the opportunity to perform” construct as a way to understand
the transfer of training process. Colquitt et al (2000) summarized (qualitatively
and quantitatively) the literature on training motivation and offered a new, inte-
grative model. Cannon-Bowers & Salas (1997) proposed a framework for how to
conceptualize performance measurement in training. Thayer & Teachout (1995)
developed a model to understand the climate for transfer in organizations, as well
as in-training conditions that enhance transfer. Cannon-Bowers et al (1998) ad-
vanced a number of conditions, concepts, and interventions that may enhance
practice. Ford and colleagues have looked at individual differences and learner
control strategies (e.g. Ford et al 1998). Training researchers have also examined
variablessuchasthe pretraining context(e.g. Baldwin&Magjuka1997, Quinones
1995), conscientiousness and training outcomes(e.g. Colquitt & Simmering 1998,
Martocchio&Judge1997),individualand situational characteristicsthatinfluence
training motivation (e.g. Facteau et al 1995, Mathieu& Martineau 1997), and par-
ticipation in developmental activities(e.g. Noe & Wilk 1993, Baldwin & Magjuka
1997), just to name a few.
In sum, these theoretical advancements have provided a much needed forum in
which to discuss, debate, analyze, and understand better the design and delivery of
training in organizations. Moreover, they have provided an organized framework
in which systematic research could be couched. Our conclusion is that training
December 11, 2000 22:54 Annual Reviews AR120-18
research is no longer atheoretical as charged by our predecessors. We believe the
field is healthier because of these influences and all the empirical work that has
It is well acknowledged that one of the most important steps in training develop-
mentisconductingatrainingneedsanalysis. Thisfirststepintrainingdevelopment
focuses on the process of deciding who and what should be trained. A training
needs analysis is primarily conducted to determine where training is needed, what
needs to be taught, and who needs to be trained (Goldstein 1993). This phase
has several outcomes. One is the specification of learning objectives, which in
turn shape the design and delivery of training, as well as the process of criterion
development. Consistent with Tannenbaum & Yukl (1992), we found a limited
amount of empirical work on training needs analysis. In this section we discuss
twocomponents: organizationalanalysisandjob/taskanalysis. We briefly address
the third phase—person analysis.
Organizational Analysis
Thepurpose of an organizational analysis is to outline thesystemwide components
of the organization that may affect the delivery of a training program (Goldstein
1993). That is, it focuses on thecongruence between training objectives with such
factors as organizational goals, available resources, constraints, and support for
transfer. Unfortunately, many training programs fail to reach their goals because
of organizational constraints and conflicts, which could have been identified and
ameliorated before training was implemented. Hence, conducting an organiza-
tional analysis is an important first-step training design. The best treatment of this
topic can be found in Goldstein (1993).
Only recently have training researchers begunto pay attention to organizational
analysis. One study, conducted by Rouiller & Goldstein (1993) in a chain of
fast food restaurants, demonstrated that organizational climate (e.g. situational
cues, consequences) was a powerful predictor of whether trainees transferred the
learned skills. A second study conducted in a chain of supermarkets by Tracey
et al (1995)showedthat organizational climate and culture were directly related to
posttraining behaviors. Clearly, these two studies illustrate howpowerful an effect
the organizational environment can have on whether newly acquired knowledge,
skills, and attitudes (KSAs) are applied on the job (see also the transfer of training
As job requirements change, so does the need to help organizations plan
their human resources activities. A number of issues have emerged that are re-
lated to organizational analysis. For example, authors have expressed the need
to understand how the organizational context influences human resources strate-
gies (e.g. Tannenbaum & Dupuree-Bruno 1994) to enhance continuous learning
December 11, 2000 22:54 Annual Reviews AR120-18
environments (e.g. London & Moore 1999), to manage knowledge effectively
(e.g. Tannenbaum 1997), and to determine the best organizational strategy
(e.g. who is responsible for training?) for learning and training (e.g. Martocchio &
Baldwin 1997). Obviously, organizational analysis is crucial for ensuring the
success of a training program. However, more research is needed to develop
practical and diagnostic tools to determine the organizational context relative to
Job/Task Analysis
Historically, job/task analysis has been used to identify the information necessary
to create the learning objectives (Goldstein 1993). A job/task analysis results in a
underwhichthejobistobeperformed, andtheKSAsneededtoperformthosetasks.
Inthepastdecade,newresearchaimedatdevelopingsolidmethods, approaches,
and knowledge elicitation techniques for determining training needs and require-
ments have emerged. For example, Arvey et al (1992) explored the use of task
inventories to forecast skills and abilities necessary for a future job. The results
indicated that such forecasting predictions could represent useful information to
training analysis. Wilson & Zalewski (1994) tested an expert system program as
a way to estimate the amount of 11 abilities required for performing a job. The
results indicated that most incumbents preferred the expert system method to the
traditional ability rating scales.
Some attention has been given to better understanding the job/task analysis
process for training purposes. For example, Ford et al (1993) examined the impact
of task experience and individual factors on task ratings of training emphasis. Re-
sults indicated that as experience (and self-efficacy) increased over time, it tended
to cause trainees to increase their ratings of training emphasis. Also, a few re-
searchershave focusedon outlining a task analysis procedure for teams (e.g. Baker
et al 1998, Bowers et al 1993, Blickensderfer et al 2000). Much more research is
needed, however. Specifically, we need to design and develop a methodology that
helps instructional designers and analysts uncover the team-based tasks and their
related KSAs.
Cognitive Task Analysis Cognitive task analysis refers to a set of procedures for
It has received much attention recently (see Dubois et al 1997/1998, Schraagen
et al 2000), fueled primarily by interest in understanding how trainees acquire and
develop knowledge, and how they organize rules, concepts, and associations (see
Zsambok & Klein 1997). In addition, research aimed at uncovering the nature of
expertise and how experts make decisions in complex natural environments has
led to the development of tools such as cognitive task analysis (see Salas & Klein
2000, Schraagen et al 2000).
December 11, 2000 22:54 Annual Reviews AR120-18
Cognitive task analysis is based on techniques (e.g. verbal protocols) used by
cognitive scientists to elicit knowledge from subject matter experts. Products of a
cognitive task analysis includeinformation-generating templates for mental model
development, cues for fostering complex decision-making skills, cues for devel-
oping simulation and scenarios used during training, and information for design-
ing performance measurement and feedback protocols. For example, Neerincx &
Griffoen (1996) applied a cognitive task analysis to assess the task load of jobs
and to provide indicators for the redesign of jobs. This new application showed
its benefits over the “old” task load analysis.
A cognitive task analysis can complement existing (behavioral) forms of
training-need analysis. For example, research on meta-cognition suggests that
through continued practice or experience, individuals automatize complex behav-
iors, thus freeing up cognitive resources for monitoring and evaluating behavior
(Rogers et al 1997). By determining trainees’ current complex cognitive skills,
instructional designers can gain insight into trainees’ capacity for proficiency and
diagnose performance deficiencies. Thus, training-needs analysis should identify
not only the requisite knowledge and skills to perform tasks, but also the cues and
cognitions that enable trainees to know when to apply those skills. By incorporat-
trainees with valuableself-help tools. Cognitivetask analysis is becoming a useful
toolbutneeds more development. Specifically, atheoreticallydriven methodology
that clearly outlines the steps to take and how to analyze the data is needed.
We found no empirical work regarding the third phase of training-needs
analysis—person analysis. However, the emerging literature of 360
may be relevant. This approach identifies individual strengths and weaknesses,
but perhaps more importantly, provides suggestions for improvement that often
revolve around training and development activities.
In summary, it is interesting to note that whereas most training researchers
believe and espouse that training-needs analysis is the most important phase in
training, this phase remains largely an art rather than a science. We need more
research that would enable us to develop a systematic methodology to determine
the training needs of organizations.
Events that occur before training can be as important as (and in some cases more
important than) those that occur during and after training. Research has shown
that activities that occur prior to training have an impact on how effective training
turns out to be (Tannenbaum et al 1993). These factors fall into three general
categories: (a) what trainees bring to the training setting, (b) variables that engage
the trainee to learn and participate in developmental activities, and (c) how the
training can be prepared so as to maximize the learning experience. Each of these
is described in more detail below.
December 11, 2000 22:54 Annual Reviews AR120-18
Individual Characteristics
Cognitive Ability Research aimed at understanding how characteristics the
trainee brings to the training environment influence learning has proliferated in
the past decade. For example, Ree et al (1995) developed a causal model show-
ing the role of general cognitive ability and prior job knowledge in subsequent
job-knowledge attainment and work-sample performance during training. The
resulting model showed that ability influenced the attainment of job knowledge
directly, and that general cognitive ability influenced work samples through job
knowledge. Similar findings have been obtained by Ree & Earles (1991), Colquitt
et al (2000), Randel et al (1992), Quick et al (1996), Kaemar et al (1997), Warr &
Bunce (1995), and many others. Therefore, it is safe to conclude, based on this
body of evidence (and others as well, e.g. Hunter 1986), that g (general intelli-
gence) is good—it promotes self-efficacy and performance, and it helps a great
deal with skill acquisition. Clearly, those who havehigh cognitive ability (all other
things being equal) will likely learn more and succeed in training.
At this point, we probably need to look more closely at low-ability trainees and
conduct research on how to optimize learning for them. Also, it might be worth-
while to examine in more depth concepts such as tacit knowledge and practical
intelligence (Sternberg 1997) and their relation to on-the-job learning. Finally, it
is worth noting that cognitive ability is a viable predictor of training performance
(i.e. learning), but not necessarily performance on the job. Many jobs have re-
quirements that go beyond cognitive ability (e.g. psychomotor demands), and/or
depend on other factors (e.g. motivation) for success. Therefore, it is important
to understand the nature of the job to determine whether cognitive ability will be
a valid predictor of training transfer.
Self-efficacy This construct has been widely studied in this past decade. The
findings are consistent: Self-efficacy, whether one has it before or acquires it
during training, leads to better learning and performance. Self-efficacy (the be-
lief that one can perform specific tasks and behaviors) is a powerful predictor of
performance, as has been shown time and time again (e.g. Cole & Latham 1997
Eden & Aviram 1993, Ford et al 1998, Mathieu et al 1993, Martocchio 1994,
Martocchio & Webster 1992, Mathieu et al 1992, Quinones 1995, Mitchell et al
1994, Phillips & Gully 1997, Stevens & Gist 1997, Stajkovic & Luthans 1998).
Self-efficacy also mediates a number of personal variables including job satisfac-
tion,organizationalcommitment, intentiontoquit thejob,therelationship between
training and adjustment in newcomers (Saks 1995), and the relationship between
conscientiousness and learning (Martocchio & Judge 1997). Self-efficacy has also
beenshown to havemotivationaleffects(e.g. Quinones1995), to influence training
reactions (Mathieu et al 1992), and to dictate whether trainees will use training
technology (Christoph et al 1998).
In sum, it is well established that self-efficacy enhances leaning outcomes and
performance. A research need that still remains is to expand what we know about
December 11, 2000 22:54 Annual Reviews AR120-18
self-efficacy at the team level. Whereas a few studies have investigated collective
efficacy in training (e.g. Guzzo et al 1993, Smith-Jentsch et al 2000), considerably
more work is needed to better understand the mechanisms of collective efficacy in
learning as a means to raise team performance. In addition, it might be useful to
training targeted at raising self-efficacy), as well as a desirable outcome of training
(i.e. as an indicator of training success).
Goal Orientation Goal orientation has received considerable attention in recent
years (e.g. Brett & VandeWalle 1999, Ford et al 1998, Phillips & Gully 1997).
This construct is broadly conceptualized as the mental frameworkused by individ-
uals to interpret and behave in learning- or achievement-oriented activities. Two
classes of goal orientation have been identified (Dweck 1986, Dweck & Leggett
1988): (a) mastery (or learning) goal orientation, whereby individuals seek to
develop competence by acquiring new skills and mastering novel situations, and
(b) performance goal orientation, whereby individuals pursue assurances of their
own competence by seeking good performance evaluations and avoiding negative
ones. There is a debate in the literature as to whether goal orientation is a disposi-
tion, a state, or both (e.g. Stevens & Gist 1997), whether it is a multidimensional
construct (e.g. Elliot & Church 1997, VandeValle 1997), or whether these two
goal strategies are mutually exclusive (Buttom et al 1996). Although continued
research will bring more conceptual clarity, recent studies have shown, in general,
that goal orientation influences learning outcomes and performance. For example,
Fisher & Ford (1998) found that a mastery orientation was a strong predictor of a
knowledge-based learning outcome. Ford et al (1998) showed that mastery orien-
tationwaspositively relatedtothe meta-cognitiveactivityofthetrainee. Phillips&
Gully (1997) demonstrated that mastery goal orientation was positively related to
self-efficacy. All these results are promising. More research is needed to de-
termine how goal orientation is developed. Specifically, it must be determined
whether goal orientation is a relatively stable trait, or if it can be modified prior to
training. Should the latter be true, then efforts to move trainees toward a mastery
orientation should be developed.
Training Motivation
Training motivation can be conceptualized as the direction, effort, intensity, and
persistence that trainees apply to learning-oriented activities before, during, and
after training (Kanfer 1991, Tannenbaum & Yukl 1992). Recently, several studies
have found (and confirmed) that trainees’ motivation to learn and attend train-
ing has an effect on their skill acquisition, retention, and willingness to apply
the newly acquired KSAs on the job (e.g. Martocchio & Webster 1992, Mathieu
et al 1992, Quinones 1995, Tannenbaum & Yukl 1992). Whereas the literature is,
in general, clear about the influence of training motivation on learning outcomes,
it has lacked some conceptual precision and specificity, and has been somewhat
December 11, 2000 22:54 Annual Reviews AR120-18
piecemeal. An exception is a recent effort by Colquitt et al (2000) that has shed
light on the underlying processes and variables involved in understanding training
motivation throughout the training process. Their integrative narrative and meta-
analytic review suggest that training motivation is multifaceted and influenced
by a set of individual (e.g. cognitive ability, self-efficacy, anxiety, age, conscien-
tiousness) and situational (e.g. climate) characteristics. This effort provides the
beginnings of an integrative theory of training motivation—a much needed syn-
thesis and organization.
Colquitt et al’s review. For example, they point out the need to assess trainee’s
personalityduringtraining-needsanalysis, amuchneglectedorignoredassessment
during person analysis. In fact, Colquitt et al also called for the need toexpand the
adaptability, traitgoalorientation,andotherBigFivevariables. Anotherimportant
implication is the link they found between age and motivation to learn—older
workers showed lower motivation, learning, and post-training efficacy. However,
it may be prudent to consider this conclusion carefully because a host of other
issues must be considered when discussing the training needs of older workers
(including the design of training itself). Clearly, in an era of technology-driven
todesignlearningenvironments where older trainees can be trained(andretrained)
with ease.
In the future, we also need to continue gaining a deeper understanding of train-
ing motivation because it is crucial for learning and has direct implications for
the design and delivery of training. Future work should consider those factors
that influence training motivation for job development activities and for situa-
tions in which workers acquire new skills through informal learning mechanisms.
Longitudinal studies are also needed.
Training Induction and Pretraining Environment
Considerable research has gone into understanding which factors help trainees to
optimize the benefits of training. These are usually interventions employed before
training to ensure that the trainee gets the most out of the learning experience.
Prepractice Conditions It is well documented that practice is a necessary con-
dition for skill acquisition. However, all practice is not equal. In fact, the precise
nature of practice and its relationship to learning outcomes has been largely igno-
red or misunderstood. Recent thinking and research is beginning to suggest that
practice may be a complex process, not simply task repetition (e.g. Ehrenstein
et al 1997, Shute & Gawlick 1995, Schmidt & Bjork 1992); we address this
issue further in Specific Learning Approaches. For example, Cannon-Bowers et al
(1998) provided a frameworkfor delineating the conditions that might enhance the
December 11, 2000 22:54 Annual Reviews AR120-18
utility and efficacy of practice in training. They drew from the literature a number
of interventions (e.g. meta-cognitive strategies, advanced organizers, and prepara-
tory information) that can be applied before actual practice as a way to prepare
the trainee for training. Empirical verification of these interventions needs to be
The Pretraining Environment and Climate Can pretraining contextual factors
also affect learning outcomes? Recent research suggests that the manner in which
intrainingdoinfluencelearningoutcomes. Forexample,Quinones(1995) demon-
stratedthat the manner in which training wasframed (i.e. as advancedor remedial)
influenced training motivation and learning (see also Quinones 1997). Martocchio
(1992), who labeled the training assignment as an “opportunity, showed similar
findings. Smith-Jentsch et al (1996a) demonstrated that trainees’ previous expe-
riences with training (e.g. prior negative events) affected learning and retention.
Baldwin & Magjuka (1997) explored the notion of training as an organizational
episode and laid out a framework of other pretraining contextual factors (e.g. vol-
untaryversusmandatoryattendance)that mayinfluencemotivationto learn. These
studies suggest that experience with training (both task-based and event-based) is
important to subsequent training outcomes. This is certainly a neglected area, and
one in which much more work is needed. Specifically, we need to know how
these experiences shape self-efficacy, expectations about the training, motivation
to learn and apply skills on the job, and learning.
Instructional strategies are defined as a set of tools (e.g. task analysis), methods
(e.g. simulation), and content (i.e. required competencies) that, when combined,
create an instructional approach (Salas & Cannon-Bowers 1997). Most effective
strategies are created around four basic principles: (a) They present relevant in-
formation or concepts to be learned; (b) they demonstrate the KSAs to be learned;
(c) they create opportunities for trainees to practice the skills; and (d) they pro-
vide feedback to trainees during and after practice. Because there is no single
method to deliver training, researchers continue to address how to best present tar-
geted information to trainees. Specifically, researchers are seeking cost-effective,
content-valid, easy-to-use, engaging, and technology-based methods (e.g. Baker
et al 1993, Bretz & Thompsett 1992, Steele-Johnson & Hyde 1997). In the next
section, we review research related to instructional strategies in several major
categories. First, we review specific learning approaches and learning technolo-
gies and distance training. Next, we cover simulation-based training and games,
followed by a review of recent work in team training.
December 11, 2000 22:54 Annual Reviews AR120-18
Specific Learning Approaches
Traditionally, training researchers have investigated how to optimize learning
and retention by manipulating feedback, practice intervals, reinforcement sched-
ules, and other conditions within the learning process itself. In this regard, Fisk,
Kurlik, and colleagues (Kirlik et al 1998) improved performance in a complex
decision-making task by training consistently mapped components of the task to
automaticity (i.e. so that they could be performed with little or no active cognitive
control). Along these same lines, Driskell et al (1992) conducted a meta-analysis
oftheeffectsof overlearningonretention. The results of their analysis showedthat
overlearning produces a significant effecton retention which, in turn, is moderated
by the degree of overlearning, length of retention period, and type of task.
Attention has also been focusedon developing collaborative training protocols.
This is distinguished from team training (see below) by the fact that team training
applies to training competencies that are required for performance of a team task.
Collaborative learning, on the other hand, refers to situations where trainees are
trained in groups, but not necessarily to perform a team task. The idea is that there
are features of group interaction that benefit the learning process (e.g. the oppor-
tunity for vicarious learning or interaction with peers). For example, Arthur et al
(1997) provided strong support and justification for the ongoing use of innovative
dyadic protocols (i.e. training two trainees at once) for the training of pilots and
navigators in both military and nonmilitary settings. However, Arthur et al (1996)
showed that the comparative effectiveness of dyadic versus individual protocols
for computer-based training is moderated by trainees’ level of interaction anxiety,
with only low interaction anxiety trainees benefiting from dyadic protocols (see
also Arthur et al 1997). Collaborative protocols have also been shown to reduce
required instructor time and resources by half (Shebilske et al 1992), and to pro-
vide observational learning opportunities that compensate for hands-on practice
efficiently and effectively, as predicted by social learning theory (Shebilske et al
Researchers have also studied the conditions of practice as they relate to learn-
ing. Forexample,Goettletal(1996)comparedanalternatingtaskmoduleprotocol,
which alternated sessions on video game–like tasks and algebra word problems,
with a massed protocol, which blocked sessions on the tasks. The findings showed
that alternating task modules provided an advantage in learning and retention in
both the video games and algebra word problems.
Along these lines, Bjork and colleagues (Schmidt & Bjork 1992, Ghodsian
etal 1997) haveprovided an interesting reconsideration offindings regardingprac-
tice schedules. These authors argued that introducing difficulties for the learner
during practice will enhance transfer (but not necessarily immediate posttraining
performance). By reconceptualizing interpretation of data from several studies,
Schmidt & Bjork (1992) provided a compelling case for a new approach to arrang-
ing practice. This approach includes introducing variation in the way tasks are
December 11, 2000 22:54 Annual Reviews AR120-18
the task to be practiced, and also by providing less frequent feedback. In all cases,
the authors argue that even though acquisition (i.e. immediate) performance may
be decreased, retention and generalization are enhanced owing to additional—
and most likely deeper—information processing requirements during practice.
Shute&Gawlick(1995)supported thisconclusioninan investigationofcomputer-
based training for flight engineering knowledge and skill.
In other work, Driskell and colleagues (Driskell & Johnston 1998, Johnston &
Cannon-Bowers 1996; JE Driskell, E Salas, JH Johnston, submitted) have inves-
tigated the use of stress-exposure training (SET) as a means to prepare trainees
to work in high stress environments. SET, which is based on clinical research
into stress inoculation, has several phases. In the first phase, trainees are provided
with preparatory information that includes a description of which stressors are
likely to be encountered in the environment and what the likely impact of those
stressors on the trainee will be. The second phase—skill acquisition—focuses on
behavioral- and cognitive-skills training designed to help trainees cope with the
stress. In the final phase, application and practice of learned skills is conducted
under conditions that gradually approximate the stress environment. Results of
investigations of this protocol have indicated that SET is successful in reducing
trainees’subjective perception of stress, whileimprovingperformance. Moreover,
the effects of SET generalized to novel stressors and tasks.
Learning Technologies and Distance Training
There is no doubt that technology is shaping how training is delivered in organiza-
tions. While still relying heavily on classroom training, organizations have begun
to explore technologies such as video conferencing, electronic performance sup-
portsystems, videodiscs,andon-lineInternet /Intranetcourses.Indeed,Web-based
training may make “going-to” training obsolete. It is being applied in education,
industry, andthe militaryatanalarming rate(thesedays,onecanget aPhDthrough
the Web). What is probably more alarming is that this implementation is happen-
ing without much reliance on the science of training. Many issues about how
to design distance learning systems remain open. Theoretically-based research
is needed to uncover principles and guidelines that can aid instructional design-
ers in building sound distance training. A few have begun to scratch the surface
(e.g. Schreiber & Berge 1998) of this topic, but a science of distance learning and
training needs to evolve. Specifically, it must be determined what level of inter-
action is needed between trainees and instructors. Moreover, the nature of such
interaction must be specified. For example, do instructors need to see trainees in
order to conduct effective instruction? Do trainees need to see instructors or is it
better for them to view other material? What is the best mechanism for address-
ing trainee questions (e.g. through chat rooms or e-mail)? Should learners have
control over the pace and nature of instruction [some evidence from studies of
computer-based training support the use of learner control (see Shute et al 1998),
but the extent of its benefits for distance learning is not known]? These and
December 11, 2000 22:54 Annual Reviews AR120-18
other questions must be addressed as a basis to develop sound distance-training
Advances in technology are also enabling the development of intelligent tu-
toring systems that have the potential to reduce or eliminate the need for human
instructors for certain types of learning tasks. Early indications are that intelli-
gent software can be programmed to successfully monitor, assess, diagnose, and
remediate performance in tasks such as computer programming and solving alge-
bra problems (e.g. see Anderson et al 1995). As this technology becomes more
widely available (and less costly to develop), it may provide organizations with a
viable alternative to traditional computer-based or classroom training.
Simulation-Based Training and Games
Simulation continues to be a popular method for delivery training. Simulators are
widely used in business, education, and the military (Jacobs & Dempsey 1993).
In fact, the military and the commercial aviation industry are probably the biggest
investors in simulation-based training. These simulations range in cost, fidelity,
and functionality. Many simulation systems (including simulators and virtual en-
vironments) have the ability to mimic detailed terrain, equipment failures, motion,
vibration, and visual cues about a situation. Others are less sophisticated and have
less physical fidelity, but represent well the KSAs to be trained (e.g. Jentsch &
Bowers 1998). A recent trend is to use more of these low-fidelity devices to train
complex skills. There is also more evidence that skills transfer after training
that uses these simulations (e.g. MT Brannick, C Prince, E Salas, unpublished
manuscript; Gopher et al 1994). For example, some researchers are studying the
viability of computer games for training complex tasks. Gopher et al (1994) tested
the transfer of skills from a complex computer game to the flight performance of
cadets in the Israeli Air Force flight school. They arguedthat the context relevance
of the game to flight was based on a skill-oriented task analysis, which used in-
formation provided by contemporary models of the human processing system as
the framework. Flight performance scores of two groups of cadets who received
10 hours of training in the computer game were compared with a matched group
with no game experience. Results showed that the groups with game experience
performed much better in subsequent test flights than did those with no game ex-
perience. Jentsch & Bowers (1998) and Goettl et al (1996) have reported similar
Precisely why simulation and simulators work is not well known. A fewstudies
have provided preliminary data (e.g. Bell & Waag 1998, Jentsch & Bowers 1998,
Ortiz 1994), but there is a somewhat misleading conclusion that simulation (in and
of itself) leads to learning. Unfortunately, most of the evaluations rely on trainee
reaction data and not on performance or learning data (see Salas et al 1998). More
systematic and rigorous evaluations of large-scale simulations and simulators are
needed. Nonetheless, the use of simulation continues at a rapid pace in medicine,
maintenance, law enforcement, and emergency management settings. However,
December 11, 2000 22:54 Annual Reviews AR120-18
some have noted (e.g. Salas et al 1998) that simulation and simulators are being
used without much consideration of what has been learned about cognition, train-
ing design, or effectiveness. There is a growing need to incorporate the recent
advances in training research into simulation design and practice. Along these
lines, some have argued for an event-based approach to training with simulations
(Cannon-Bowers et al 1998, Oser et al 1999, Fowlkes et al 1998). According
to this perspective, simulation-based training should be developed with training
objectives in mind, and allow for the measurement of training process and out-
comes, and provisions for feedback (both during the exercise and for debriefing
In related work, Ricci et al (1995) investigated the use of a computer-based
game to train chemical, biological, and radiological defense procedures. In this
case, the game was not a simulation (as discussed above), but a computer-based
slot machine that presented trainees with questions about the material. Trainees
earned points for correct answers, and received corrective feedback for incorrect
ones. The authors argued that motivation to engage in this type of presentation
(over text-based material) would result in higher learning. Results indicated that
reactions and retention (but not immediate training performance) were higher for
the game condition.
Behavior role modeling is another type of simulation-based training that has
received attention over the years. Recently, Skarlicki & Latham (1997) found
that a training approach that included role-playing, and other elements of behav-
ior modeling, was successful in training organizational citizenship behavior in a
labor union setting. Similarly, Smith-Jentsch et al (1996b) found that a behav-
ior modeling approach emphasizing practice (i.e. role playing) and performance
feedback was superior to a lecture only or lecture with demonstration format for
training assertiveness skills. Also studying assertiveness, Baldwin (1992) found
that behavioral reproduction (i.e. demonstrating assertiveness in a situation that
was similar to the training environment) was best achieved by exposing trainees
only to positive model displays. Conversely, the combination of both positive and
negative model displays was most effective in achieving behavioral generalization
(i.e. applying the skill outside of the training simulation) four weeks later.
Team Training
As noted by Guzzo & Dickson (1996) and Tannenbaum & Yukl (1992), teams are
heavily used in industry, government, and the military. Therefore, these organiza-
tions have invested some resources in developing teams (Tannenbaum 1997). A
number of theoretically-driven team training strategies has emerged. These in-
cludecross-training (Blickensderferetal 1998), teamcoordinationtraining(Prince
& Salas 1993), team leadership training (Tannenbaum et al 1998), team self-
correction (Smith-Jentsch et al 1998), and distributed team training (Dwyer et al
1999). All of these have been tested and evaluated with positive results (see
Cannon-Bowers & Salas 1998a).
December 11, 2000 22:54 Annual Reviews AR120-18
The aviation community has arguably been the biggest advocate and user of
team training (see Helmreich et al 1993). The airlines and the military have ex-
tensively applied a strategy labeled crew resource management (CRM) training.
This strategy has a 20-year history in the aviation environment. It is used as a
tool to improve teamwork in the cockpit but, more importantly, to reduce human
error, accidents, and mishaps (Helmreich & Foushee 1993). CRM training has
gonethroughseveralevolutions(Helmreichetal1999)andismaturing. Systematic
et al 1999), and the evaluation data are encouraging (see Leedom & Simon 1995,
Salas et al 1999, Stout et al 1997). CRM training seems to work by changing the
crew’s attitudes toward teamwork, and by imparting the relevant team competen-
cies. Crew that have received CRM training exhibit more teamwork behaviors in
the cockpit (Salas et al 1999, Stout et al 1997). However, more and better eval-
uations are needed. Most of the evaluations conducted have been in simulation
environments. Only recently have evaluations begun to determine the transfer of
this training to the actual cockpit.
Other research in team training has focused on developing strategies to train
specific competencies (see also Cannon-Bowers & Salas 1998b). For example,
Smith-Jentsch et al (1996b) examined determinants of team performance–related
assertiveness in three studies. These studies concluded that, whereas both attitu-
dinally focused and skill-based training improved attitudes toward team member
assertiveness, practiceandfeedbackwereessentialtoproducingbehavioraleffects.
In addition, Volpe et al (1996) used shared mental model theory (Cannon-Bowers
et al 1993) as a basis to examine the effects of cross-training and workload on per-
formance. The results indicated that those who received cross-training were more
effective in teamwork processes, communication, and overall team performance.
In sum, the literature has begun to provide evidencethat team training works. It
workswhen the training is theoretically driven, focused on required competencies,
and designed to provide trainees with realistic opportunities to practice and receive
feedback. Also, guidelines for practitioners have emerged (e.g. Swezey & Salas
1992, Salas & Cannon-Bowers 2000), tools for designing team training strategies
havesurfaced(e.g. Bowersetal1993), anda numberofstrategiesarenowavailable
for team training (e.g. Cannon-Bowers & Salas 1997). In the future, we need
to know more about how to diagnose team cognitions during training. We also
need better and more rigorous measurement protocols to assess shared knowledge.
In addition, we need to understand better the mechanisms by which to conduct
effective distributed team training.
Events that occur after training are as important as those that occur before and
during training. Therefore, recent research has focused on improving the methods
andprocedures weuseto evaluatetraining, andonexaminingtheeventsthatensure
December 11, 2000 22:54 Annual Reviews AR120-18
transfer and application of newlyacquired KSAs. In examining this body of work,
we get a clear sense that it is in these two areas where we probably have made the
most significant progress. There are theoretical, methodological, empirical, and
practical advances. All the issues have not been solved, but meaningful advances
have been made in the last decade. This is very encouraging. We first look at
training evaluation and then at transfer of training.
Training Evaluation
Kirkpatrick’s Typology and Beyond Kirkpatrick’s typology (Kirkpatrick 1976)
continues to be the most popular framework for guiding evaluations. However,
recent work has either expanded it or pointed out weaknesses, such as the need to
develop more diagnostic measures. For example, Kraiger et al (1993) proposed
a multi-dimensional view of learning, implying that learning refers to changes in
cognitive, affective, and/or skill-based outcomes. The proposed taxonomy can be
used to assess and document learning outcomes. In a meta-analysis of studies em-
ploying Kirkpatrick’s model, Alliger et al (1997) noted that utility-type reaction
measures were more strongly related to learning and performance (transfer) than
affective-typereaction measures. Surprisingly, they also found that utility-type re-
action measures are more predictive of transfer than learning measures. Kraiger &
Jung (1997) suggested several processes by which learning outcomes can be de-
rived from instructional objectives of training. Goldsmith & Kraiger (1997) pro-
posed a method for structural assessment of an individual learner’s knowledge and
skill in a specific domain. This model has been used with some success in several
domains (e.g. Kraiger et al 1995, Stout et al 1997).
Clearly, Kirkpatrick’s typology has served as a good foundation for training
evaluation for many decades (Kirkpatrick 1976). It has been used, criticized, mis-
used, expanded, refined, adapted, and extended. It has served the training research
community well—but a richer, more sophisticated typology is needed. Research
needs to continue finding better, more diagnostic and rigorous assessments of
learning outcomes. The next frontier and greatest challenge in this area is in de-
signing, developing, and testing on-line assessments of learning and performance.
As we rely more on technology for training delivery, we need better and more
protocols to access learning not only after but also during training (e.g. Ghodsian
et al 1997).
Evaluation Design Issues Training evaluation is one of those activities that is
easier said than done. Training evaluation is labor intensive, costly, political, and
many times is the bearer of bad news. We also know that it is very difficult to
conduct credible and defensible evaluations in the field. Fortunately, training re-
searchers have derived and tested thoughtful, innovative and practical approaches
to aid the evaluation process. For example, Sackett & Mullen (1993) proposed
other alternatives (e.g. posttesting-only, no control group) to formal experimental
designswhenanswering evaluation questions. They suggested that those questions
December 11, 2000 22:54 Annual Reviews AR120-18
(e.g.Howmuchchangehasoccurred? Whattargetperformancehasbeenreached?)
should drive the evaluation mechanisms needed, and that each requires different
designs. Haccoun & Hamtiaux (1994) proposed a simple procedure for estimating
effectivenessoftrainingin improving trainee knowledge—theinternalreferencing
strategy. This situation tests the implicit training evaluation notion that training-
relevant content should show more change (pre-post) than training-irrelevant con-
tent. An empirical evaluation using internal referencing strategy versus a more
traditional experimental evaluation indicated that the internal referencing strategy
approach might permit inferences that mirror those obtained by the more complex
The costs of training evaluation have also been addressed recently. Yang et al
(1996) examined two ways to reduce costs. The first method is by assigning dif-
ferent numbers of subjects into training and control groups. An unequal group
size design with a larger total sample size may achieve the same level of statistical
power at lower cost. In a second method, the authors examined substituting a less
expensive proxy criterion measure in place of the target criterion when evaluat-
ing the training effectiveness. Using a proxy increases the sample size needed to
achieve a given level of statistical power. The authors described procedures for
examining the tradeoff between the costs saved by using the less expensive proxy
criterion and the costs incurred by the larger sample size. Similar suggestions have
been made by Arvey et al (1992).
Evaluations It is refreshing to see thatmore evaluations are being reported in the
literature; we hope this trend continues. It is only by drawing lessons learned from
past evaluations that the design and delivery of training will continue to progress.
Several field training evaluations have been reported in team training settings
(e.g. Leedom & Simon 1995, Salas et al 1999), sales training (e.g. Morrow et al
1997), stress training (e.g. Friedland & Keinan 1992), cross-cultural management
training (e.g. Harrison 1992), transformational leadership training (e.g. Barling
etal1996), careerself-managementtraining(e.g. Kosseketal1998),workforcedi-
versity training (e.g. Hanover & Cellar 1998) and approaches tocomputer training
(e.g. Simon & Werner 1996). All suggest that training works. However, an exam-
ination of evaluations where training did not work is also needed (and we suspect
there are many). Some important lessons can be learned from these types of
evaluations as well.
Transfer of Training
Transfer of training is conceptualized as the extent to which KSAs acquired in a
training program are applied, generalized, and maintained over some time in the
job environment (Baldwin & Ford 1988). There has been a plethora of research
and thinking in the transfer of training area (see Ford & Weissbein 1997). This
emerging body of knowledge suggests a number of important propositions and
conclusions. For example, (a) the organizational learning environment can be reli-
ably measured and varies in meaningful ways across organizations (Tannenbaum
December 11, 2000 22:54 Annual Reviews AR120-18
1997); (b) the context matters (Quinones 1997)—it sets motivations, expectations,
and attitudes for transfer; (c) the transfer “climate” can have a powerful impact on
the extent to which newly acquired KSAs are used back on the job (e.g. Tracey
et al 1995, Thayer & Teachout 1995); (d) trainees need an opportunity to perform
(Ford et al 1992, Quinones et al 1995); (e) delays between training and actual
use on the job create significant skill decay (Arthur et al 1998); (f ) situational
cues and consequences predict the extent to which transfer occurs (Rouiller &
Goldstein 1993); (g) social, peer, subordinate, and supervisor support all play a
central role in transfer (e.g. Facteau et al 1995, Tracey et al 1995); (h) training can
generalize from one context to another (e.g. Tesluk et al 1995); (i) intervention
strategiescanbedesignedtoimprovetheprobabilityoftransfer(e.g. Brinkerhoff&
Montesino 1995, Kraiger et al 1995); (j) team leaders can shape the degree
of transfer through informal reinforcement (or punishment) of transfer activities
(Smith-Jentsch et al 2000); (k) training transfer needs to be conceptualized as a
multidimensionalconstruct—itdiffers depending onthetypeoftrainingand close-
ness of supervision on the job (Yelon & Ford 1999).
As noted by Ford & Weissbein (1997), much progress has been made in this
area. Therearemorestudiesusingcomplextaskswithdiversesamplesthatactually
measure transfer overtime. However, much more is needed. Specifically, weneed
more studies thatactually manipulate thetransfer climate (e.g. Smith-Jentsch et al
2000). The measurement problems remain. Most studies still use surveys as the
preferred method for measuring transfer. Other methods need to be developedand
used. Finally, we need to assume that learning outcomesattheindividuallevelwill
emerge to influence higher level outcomes. Vertical transfer of training is the next
frontier. Vertical transfer may be a leverage point for strengthening the links bet-
ween learning outcomes and organizational effectiveness (see Kozlowski et al
Takentogether, these studies validatethe importance of the organizationalenvi-
ronment in training. In the future we need to continue to determine which factors
affect transfer so that we can maximize it.
In closing, we draw on the extensive literature just reviewed to offer the
following observations:
1. As Tannenbaum & Yukl (1992) predicted, the quality and quantity of
research has increased. We truly have seen an explosion of theoretical,
methodological, and empirical work in training research, and we do not see
an end to this trend. This is very encouraging, and we believe this body of
work will pay off as we learn more about how to design and deliver
training systems. Therefore, we contend that training research is here to
stay and prosper.
December 11, 2000 22:54 Annual Reviews AR120-18
2. The progress in theoretical development, especially the attention given to
cognitive and organizational concepts, is revolutionizing the field. These
new developments promise to change how we conceptualize, design,
implement, and institutionalize learning and training in organizations. In
the future, we will need a deeper understanding of these concepts, we must
strive for more precision and clarity of constructs, and our methods must
be more rigorous.
3. The body of literature generated over the past decade suggests that the
field does not belong to any single discipline anymore. In the past,
industrial/organizational and educational psychologists primarily
conducted training research. A closer look at the literature now suggests
that cognitive, military, engineering, human factors, and instructional
psychologists are involved in training research to an equal degree. In fact,
computer scientists and industrial engineers are also researching learning,
training technology, and training systems. As many others have observed,
we need more cross-fertilization, collaboration, and dialogue among
disciplines. To start, we need to read each other’s work, and leverage each
other’s findings, ideas, and principles.
4. Technology has influenced—and will continue to do so for the foreseeable
future—the design and delivery of training systems. Whether we like it or
not, technology has been embraced in industrial, educational, and military
institutions as a way to educate and train their workforces. Technology
may, or may not, have instructional features because it is often employed
without the benefit of findings from the science of training. However, as
we learn more about intelligent tutoring systems, modeling and simulation,
multimedia systems, learning agents, Web-based training, distance
learning, and virtual environments, this state of affairs may change. It is
encouraging that basic and applied research is currently going on to
uncover how these technologies enhance learning and human performance
(e.g. Cannon-Bowers et al 1998). More research is needed, and the
prospects of it happening are very promising. Specifically we need to
know more about how to best present knowledge over the Internet, how
and when to provide feedback, which instructional strategies are best for
Web-based applications, what role instructors and trainees play in these
modern systems, and how effectiveness can best be evaluated.
5. The distinction between training effectiveness and training evaluation is
much clearer. Kraiger et al (1993) provided the seed for this important
distinction. Training effectiveness is concerned with why training works
and it is much more “macro” in nature. That is, training effectiveness
research looks at the training intervention from a systems
perspective—where the success of training depends not only on the method
used but on how training (and learning) is positioned, supported, and
reinforced by the organization; the motivation and focus of trainees; and
December 11, 2000 22:54 Annual Reviews AR120-18
what mechanisms are in place to ensure the transfer of the newly acquired
KSAs to the job. Training evaluation on the other hand, examines what
works and is much more “micro” (i.e. focused on measurement). It looks
at what was learned at different levels and is the basis for determining the
training effectiveness of a particular intervention. This distinction has
made some significant contributions to practice possible and, more
importantly, is helping avoid the simplistic view of training (i.e. that
training is just a program or curriculum rather than the complex interaction
of many organizational factors). More research aimed at uncovering why
training works is, of course, desirable.
6. Much more attention has been given to discussing training as a system
embedded in an organizational context (e.g. Dipboye 1997, Kozlowski &
Salas 1997, Kozlowski et al 2000, Tannenbaum & Yukl 1992). This is
refreshing and welcome. For many decades, training researchers have
ignored the fact that training cannot be isolated from the system it
supports. In fact, the organizational context matters (e.g. Quinones 1997,
Rouillier & Goldstein 1993) and matters in a significant way. Research
aimed at studying how organizations implement training and why even the
best-designed training systems can fail is encouraged.
7. Research has begun to impact practice in a more meaningful, and it is to be
hoped, quantifiable way. We can offer principles and guidelines to organi-
zations regarding how to analyze, design, develop, implement, and evaluate
training functions. Much needs to be done, but it is only through mutual
et al 1997). As already stated, we have seen more evaluations conducted,
there are more guidelines for designers and practitioners, and viable
strategies that seem to impact organizational outcomes and the link between
A number of training issues need considerable attention in the next few years
(in addition to the ones we have noted throughout this chapter). In particular, we
need research that helps us get a better understanding of what, how, and when on-
the-job training works. On-the-job training is a common practice in organizations,
butfewprinciples and guidelines exist on how to optimize this strategy. We need a
deeper understanding of how to build expertise and adaptability through training.
Although some work has started (e.g. Kozlowski 1998, Smith et al 1997), longi-
tudinal studies in the field are desirable. How learning environments are created
and maintained in organizations needs to be researched and better understood. A
related issue is how, and under what circumstances, individuals and teams learn
from informal organizational activities. In addition, as organizations become older
and more diverse, more attention must be paid to the special training needs of
nontraditional workers (especially given the anticipated reliance on high-tech
systems). Moreover, as organizations allow more flexibility in how work is
accomplished (e.g. telecommuting), training practices must keep pace. In fact,
December 11, 2000 22:54 Annual Reviews AR120-18
organizations will increasingly depend on workers who can develop, maintain,
and manage their own skills, requiring attention to the challenge of how to de-
velop and attract self-directed learners. Finally, as noted, training researchers
need to embrace and investigate new technologies. We know that organizations
will; we hope that new developments in training are driven by scientific findings
rather than the band wagon.
In conclusion, we are happy to report that, contrary to charges made by our
predecessors over the years, training research is no longer atheoretical, irrelevant,
or dull. Exciting advances in all areas of the training enterprise have been real-
ized. Training research has also been called faddish, a characteristic we hope is
beginning to fade as well. However, we wonder whether there is compelling evi-
dence to suggest that training practitioners in organizations are actually applying
what has been learned from the research. This brings us back to a question we
raised at the beginning of this chapter; namely, to what degree does the science
of training affect organizational training practices? In other words, can we find
evidencethat organizationsareimplementing the lessons being learned from train-
ing research (especially the work reviewed here), or are practitioners still prone
to latch on to the latest training craze? The answer is, quite simply, that we just
do not know. This is due, at least in part, to the fact that detailed records doc-
umenting training practices (and more importantly, the rationale that went into
developing them) are not typically available. However, one thing seems clear:
The stage for the application of training research is set. We say this because, as
noted, organizations are beginning to question the value-added of human resource
activities (including training), and to pay more attention to human capital. Sim-
ply put, organizations want to know what the return is on their training inves-
Assuming this trend continues, it should force training professionals to turn to
training outcomes (including transfer), and how to evaluate whether training has
been effective in reaching organizational goals. As the pressure grows to show
an impact on the bottom line, training practitioners will do well to employ sound
principles,guidelines,specifications, andlessonslearnedfromthe literature, rather
than relying on a trial-and-error approach. For this reason, webelieve a new era of
training has begun—one in which a truly reciprocal relationship between training
research and practice will be realized.
We thank Clint Bowers, Ken Brown, Irv Goldstein, Steve Kozlowski, Kevin Ford,
John Mathieu, Ray Noe, Paul Thayer, Scott Tannenbaum, and Will Wooten for
their valuable comments and suggestions on earlier drafts of this chapter. We
were aided in the literature review by two doctoral students in the Human Factors
program from the University of Central Florida: Katherine Wilson and Shatha
December 11, 2000 22:54 Annual Reviews AR120-18
Visit the Annual Reviews home page at
Alliger GM, Tannenbaum SI, Bennett W,
TraverH, ShotlandA. 1997.A meta-analysis
of the relations among training criteria. Pers.
Psychol. 50:341–58
Anderson JR, Corbett AT, Koedinger KR, Pel-
letier R. 1995. Cognitive tutors: lessons
learned. J. Learn. Sci. 4:167–207
Arthur W, Bennett W, Stanush PL, McNelly
TL. 1998. Factors that influence skill decay
andretention: a quantitativereviewand anal-
ysis. Hum. Perform. 11:79–86
Arthur W, Day EA, Bennett W, McNelly TL,
Jordan JA. 1997. Dyadic versus individual
training protocols: loss and reacquisition of
a complex skill. J. Appl. Psychol. 82:783–91
ArthurW, Young B, JordanJA, ShebilskeWL.
1996. Effectiveness of individual and dyadic
training protocols: the influence of trainee
interaction anxiety. Hum. Factors 38:79–86
Arvey RD, Salas E, Gialluca KA. 1992. Using
task inventories to forecast skills and abili-
ties. Hum. Perform. 5:171–90
Baker D, Prince C, Shrestha L, Oser R, Salas
E. 1993. Aviation computer games for crew
resource management training. Int. J. Aviat.
Psychol. 3:143–56
Baker D, Salas E, Cannon-Bowers J. 1998.
Team task analysis: lost but hopefully not
forgotten. Ind. Organ. Psychol. 35:79–83
BaldwinTT. 1992.Effectsofalternativemodel-
ing strategies on outcomes of interpersonal-
skills training. J. Appl. Psychol. 77:147–54
Baldwin TT, Ford JK. 1988. Transfer of train-
ing: a review and directions for future re-
search. Personnel Psychol. 41:63–105
Baldwin TT, Magjuka RJ. 1997. Training as an
organizational episode: pretraining influ-
ences on trainee motivation. See Ford et al
1997, pp. 99–127
Barling J, Weber T, Kelloway EK. 1996. Ef-
fects of transformational leadership training
on attitudinal and financial outcomes: a field
experiment. J. Appl. Psychol. 81:827–32
BassiLJ, VanBurenME.1999.The1999ASTD
State of the Industry Report.Alexandria, VA:
Am. Soc. Train. Dev.
Bell H, Waag W. 1998. Evaluating the effec-
tiveness offlight simulatorsfor trainingcom-
bat skills: a review. Int. J. Aviat. Psychol.
BlickensderferE, Cannon-Bowers JA, Salas E.
1998. Cross training and team performance
Blickensderfer E, Cannon-Bowers JA, Salas
E, Baker DP. 2000. Analyzing knowledge
requirementsinteamtasks. InCognitiveTask
Analysis,ed. JMSchraagen, SFChipman, VJ
Shalin. Mahwah, NJ: Erlbaum
BowersCA, Morgan BB Jr, Salas E, Prince C.
1993. Assessment of coordination demand
for aircrew coordination training. Mil. Psy-
chol. 5:95–112
Brett JF, VandeValle D. 1999. Goal orienta-
tion and goal content as predictors of perfor-
mance in a training program. J. Appl. Psy-
chol. 84:863–73
Bretz RD Jr, Thompsett RE. 1992. Comparing
traditional and integrative learning methods
in organizational training programs. J. Appl.
Psychol. 77:941–51
Brinkerhoff RO, Montesino MU. 1995. Part-
nership for training transfer: lessons from a
corporate study. Hum. Res. Dev. Q. 6:263–74
Buttom SB, Mathieu JE, Zajac DM. 1996.
Goal orientation in organizational research:
a conceptual and empirical foundation.
Organ. Behav. Hum. Decis. Process. 67:26–
Campbell JP. 1971. Personnel training and
development. Annu. Rev. Psychol. 22:565–
Cannon-Bowers J, Burns J, Salas E, Pruitt
J. 1998. Advanced technology in decision-
making training. See Cannon-Bowers &
Salas 1998b, pp. 365–74
December 11, 2000 22:54 Annual Reviews AR120-18
Cannon-Bowers JA, Salas E. 1997. Teamwork
competencies: the interaction of team mem-
ber knowledge, skills, and attitudes. In
Workforce Readiness: Competencies and
Assessment, ed. HF O’Niel, pp. 151–74.
Mahwah, NJ: Erlbaum
Cannon-BowersJA, Salas E. 1998a.Individual
and team decision making under stress: the-
oretical underpinnings. See Cannon-Bowers
& Salas 1998b, pp. 17–38
Cannon-BowersJA, Salas E, eds. 1998b.Mak-
ing Decisions Under Stress: Implicationsfor
Individual and Team Training. Washington,
DC: Am. Psychol. Assoc.
Cannon-Bowers J, Salas E, Converse S. 1993.
Shared mental models in expert team de-
cision making. In Individual and Group
Decision Making: Current Issues, ed. NJ
Castellan Jr, pp. 221–46. Hillsdale, NJ: Erl-
Cannon-Bowers JA, Salas E, Tannenbaum SI,
Mathieu JE. 1995. Toward theoretically-
based principles of trainee effectiveness: a
model and initial empirical investigation.
Mil. Psychol. 7:141–64
Christoph RT, Schoenfeld GA Jr, Tansky JW.
1998. Overcoming barriers to training utiliz-
ing technology: theinfluence of self-efficacy
factors on multimedia-based training recep-
tiveness. Hum. Res. Dev. Q. 9:25–38
ColeND, Latham GP. 1997.Effectsof training
in procedural justice on perceptions of disci-
plinary fairness by unionized employees and
disciplinary subject matter experts. J. Appl.
Psychol. 82:699–705
ColquittJA, LePineJA, NoeRA. 2000.Toward
an integrative theory of training motivation:
a meta-analytic path analysis of 20 years of
research. J. Appl. Psychol. In press
ColquittJA, SimmeringMS. 1998.Conscious-
ness,goalorientation, andmotivationtolearn
during the learning process: a longitudinal
study. J. Appl. Psychol. 83:654–65
Dipboye RL. 1997. Organizational barriers to
implementing a rational model of training.
See Quinones & Ehrenstein 1997, pp. 119–
Driskell JE, Johnston JH. 1998. Stress expo-
sure training. See Cannon-Bowers & Salas
1998b, pp. 191–217
Driskell JE, WillisRP, Copper C. 1992. Effect
of overlearning on retention. J. Appl. Psy-
chol. 77:615–22
DuboisDA, ShalinVL, LeviKR, BormanWC.
1997/1998. A cognitively-oriented approach
to task analysis. Train. Res. J. 3:103–41
Dweck CS. 1986. Motivational processes affe-
cting learning. Am. Psychol. 41:1040–48
Dweck CS, Leggett EL. 1988. A social-
cognitive approach tomotivationand person-
ality. Psychol. Rev. 95:256–73
Dwyer DJ, Oser RL, Salas E, Fowlkes JE.
1999. Performance measurement in dis-
tributedenvironments: initial results and im-
plications for training. Mil. Psychol. 11:189–
Eden D, Aviram A. 1993. Self-efficacy train-
ing to speed reemployment: helping people
tohelp themselves.J.Appl.Psychol.78:352–
Ehrenstein A, Walker B, Czerwinski M, Feld-
manE. 1997. Somefundamentals of training
and transfer: Practice benefits are not auto-
matic. See Quinones & Ehrenstein 1997, pp.
Elliot AJ, Church MA. 1997. A hierarchical
model of approach and avoidance achieve-
ment motivation. J. Pers. Soc. Psychol.
Facteau JD, Dobbins GH, Russel JEA, Ladd
RT, Kudisch JD. 1995. The influence of
general perceptions for the training envi-
ronment on pretraining motivation and per-
ceived training transfer. J. Manage. 21:1–
Fisher SL, Ford JK. 1998. Differential effects
of learner efforts and goal orientation on two
learning outcomes. Pers. Psychol. 51:397–
Ford JK, Kozlowski S, Kraiger K, Salas E,
Teachout M, eds. 1997. Improving Train-
ing Effectiveness in Work Organizations.
Mahwah, NJ: Erlbaum. 393 pp.
Ford JK, Quinones MA, Sego DJ, Sorra JS.
December 11, 2000 22:54 Annual Reviews AR120-18
1992. Factors affecting the opportunity to
perform trained tasks on the job. Pers. Psy-
chol. 45:511–27
Ford JK, Smith EM, Sego DJ, Quinones
MA. 1993. Impact of task experience and
individual factors on training-emphasis rat-
ings. J. Appl. Psychol. 78:218–33
Ford JK, Smith EM, Weissbein DA, Gully
SM, Salas E. 1998. Relationships of goal-
orientation, metacognitiveactivity, and prac-
tice strategies with learning outcomes and
transfer. J. Appl. Psychol. 83:218–33
Ford JK, Weissbein DA. 1997. Transfer of
training: an updated review and analysis.
Perform. Improv. Q. 10:22–41
Fowlkes J, Dwyer D, Oser R, Salas E.
1998. Event-based approach to training. Int.
J. Aviat. Psychol. 8:209–22
Friedland N, Keinan G. 1992. Training ef-
fective performance in stressful situations:
three approaches and implications for com-
bat training. Mil. Psychol. 4:157–74
GhodsianD, BjorkR, BenjaminA. 1997.Eval-
uatingtrainingduringtraining: obstaclesand
opportunities. See Quinones & Ehrenstein
1997, pp. 63–88
Goettl BP, Yadrick RM, Connolly-Gomez
C, Regian WJ, Shebilske WL. 1996. Al-
ternating task modules in isochronal dis-
tors 38:330–46
Goldsmith T, Kraiger K. 1997. Structural
knowledge assessment and training evalua-
tion. See Ford et al 1997, pp. 19–46
Goldstein IL. 1980. Training in work organiza-
tions. Annu. Rev. Psychol. 31:229–72
Goldstein IL. 1993. Trainingin Organizations:
Needs Assessment, Development and Evalu-
ation. Monterey, CA: Brooks/Cole. 3rd ed.
Gopher D, Weil M, Bareket T. 1994. Trans-
fer of skill from a computer game trainer to
flight. Hum. Factors 36:387–405
Guzzo RA, Dickson MW. 1996. Teams in
organizations: recent research on perfor-
Guzzo RA, Yost PR, Campbell RJ, Shea GP.
1993. Potency in groups: articulating a con-
struct. Br. J. Soc. Psychol. 32:87–106
Haccoun RR, Hamtiaux T. 1994. Optimizing
knowledge tests for inferring learning acqui-
sition levels in single group training evalua-
tion designs: the internal referencing strat-
egy. Pers. Psychol. 47:593–604
Hanover JMB, Cellar DF. 1998. Environmen-
tal factors and the effectiveness ofworkforce
diversity training Hum. Res. Dev. Q. 9:105–
Harrison JK. 1992. Individual and combined
effects of behavior modeling and the cul-
tural assimilator in cross-cultural manage-
ment training. J. Appl. Psychol. 77:952–62
Helmreich RL, Foushee HS. 1993. Why crew
resource management? Empirical and the-
oretical bases of human factors training in
avaiation. See Wiener et al 1993, pp. 3–45
HelmreichRL, Merritt AC, WilhelmJA. 1999.
The evolution of crew resource management
training in commercial aviation. Int. J. Aviat.
Psychol. 9:19–32
Helmreich RL, Wiener EL, Kanki BG. 1993.
The future of crew resource management in
the cockpit and elsewhere. See Wiener &
Kanki 1993, pp. 479–501
Howard A, ed. 1995. The Changing Nature of
Work. San Francisco: Jossey-Bass
Hunter JE. 1986. Cognitive ability, cognitive
aptitudes, job knowledge, and job perfor-
mance. J. Vocat. Behav. 29:340–62
Huselid MA. 1995. The impact of human re-
source management practices on turnover,
productivity, and corporate financial perfor-
mance. Acad. Manage. J. 38:635–72
JacobsJW, DempseyJV. 1993. Simulation and
gaming: fidelity, feedback, and motivation.
In Interactive Instruction and Feedback, ed.
JV Dempsey, GCSales, pp.197–229. Engle-
wood Cliffs, NJ: Educ. Technol.
Jentsch F, Bowers C. 1998. Evidence for the
validity of PC-based simulations in studying
aircrew coordination. Int. J. Aviat. Psychol.
Johnston JH, Cannon-Bowers JA. 1996. Train-
ing for stress exposure. In Stress and Human
December 11, 2000 22:54 Annual Reviews AR120-18
Performance, ed. JE Driskell, E Salas, pp.
223–56. Mahweh, NJ: Erlbaum
Kaemar KM, Wright PM, McMahan GC.
1997. The effects of individual differences
on technological training. J. Manage. Issues.
KanferR. 1991.Motivationaltheory andindus-
book of Industrial and Organizational Psy-
chology, ed. MD Dunnette, LM Hough, M
Leaetta, 2:75–170. Palo Alto, CA: Consult.
Psychol. 2nd ed.
Kirkpatrick DL. 1976. Evaluation of training.
In Training and Development Handbook, ed.
RL Craig, Ch. 18. New York: McGraw-Hill.
2nd ed.
Kirlik A, Fisk AD, Walker N, Rothrock
L. 1998. Feedback augmentation and part-
task practice in training dynamic decision-
making skills. See Cannon-Bowers & Salas
1998b, pp. 247–70
Kossek EE, Roberts K, Fisher S, Demarr
B. 1998. Career self-management: a quasi-
experimental assessment of the effects of a
training intervention. Pers. Psychol. 51:935–
Kozlowski SW. 1998. Training and developing
adaptive teams: theory, principles, and re-
search. See Cannon-Bowers & Salas 1998b,
pp. 247–70
Kozlowski SWJ, Brown K, Weissbein D,
Cannon-Bowers J, Salas E. 2000. A multi-
level approach to training effectiveness: en-
hancing horizontal and vertical transfer. In
Multilevel Theory, Research and Methods in
Organization, ed. K Klein, SWJ Kozlowski.
San Francisco: Jossey-Bass
Kozlowski SWJ, Salas E. 1997. A multilevel
organizational systems approach for the im-
plementation and transfer of training. See
Ford et al 1997, pp. 247–87
Kraiger K, Ford JK, Salas E. 1993. Appli-
cation of cognitive, skill-based, and affective
theories of learning outcomes to new meth-
ods of training evaluation. J. Appl. Psychol.
Kraiger K, Jung K. 1997. Linking train-
ing objectives to evaluation criteria. See
Quinones & Ehrenstein 1997, pp. 151–76
Kraiger K, Salas E, Cannon-Bowers JA.
1995. Measuring knowledge organization as
a method for assessing learning during train-
ing. Hum. Perform. 37:804–16
LathamGP. 1988.Humanresourcetrainingand
Leedom DK, Simon R. 1995. Improving team
ing. Mil. Psychol. 7:109–22
London M, Moore EM. 1999. Continuous
learning. In The Changing Nature of Perfor-
mance, ed. DR Ilgen, ED Pulakos, pp. 119–
53. San Francisco: Jossey-Bass
Martocchio JJ. 1992. Microcomputer usage as
an opportunity: the influence of context in
employee training. Pers. Psychol.45:529–51
Martocchio JJ. 1994. Effects of conceptions of
ability on anxiety, self-efficacy and learning
in training. J. Appl. Psychol. 79:819–25
Martocchio JJ, Baldwin TT. 1997. The evo-
lution of strategic organizational training.
In Research in Personnel and Human Re-
source Management,ed. RGFerris, 15:1–46.
Greenwich, CT: JAI
Martocchio JJ, Judge TA. 1997. Relationship
between conscientiousness and learning in
employee training: mediating influences of
self-deceptionand self-efficacy.J. Appl. Psy-
chol. 82:764–73
Martocchio JJ, Webster J. 1992. Effects of
feedback and cognitive playfulness on per-
formance in microcomputer software train-
ing. Pers. Psychol. 45:553–78
Mathieu JE, Martineau JW. 1997. Individual
and situational influences in training motiva-
tion. See Ford et al 1997, pp. 193–222
Mathieu JE, Martineau JW, Tannenbaum SI.
1993. Individual and situational influences
onthedevelopmentofself-efficacy: implica-
tion for training effectiveness. Pers. Psychol.
Mathieu JE, Tannenbaum SI, Salas E. 1992.
Influences of individual and situational char-
acteristics on measures of training effective-
ness. Acad. Manage. J. 35:828–47
December 11, 2000 22:54 Annual Reviews AR120-18
McKenna JA. 1990. Take the A training:
Facing world-class challenges, leading-edge
companies use progressive training tech-
niques to stay competitive. Ind. Week
Mitchell TR, Hopper H, Daniels D, George-
Falvy J, James LR. 1994. Predicting self-
efficacy and performance during skill acqui-
sition. J. Appl. Psychol. 79:506–17
Morrow CC, Jarrett MQ, Rupinski MT. 1997.
An investigation of the effect and economic
utility of corporate-wide training. Pers. Psy-
chol. 50:91–119
Neerincx MA, Griffoen E. 1996. Cognitive
task analysis: harmonizing tasks to human
capacities. Ergonomics 39:543–61
Noe RA, ed. 1999. Employee Training and De-
velopment. Boston: Irwin/McGraw-Hill
Noe RA, Wilk SL. 1993. Investigation of the
factors that influence employees’ participa-
tion in development activities. J. Appl. Psy-
chol. 78:291–302
Ortiz GA. 1994. Effectiveness of PC-based
flight simulation. Int. J. Aviat. Psychol.
Oser RL, Cannon-Bowers JA, Salas E, Dwyer
DJ. 1999. Enhancing human performance
in technology-rich environments: guide-
lines for scenario-based training. In Hu-
tems, ed. E Salas, 9:175–202. Greenwich,
Phillips JM, Gully SM. 1997. Roleof goal ori-
entation, ability, need for achievement, and
locus of control in the self-efficacy and goal-
Prince C, Salas E. 1993. Training and re-
search for teamwork in the military aircrew.
See Wiener et al 1993, pp. 337–66
QuickJC, JoplinJR, NelsonDL, Mangelsdorff
AD, Fiedler E. 1996. Self-reliance and mili-
tary service training outcomes. Mil. Psychol.
Quinones MA. 1995. Pretraining context ef-
fects: training assignment as feedback.
J. Appl. Psychol. 80:226–38
Quinones MA. 1997. Contextual influencing
on training effectiveness. See Quinones &
Ehrenstein 1997, pp. 177–200
Quinones MA, Ehrenstein A. 1997. Train-
ing for a Rapidly Changing Workplace:
Applications of Psychological Research.
Washington, DC: Am. Psychol. Assoc.
Quinones MA, Ford JK, Sego DJ, Smith EM.
1995. The effects of individual and transfer
environment characteristics on the opportu-
nity to perform trained tasks. Train. Res. J.
Randel JM, Main RE, Seymour GE, Mor-
ris BA. 1992. Relation of study factors to
performance in Navy technical schools. Mil.
Psychol. 4:75–86
Ree MJ, Carretta TR, Teachout MS. 1995.
Role of ability and prior job knowledge in
complex training performance. J. Appl. Psy-
chol. 80:721–30
Ree MJ, Earles JA. 1991. Predicting training
success: not much more than G. Pers. Psy-
chol. 44:321–32
Ricci KE, Salas E, Cannon-Bowers JA. 1995.
Do computer based games facilitate knowl-
edgeacquisitionandretention? Mil.Psychol.
Rogers W, Maurer T, Salas E, Fisk A. 1997.
Task analysis and cognitive theory: con-
trolled and automatic processing task ana-
lytic methodology. See Ford et al 1997, pp.
Rouillier JZ, Goldstein IL. 1993. The relation-
ship between organizational transfer climate
and positive transfer of training. Hum. Res.
Dev. Q. 4:377–90
Sackett PR, Mullen EJ. 1993. Beyond formal
experimental design: towards an expanded
view of the training evaluation process.Pers.
Psychol. 46:613–27
Saks AM. 1995. Longitudinal field investiga-
tion of the moderating and mediating effects
of self-efficacy on the relationship between
training and newcomer adjustment. J. Appl.
Psychol. 80:221–25
Salas E, Bowers CA, Blickensderfer E.
1997. Enhancing reciprocity between train-
ing theory and training practice: principles,
December 11, 2000 22:54 Annual Reviews AR120-18
guidelines, and specifications. See Ford et al
1997, pp. 19–46
Salas E, Bowers CA, Rhodenizer L. 1998. It
is not how much you have but how you use
it: toward a rationaluse of simulation tosup-
port aviation training. Int. J. Aviat. Psychol.
Salas E, Cannon-Bowers JA. 1997. Meth-
ods, tools, and strategies for team training.
See Quinones & Ehrenstein 1997, pp. 249–
Salas E, Cannon-Bowers JA. 2000. The
anatomy of team training. In Training and
Retraining: A Handbook for Business, In-
dustry, Government and the Military, ed. S
Tobias, D Fletcher. Farmington Hills, MI:
Macmillan. In press
Salas E, Fowlkes J, Stout RJ, Milanovich DM,
PrinceC. 1999. Does CRM training improve
teamwork skills in the cockpit?: two evalua-
tion studies. Hum. Factors 41:326–43
Salas E, Klein G, eds. 2000. Linking Expertise
and Naturalistic Decision Making. Mahwah,
NJ: Erlbaum. In press
SalasE, Rhodenizer L, Bowers CA. 2000.The
designanddeliveryofCRMtraining: explor-
ing the available resources. Hum. Factors. In
Schmidt RA, Bjork RA. 1992. New concep-
tualizations of practice: Common principles
in three paradigms suggest new concepts for
training. Psychol. Sci. 3:207–17
Schraagen JM, Chipman SF, Shalin VL, eds.
2000. Cognitive Task Analysis. Mahwah, NJ:
Erlbaum. 392 pp.
Schreiber D, Berge Z, eds. 1998. Distance
Training: HowInnovativeOrganizationsAre
Using Technology toMaximize Learning and
Meet Business Objectives. San Francisco:
Shebilske WL, Jordan JA, Goettl BP, Paulus
LE. 1998.Observationversushands-onprac-
tice of complex skills in dyadic, triadic,
and tetradic training-teams. Hum. Factors
Shebilske WL, Regian JW, Arthur W Jr, Jor-
dan JA. 1992. A dyadic protocol for train-
ing complex skills. Hum. Factors 34:369–
Shute VJ, Gawlick LA. 1995. Practice effects
on skill acquisition, learningoutcome, reten-
tion, and sensitivity to relearning. Hum. Fac-
tors 37:781–803
Shute VJ, Gawlick LA, Gluck KA. 1998. Ef-
fects of practice and learnercontrol onshort-
and long-term gain. Hum. Factors 40:296–
Simon SJ, Werner JM. 1996. Computer train-
ing through behavior modeling, self-paced,
and instructional approaches: a field experi-
ment. J. Appl. Psychol. 81:648–59
Skarlicki DP, Latham GP. 1997. Leader-
ship training in organizational justice to in-
crease citizenship behavior within a labor
union: a replication. Pers. Psychol. 50:617–
SmithE, FordK, KozlowskiS. 1997. Building
adaptive expertise: implications for training
1997, pp. 89–118
Smith-Jentsch KA, Jentsch FG, Payne SC,
Salas E. 1996a. Can pretraining experiences
explain individual differences in learning?
J. Appl. Psychol. 81:909–36
Smith-Jentsch KA, Salas E, Baker DP. 1996b.
ness. Pers. Psychol. 49:110–16
Smith-JentschKA, SalasE, BrannickM. 2000.
To transfer or not to transfer? An investiga-
tion of the combined effects of trainee char-
acteristics andteam transfer environments. J.
Appl. Psychol. In press
Smith-Jentsch KA, Zeisig RL, Acton B,
McPherson JA. 1998. Team dimensional
training: a strategy for guided team self-
correction. See Cannon-Bowers & Salas
1998b, pp. 247–70
Stajkovic AD, Luthans F. 1998. Self effi-
cacy and work-related performance. A meta-
analysis. Psychol. Bull. 124:240–61
Steele-Johnson D, Hyde BG. 1997. Advanced
technologies in training: intelligent tutoring
systems and virtual reality. See Quinones &
Ehrenstein 1997, pp. 225–48
December 11, 2000 22:54 Annual Reviews AR120-18
Sternberg RJ. 1997. Managerial intelligence:
Why IQ isn’t enough. J. Manage. 23:475–
Stevens CK, Gist ME. 1997. Effects of self-
efficacy and goal-orientation training on ne-
gotiation skill maintenance: what are the
mechanisms? PersonnelPsychol.50:955–78
Stout RJ, Salas E, Fowlkes J. 1997. En-
hancing teamwork in complex invironments
through team training. Group Dyn.: Theory
Res. Pract. 1:169–82
Swezey RW, Salas E, eds. 1992. Teams: Their
Training and Performance. Norwood, NJ:
Tannenbaum SI. 1997. Enhancing continuous
learning: diagnostic findings from multiple
companies. Hum. Res. Manage. 36:437–52
Tannenbaum SI, Cannon-Bowers JA, Math-
ieu JE. 1993. Factors That Influence Train-
ing Effectiveness: A Conceptual Model and
Longitudinal Analysis. Rep. 93-011, Naval
Train. Syst. Cent., Orlando, FL
Tannenbaum SI, Dupuree-Bruno LM. 1994.
The relationship between organizational and
evironmental factors and the use of innova-
tive human resourcepractices. Group Organ.
Manage. 19:171–202
Tannenbaum SI, Smith-Jentsch KA, Behson
SJ. 1998. Training team leaders to facilitate
teamlearningand performance.SeeCannon-
Bowers & Salas 1998b, pp. 247–70
Tannenbaum SI, Yukl G. 1992. Training and
development in work organizations. Annu.
Rev. Psychol. 43:399–441
Tesluk PE, Farr JL, Mathieu JE, Vance
RJ. 1995. Generalization of employee in-
volvement training to the job setting: indi-
vidual and situational effects. Pers. Psychol.
Thayer PW. 1997. A rapidly changing world:
some implications for training systems in
the year 2001 and beyond. See Quinones &
Ehrenstein 1997, pp. 15–30
Thayer PW, Teachout MS. 1995. A Climate
for Transfer Model. Rep. AL/HR-TP-1995-
0035, Air Force Mat. Command, Brooks Air
Force Base, Tex.
Tracey JB, Tannenbaum SI, Kavanagh MJ.
1995. Applying trained skills on the job: the
importanceofthe workenvironment. J. Appl.
Psychol. 80:239–52
VandeValle D. 1997. Development and valida-
tionofaworkdomain goalorientationinstru-
ment. Educ. Psychol. Meas. 57:995–1015
Volpe CE, Cannon-Bowers JA, Salas E, Spec-
tor PE. 1996. The impact of cross-training
on team functioning: an empirical investiga-
tion. Hum. Factors 38:87–100
Warr P, Bunce D. 1995. Trainee characteris-
tics and the outcomes of open learning. Pers.
Psychol. 48:347–75
Wexley KN. 1984. Personnel training. Annu.
Rev. Psychol. 35:519–51
Wexley KN, Latham GP. 2000. Developing
andTraining HumanResourcesin Organiza-
tions, Vol.3. EnglewoodCliffs, NJ:Prentice-
Hall. In press
Wiener EL, Kanki BG, Helmreich RL, eds.
1993. Cockpit Resource Management. San
Diego, CA: Academic
Wilson MA, Zalewski MA. 1994. An expert
system for abilities-oriented job analysis.
Comp. Hum. Behav. 10:199–207
Yang H, Sackett PR, Arvey RD. 1996. Sta-
tistical power and cost in training evalua-
tion: some new considerations. Pers. Psy-
chol. 49:651–68
Yelon SL, Ford JK. 1999. Pursuing a multi-
dimensional model of transfer. Perform. Im-
prov. Q. 12:58–78
Zsambok C, Klein G, eds. 1997. Naturalistic
Decision Making. Mahweh, NJ: Erlbaum
... Good communication between students, teachers, and also the management team is the best way to meet the training goals (Park et al. 2015;Freitas & Silva 2017). Training can be defined as the system of knowledge, skills, and attitudes to develop competencies for the effective performance of people in the work environment (Salas and Cannon-Bowers 2001). Salas and Cannon-Bowers (2001) also discussed on the importance of ergonomic safety training that can be incorporated into the learning method and also the course content. ...
... Training can be defined as the system of knowledge, skills, and attitudes to develop competencies for the effective performance of people in the work environment (Salas and Cannon-Bowers 2001). Salas and Cannon-Bowers (2001) also discussed on the importance of ergonomic safety training that can be incorporated into the learning method and also the course content. ...
Ergonomic safety is one of the most important issues in many working sectors and this includes educational institutions especially school. It is important to get the information on the teachers’ perception of ergonomic safety training. Thus, the researcher manages to identify the suitable methods to prevent more ergonomic problem among teachers in future. Aim of this study was to analyze teachers’ perception on ergonomic safety in school and at the same time measured the training requirements on ergonomic safety. Ergonomic safety training in school is important in order to improve good body posture. Survey questionnaires were distributed to 400 teachers. 111 schools randomly selected from the 10 District Education Offices from whole state of Kelantan, Malaysia. Results were then analyzed by using the Statistical Package for the Social Sciences (SPSS) Version 24. Most of the respondents involved in this research are female with the percentage of 68%. Descriptive analysis showed that more than half of respondents understood about ergonomic safety, 78% of them possessed basic safety knowledge and 22% of them lacked on the basic understanding of safety. Interestingly most of the respondents agreed that ergonomic safety should be included in occupational safety and health training in school. It is suggested that all teacher must undergo ergonomic safety training to promote and improve ergonomic safety in school. Higher awareness and more information about ergonomic safety will help teachers teach their students about the importance of ergonomic safety and create a safer environment in their school. As for the conclusion, teachers and students having an important role to ensure ergonomic safety and their commitment will help in reducing the number of ergonomic problems in school.
... The ADDIE model proposes that there are five stages involved in the training lifecycle: Analysis, Design, Develop, Implementation and Evaluation (Branson et al., 1975). One activity that can be performed during the Analysis stage to help establish the tasks and competencies that are required for a task/job and should be targeted in future training programmes is a Training Needs Analysis (TNA) (Moore and Dutton, 1978;Salas and Cannon-Bowers, 2001). therefore wasting valuable time and resources (Barbazette, 2006). ...
Considerable resources are invested each year into training to ensure trainees have the required competencies to safely and effectively perform their tasks/jobs. As such, it is important to develop effective training programmes which target those required competencies. One method that can be used at the start of the training lifecycle to establish the tasks and competencies that are required for a task/job and is considered an important activity to perform when developing a training programme is a Training Needs Analysis (TNA). This article presents a new TNA approach and uses an Automated Vehicle (AV) case study to demonstrate this new approach for a specific AV scenario within the current UK road system. A Hierarchical Task Analysis (HTA) was performed in order to identify the overall goal and tasks that drivers need to perform to operate the AV system safely on the road. This HTA identified 7 main tasks which were decomposed into 26 sub-tasks and 2428 operations. Then, six AV driver training themes from the literature were combined with the Knowledge, Skills and Attitudes (KSA) taxonomy to identify the KSAs that drivers need to perform the tasks, sub-tasks and operations that were identified in the HTA (training needs). This resulted in the identification of over 100 different training needs. This new approach helped to identify more tasks, operations and training needs than previous TNAs which applied the KSA taxonomy alone. As such, a more comprehensive TNA for drivers of the AV system was produced. This can be more easily translated into the development and evaluation of future training programmes for drivers of AV systems.
... They are often pressed to deliver interventions within fixed timeframes and struggle to set aside sufficient time for individualized, in-session supervised practice and reinforcement of new skills and their integration with previously-learned skills (Conley et al., 2015;Kazdin & Blase, 2011). Nonetheless, extensive research has identified supervised practice over multiple sessions as an important component of successful skills training for both youth and adults (Conley et al., 2015;Elliott et al., 2015;Gottfredson et al., 2015;Kumm et al., 2021;Payton et al., 2000;Salas & Cannon-Bowers, 2001;Taylor et al., 2005;Young, 2019). Compared to instruction-only skills modules, programs that provide young people with supervised opportunities to practice and receive feedback yield far stronger effects than those without the practice component (e.g., Conley et al., 2015). ...
Full-text available
Supervised practice pairs behavioral rehearsal (i.e., the practice of skills) with constructive and supportive feedback so that learners can enact new skills accurately and develop the motivation to consistently apply these skills. The current review study takes stock of the literature on supervised practice through second-order meta-analysis, a rigorous quantitative method used to aggregate overall effects from previous meta-analyses. Results from five meta-analyses revealed a significant overall effect of supervised practice compared to unsupervised practice (SMD = 0.22). Youth outcome type significantly moderated the effects of supervised practice, with internalizing behavior yielding the largest effect. Findings suggest that providing opportunities for supervised practice has the potential to significantly improve the effectiveness of a range of skills-based interventions. Implications for supervised practice are discussed, including as an adjunct to cognitive behavioral interventions and a valuable role for volunteers and other paraprofessionals in their delivery of research supported care.
... Bu durum elde edilen sonucu da açıklar niteliktedir. Çünkü öz yeterliği yüksek bireyler, yaptıkları işte doyum alma, o işi daha iyi yapabilme ve daha yüksek motivasyona sahip olma gibi özelliklere sahiptir (Salas & Cannon-Bowers, 2001). Ancak alanyazında farklı sonuçların olduğu çalışmalar da bulunmaktadır. ...
Full-text available
Bu araştırmada, sınıf öğretmenlerinin ve sınıf öğretmeni adaylarının dijital okuryazarlık düzeylerinin birçok değişken bakımından incelenmesi amaçlanmıştır. Nicel araştırma yöntemlerinden tarama modeliyle gerçekleştirilen çalışmada, veriler kolay ulaşılabilir örnekleme yöntemi kullanılarak toplanmıştır. Çalışma grubu, Türkiye’nin farklı il veya ilçe merkezlerinde devlet ilkokullarında ve özel ilkokullarda görev yapan 191 sınıf öğretmeni ile farklı üniversitelerin eğitim fakültelerinde okuyan 348 sınıf öğretmeni adayından oluşmaktadır. Çalışmanın verileri araştırmacıların hazırladığı kişisel bilgiler formu ile Sulak (2019) tarafından geliştirilen Dijital Okuryazarlık Ölçeği kullanılarak toplanmıştır. Elde edilen verilerin analizinde, t-testi, tek faktörlü varyans analizi, Kruskal Wallis H ve Mann Whitney U testlerinden yararlanılmıştır. Çalışmanın sonunda, sınıf öğretmenlerinin dijital okuryazarlık düzeylerinin sınıf öğretmeni adaylarından daha yüksek olduğu görülmüştür. Ayrıca erkek öğretmenlerin kadınlara, yaşı genç olan öğretmenlerin daha yaşlı öğretmenlere, mesleki tecrübesi az olan öğretmenlerin fazla olan öğretmenlere, özel okuldaki öğretmenlerin devlet okulundaki öğretmenlere, lisansüstü eğitim alan öğretmenlerin, lisans ve önlisans sahibi öğretmenlere, kişisel bilgisayara/tablete sahip olan öğretmenlerin sahip olmayanlara göre dijital okuryazarlık düzeyinin daha yüksek olduğu bulunmuştur. Son olarak ise cinsiyetin, sınıf öğretmeni adaylarının dijital okuryazarlık düzeylerini etkilemediği, dijital okuryazarlık puanlarının en yüksek 22–23 yaş aralığındaki ve 3. sınıf öğrencilerine ait olduğu, kişisel bilgisayara/tablete sahip olan öğretmen adaylarının sahip olmayanlara göre dijital okuryazarlık düzeyinin daha yüksek olduğu sonucuna ulaşılmıştır. Çalışma sonuçlarına göre önerilere yer verilmiştir.
Full-text available
Cieľom tejto diplomovej práce je priniesť zlepšenia do prostredia výcvikov a rekvalifikácie pre pilotov. Vzhľadom na povahu práce a spôsob použitých metód, je práca rozsiahlejšia a analyzuje niekoľko ďalších aspektov ,ktoré súvisia s leteckým výcvikom a rekvalifikačnými procesmi. V prvej kapitole je dôraz kladený na analýzu štruktúry a tvorby výcvikov. V druhej kapitole rovnakým predmetom záujmu podliehajú rekvalifikačné procesy a v tretej kapitole sa práca snaží identifikovať možné nepokryté alebo slabo pokryté miesta v týchto procesoch a zároveň aj predstaviť už existujúce riešenia, ktoré slúžia ďalej ako predmet porovnávacej metódy výskumu vykonaného v 4. kapitole. Záverom práce je návrh možných riešení, v problematike ako zlepšiť bezpečnosť v letectve aj pomocou rekvalifikačných kurzov. The aim of this thesis is to create improvements in the environment of training and retraining procesess for pilots. Due to the nature of the work and the way the methods are used, the content is more extensive and analyzes several other aspects related to flight training. In the first chapter, the emphasis is on the analysis of the structure and creation of the flight training. In the second chapter, requalification processes are subject to the same point of interest, and in the third chapter, the thesis tries to identify possible uncovered spots in these processes and at the same time to analyze already existing solutions, which further serve as the subject of the comparative research method carried out in the 4th chapter. The conclusion of the work is a proposal of possible solutions in the issue of how to improve safety in aviation with the help of requalification courses or other.
The quality of the human resources of any organization is crucial to its success, therefore every organization must seek to improve the quality of its workforce. It is worth noting that Enugu Electricity Distribution Company as an Energy distribution/Maintenance company has many departments such as Operations, Technical, Audit, Communications, Information Technology, Revenue Cycle Services etc. There are some unskilled workers in the operations and technical departments that sometimes find themselves in positions that requires skills, therefore the need for on-the-job training, it is in respect of this that the Researcher decided to look into the impact of on-the-Job training and employee performance in Enugu Electricity distribution Company (EEDC). The objective of the study was to determine the selection procedure, training design, training delivery style and the relationship between employee perception of training on organizational performance. The Study adopted Historical research design. Relevant data for this study was elicited from both primary and secondary sources of data. The population of the study was 100 employees, data was derived through the questionnaire that was distributed. Data was analyzed using the simple percentage table. This research work relied on human capital and the technology-based approach theory. The findings of the study show that on the job training programmes are more likely to enhance employee capability than without. The study recommended that Organizations should always come up with on-the-job training programmes that will enhance efficiency and performance, make the employee to like their job and hence provide employee satisfaction that will also lead to increase in Organizational performance.
Full-text available
This study focuses on understanding mathematics learner identities of high school learners who participated in the South African Numeracy Chair Project after school mathematics clubs, an environment that afforded different mathematics identities from the traditional South African classroom. Mathematics learner identities feature prominently in current research on mathematics education because they affect whether and how learners engage in mathematics. They play a critical role in enhancing (or detracting from) learners’ attitudes, dispositions, emotional development, and general sense of self as they learn mathematics. Development of positive learner mathematical identity is therefore useful in making learners commit to their mathematics work. South African primary mathematics education is described as being in a state of crisis, and various programmes are being implemented to develop intervention models to improve quality and ensure the effective teaching and learning of primary mathematics. The South African Numeracy Chair Project initiative at Rhodes University provides for longitudinal research and development programmes with primary mathematics teachers and learners from previously disadvantaged schools, in order to find ways of mitigating the crisis. The after school mathematics clubs provide extra-curricular activities focused on developing a supportive learning community where learners’ active mathematical participation, engagement, enjoyment, and sense making are the focus. The clubs provide a supportive learning environment that is different to the traditional classroom and in which learners can participate actively and freely in mathematical activities. The study explores the nature of mathematics learner identities as learning trajectories that connect the past and future in negotiation of the present. It also seeks to discover how primary school club participation and experiences feature in the learners’ mathematical identities. The study employs two theoretical frameworks to analyse qualitative data that was gathered in the form of spoken and written stories, by 14 learners who participated in the after school mathematics clubs in primary school. The stories covered learners’ engagement in mathematics in different landscapes of practice that promoted the construction of different learner mathematical identities. A close analysis of the qualitative data revealed that learners’ mathematical identities are heavily influenced by the values that were foregrounded in the after school mathematics clubs. The clubs valued hard work and encouraged learners to ask for assistance when in doubt. In line with the club ethos, the learners storied resilience and hard work in their narratives. In addition, although many learners storied Mathematics as difficult in high school, they chose to continue taking the subject.
Örgütlerde bir insan kaynakları yönetimi işlevi olarak eğitim ve geliştirme çalışmaları önemli bir yatırım alanıdır. Eğitim ve geliştirmeye yapılan yatırımın örgütlere katkısının ve geri dönüşünün belirlenmesi konusunda örgütlerde önemli bir beklenti bulunmaktadır. Eğitim ve geliştirme faaliyetlerinin etkinliğinin performansa ne düzeyde dönüştüğünün ölçülmesi ve eğitimin katkısının ortaya konulması önemli bir ihtiyaçtır. Bu bağlamda çalışmanın amacı, örgütlerde eğitim ve geliştirme işlevinin sistematik bir şekilde uygulanmasının örgütsel ve bireysel performansın arttırmasına etkisi ve bu süreçte yönetici desteğinin rolünü araştırmaktır. Çalışmada konu literatürün incelemesi ve değerlendirilmesi yoluyla ortaya konulmaktadır. Literatür incelemesi sonucu ulaşılan bulgulardan yola çıkarak sonraki araştırmalar ve uygulamacılar için öneriler sunulmaktadır. Uluslararası yayınlarda eğitim uygulamalarının örgütsel ve bireysel performansa etkisini destekleyen ampirik çalışmalar olup ulusal literatürde yeterli sayıda çalışma bulunmamaktadır. Eğitim etkinliğinin örgütsel ve bireysel performansa etkisinde yönetici desteğinin aracı etkisine yönelik ampirik çalışmalar ise hem uluslararası hem ulusal literatürde oldukça kısıtlı olup bu alandaki ampirik çalışmalar geliştirmelidir.
Full-text available
As in any training programme the beneficiary are the learners, to measure a training programme’s effectiveness their experience should be valued. This research scales training effectiveness based on the opinions of 48 trainees (25 from government and 23 from private sectors) who participated in a two-day managerial training programme conducted for both sectors separately. Eight parameters – training need analysis, setting training objective, programme design, faculty / resource person, methodology, audio-visual aids, learning environment and learning outcome were selected to measure training effectiveness.. Training efficacy was examined at two stages of training evaluation – reaction & learning (Kirkpatrick model) and the difference between the measures in sectors (Private and Government). To gather the trainees’ experiences and feedback, the methodologies applied were sample collection (through designed questionnaires) and interviewing the trainees. This reading will help the trainers and training heads at organizations to reap maximum benefits from training programmes, and researchers to further their research on training effectiveness. Keywords: Training effectiveness, learner, trainer, evaluation.
Full-text available
This study included 2 sets of analyses examining the impact of task experience and individual factors on task ratings of training emphasis. Aerospace ground equipment mechanics in the US Air Force completed surveys 8 and 12 mo after formal training. Mechanics rated how much formal training they would recommend for a sample of tasks. In the cross-sectional analyses, with tenure constant at 12 mo, an individual's breadth of experience (number of tasks performed) and level of self-efficacy were found to have significant effects on training-emphasis ratings. The change analyses examined factors influencing changes in ratings of training emphasis from 8 to 12 mo on the job. Results indicate that mechanics whose breadth of experience or self-efficacy perceptions increased over time tended to increase their ratings of training emphasis. Implications for understanding the task analysis rating process are discussed.