ArticlePublisher preview available

Tier I Implementation Supports for Classroom Management: A Pilot Investigation Targeting Teachers' Praise

American Psychological Association
School Psychology
Authors:
  • Devereux Advanced Behavioral Health
To read the full-text of this research, you can request a copy directly from the authors.

Abstract

Evidence-based classroom management practices have profound effects on student outcomes. Yet teachers commonly struggle to effectively implement these practices, imploring the provision of implementation supports within a multitiered framework for promoting teachers' practices. Few studies have examined the effects of Tier I implementation supports for classroom management, and none have examined universal implementation within naturalistic school contexts and used strategies that go beyond a "train and hope" approach. Employing a sample of urban, elementary, general education classrooms, this study offers a pilot evaluation of a Tier I implementation support package for promoting teachers' delivery of effective praise for students' behavior. Preliminary results suggest the implementation support package was linked with increases in teachers' behavior-specific praise, heightened praise-to-correction ratios, and increases in students' on-task behavior. Future directions of empirical and practical development are discussed. Impact and Implications Classroom management practices promote students' positive behavior during instruction. Educators' implementation of such practices may be efficiently augmented through low-intensity, universal supports in a multitiered systems of implementation support framework. Universal implementation support packages are likely to be effective when they remove barriers to implementation, promote acquisition of knowledge and skills needed to implement the practices, and increase motivation to implement the practices.
BRIEF REPORT
Tier I Implementation Supports for Classroom Management:
A Pilot Investigation Targeting Teachers’ Praise
Brittany Zakszeski, Lisa Thomas, and Lyndsie Erdy
Devereux Center for Effective Schools–Devereux Advanced Behavioral Health, King of Prussia, Pennsylvania
Evidence-based classroom management practices have profound effects on student outcomes. Yet
teachers commonly struggle to effectively implement these practices, imploring the provision of imple-
mentation supports within a multitiered framework for promoting teachers’ practices. Few studies have
examined the effects of Tier I implementation supports for classroom management, and none have
examined universal implementation within naturalistic school contexts and used strategies that go beyond
a “train and hope” approach. Employing a sample of urban, elementary, general education classrooms,
this study offers a pilot evaluation of a Tier I implementation support package for promoting teachers’
delivery of effective praise for students’ behavior. Preliminary results suggest the implementation support
package was linked with increases in teachers’ behavior-specific praise, heightened praise-to-correction
ratios, and increases in students’ on-task behavior. Future directions of empirical and practical devel-
opment are discussed.
Impact and Implications
Classroom management practices promote students’ positive behavior during instruction. Educators’
implementation of such practices may be efficiently augmented through low-intensity, universal
supports in a multitiered systems of implementation support framework. Universal implementation
support packages are likely to be effective when they remove barriers to implementation, promote
acquisition of knowledge and skills needed to implement the practices, and increase motivation to
implement the practices.
Keywords: implementation support, professional development, in-service training, classroom manage-
ment, behavior-specific praise
Supplemental materials: http://dx.doi.org/10.1037/spq0000354.supp
Classroom management is a critical component of teachers’
instructional repertoires that involves arranging the environment to
promote learning and proactively supporting behavior (Sugai &
Horner, 2002). Research suggests that a particularly pivotal
competency is the delivery of effective verbal acknowledg-
ments for students’ behavior (Gage & MacSuga-Gage, 2017).
Namely, teachers’ use of behavior-specific praise (BSP; i.e.,
statements that specify the behavior being praised) and engage-
ment in more positive than negative interactions with students
foster a supportive classroom environment marked by high
levels of students’ on-task behavior, high proportions of time
spent in instruction, and positive student–teacher relationships
(e.g., Floress, Beschta, Meyer, & Reinke, 2017). Despite its
importance, however, teachers commonly report and are ob-
served as struggling to use effective verbal acknowledgments
(Rathel, Drasgow, Brown, & Marshall, 2014;Reinke, Stormont,
Herman, Puri, & Goel, 2011).
Recognizing the importance of and obstacles to effective class-
room management, Simonsen and colleagues (2014) introduced a
multitiered framework for supporting classroom management.
Within this framework, all teachers participate in direct training
and self-monitoring (Tier I), some participate in more intensive
self-management (Tier II), and few participate in individualized
consultation (Tier III). Numerous studies support the efficacy of
advanced-tier supports (e.g., Fabiano, Reddy, & Dudek, 2018;
Gage, Grasley-Boy, & MacSuga-Gage, 2018;Simonsen et al.,
2017), yet these supports are time- and resource-intensive, pre-
cluding widespread implementation.
XBrittany Zakszeski, Lisa Thomas, and XLyndsie Erdy, Devereux
Center for Effective Schools–Devereux Advanced Behavioral Health, King
of Prussia, Pennsylvania.
Correspondence concerning this article should be addressed to Brittany
Zakszeski Devereux Center for Effective Schools–Devereux Advanced
Behavioral Health, 2012 Renaissance Boulevard, King of Prussia, PA
19406. E-mail: Brittany.Zakszeski@devereux.org
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
School Psychology
© 2020 American Psychological Association 2020, Vol. 35, No. 2, 111–117
ISSN: 2578-4218 http://dx.doi.org/10.1037/spq0000354
111
... In some cases, universal supports for educators' implementation of effective emotional and organizational supports are not enough to change their classroom practices. That is, according to the logic of a multi-tiered system of implementation supports (MTSIS) framework (e.g., Simonsen et al., 2014;Zakszeski et al., 2020b), targeted and intensive implementation supports may be required for educators who do not respond to universal implementation supports (e.g., direct training on a classroom management practice; Zakszeski et al., 2020b), such as through the provision of coaching and/or consultation targeting the use of emotional and organizational supports in classrooms. By overlaying an MTSIS framework, which organizes practices for supporting educators, atop an MTSS framework, which organizes practices for supporting students, school leaders may most efficiently and effectually program for high-quality implementation of emotional and organizational supports-and, thereby, encourage student-teacher relationships marked by high closeness and low conflict as well as foster students' development of behavioral self-regulation. ...
... In some cases, universal supports for educators' implementation of effective emotional and organizational supports are not enough to change their classroom practices. That is, according to the logic of a multi-tiered system of implementation supports (MTSIS) framework (e.g., Simonsen et al., 2014;Zakszeski et al., 2020b), targeted and intensive implementation supports may be required for educators who do not respond to universal implementation supports (e.g., direct training on a classroom management practice; Zakszeski et al., 2020b), such as through the provision of coaching and/or consultation targeting the use of emotional and organizational supports in classrooms. By overlaying an MTSIS framework, which organizes practices for supporting educators, atop an MTSS framework, which organizes practices for supporting students, school leaders may most efficiently and effectually program for high-quality implementation of emotional and organizational supports-and, thereby, encourage student-teacher relationships marked by high closeness and low conflict as well as foster students' development of behavioral self-regulation. ...
Article
Prior research suggests that dimensions of the student–teacher relationship are transactionally associated with students’ self-regulation of classroom behavior, an important component of school readiness and success. The current study sought to determine the extent to which associations for student–teacher closeness and conflict with self-regulation (a) vary across kindergarten classrooms and schools and (b) are moderated by individual- (i.e., socioeconomic status, race/ethnicity) and system-level sociodemographic factors (i.e., economic disadvantage level, racial/ethnic composition). These associations were explored using multilevel modeling within a large national, longitudinal dataset including approximately 9990 kindergarteners, 1990 classrooms, and 670 schools. Despite substantial variance in the associations of closeness with self-regulation across classrooms and of conflict with self-regulation across classrooms and schools, results identified no sociodemographic moderators of the relationship–self-regulation associations, suggesting that these factors are universally related and promotive for varying sociodemographic populations; however, results also pointed to several sociodemographic subgroups at increased risk for low relational closeness, high relational conflict, and low self-regulation in the classroom. These findings are discussed in light of issues related to measurement and service delivery in schools.
... Most often teacher trainings occur as one-time, face-to-face didactic workshops with limited individualisation to teachers' specific needs. One-time trainings have been shown to be less effective in creating behaviour change for teachers than individualised trainings that provide coaching and performance feedback (Fallon et al., 2015;Gage et al., 2018;Zakszeski et al., 2020). A more effective approach includes coaching and performance feedback along with continued support from experts in the field (Fallon et al., 2015). ...
Article
Full-text available
Early childhood teachers receive some training related to overall classroom management but report receiving little training and support when working with children who engage in challenging behaviour. To alleviate the barriers to supporting students who engage in challenging behaviour, it may be helpful to implement a technology tool that provides early childhood teachers with evidence-based prevention and intervention supports for their students. One such tool, the Family Behavior Support App (FBSApp), has been previously used with families of young children who engage in challenging behaviour. The FBSApp has been shown to be effective in increasing families’ use of strategies, but the effects of the app in educational settings are currently unknown. The purposes of this single-case study are to see if there is a functional relation between the use of the FBSApp-created behaviour plan and teachers’ use of function-based behaviour strategies, as well as teachers’ perceptions of the FBSApp.
... characteristics and (b) school suspension and expulsions based upon set accruals of disciplinary referrals may disproportionately impact youth from minoritized backgrounds (Anyon et al., 2014). Relatedly, interventions delivered outside of an MTSS without clearly defined entry into and exit from criteria rarely maintain intervention gains (McIntosh & Goodman, 2016;Zakszeski et al., 2020). Translating the Operations Triad Model to school-based decision-making can improve context-specificity in assessments of the intervention environment. ...
... Nevertheless, teachers still provided more corrective than positive feedback to children with ADHD, emphasizing the importance of increasing positive feedback and decreasing corrective feedback in this group. For children in the TDC group, levels of positive feedback were higher compared to other studies (e.g., Zakszeski et al., 2020). This may be related to teachers selecting a typically developing child, which may have led teachers to select a child they specifically liked. ...
Article
Full-text available
This cross-sectional study aimed to compare positive and corrective teacher feedback toward children with attention-deficit/hyperactivity disorder (ADHD) and typically developing children, and to examine whether the quality of the teacher–student relationship moderated associations between child behavior and teacher feedback. We observed and coded classroom ADHD behaviors of 55 children with ADHD and 34 typically developing children (TDC; 6–12 years), as well as the levels of positive and corrective teacher feedback they received. Teachers rated closeness and conflict using the Student–Teacher Relationship Scale in the ADHD group. Multilevel analyses revealed that teachers provided significantly more corrective feedback to children in the ADHD compared to the TDC group. Children in the ADHD group received more corrective than positive feedback, but this pattern was reversed for the TDC group. Multiple regression analyses in the ADHD group indicated that lower levels of positive feedback were related to higher levels of motor hyperactivity. Higher levels of corrective feedback were associated with higher levels of verbal hyperactivity. Closeness moderated this association: Corrective feedback was related to levels of verbal hyperactivity only if teachers experienced less closeness in the relationship with the child. None of the other moderation effects were significant. Teachers provided more corrective feedback to children with ADHD than to typically developing children, and teacher feedback toward children with ADHD was associated with levels of hyperactivity. A close teacher–student relationship may serve as protective factor for the receipt of corrective feedback in this group, but experimental studies are needed to confirm this hypothesis.
... These services should aim to promote studentteacher closeness, minimize student-teacher conflict, and support class-wide behavior, namely, through universal emotional and organizational supports or practices to support staff 's delivery of emotional and organizational supports. Multitiered systems of implementation support for teachers' use of evidence-based classroom management (e.g., delivering high rates of verbal acknowledgments for desired behavior) and behavioral interventions (e.g., group contingencies) may offer a framework for supporting staff behavior in the service of students' self-regulation development (Zakszeski, Thomas, & Erdy, 2020). ...
Article
Self-regulation is a critical component of school readiness and success. Practices for supporting self-regulation may be advanced by a better understanding of factors characterizing children at risk for challenges and contextual mechanisms associated with desirable developmental trajectories.The current study leverages a large national data set and four-level analyses to evaluate an ecological model of self-regulation development that considers student-, classroom-, and school-level factors in relation to teacher-rated self-regulation growth and outcomes across kindergarten and first grade. Analyses identified reliable associations for growth trajectories and the risk factors of being younger, male, and from a low socioeconomic status background; experiencing low student–teacher closeness and high student–teacher conflict; and attending a kindergarten class with lower levels of peer-displayed appropriate behavior. Findings signify the importance of service delivery aimed at advancing the school-based implementation of emotional and organizational supports to promote student–teacher interactions and class-wide demonstration of positive behavior.
Article
Full-text available
Kennarar og starfsfólk skóla þurfa að ná til fjölbreytts hóps barna og styðja við nám, hegðun og líðan hvers og eins. Mikilvægt er að samskipti kennara og nemenda séu farsæl og þar skiptir bekkjarstjórnun miklu máli. Árangursrík bekkjarstjórnun eykur gæði kennslu og námsástundun og stuðlar auk þess að bættri líðan kennara og nemenda. Ef hún er ómarkviss getur það hins vegar valdið álagi og streitu, bæði fyrir nemendur og kennara. Þessi rannsókn fjallar um mat starfandi grunnskólakennara á námskeiði í gagnreyndum bekkjarstjórnunaraðferðum fyrir starfsfólk skóla, sem meðal annars voru sóttar í smiðju PMTO-foreldrafærni og SMT-skólafærni. Hagkvæmni og gagnsemi aðferðanna var metin; hvort það að takast markvisst á við að efla eigin bekkjarstjórnun og stuðning við félagsfærni nemenda nýttist starfandi grunnskólakennurum. Áhersla var lögð á að kanna sýn kennaranna á aðferðir sem þeir lærðu á námskeiðinu og nýttu svo á vettvangi með nemendum sínum, svo sem gagnsemi þeirra og hvort og hvaða aðferðir þeir sæju fyrir sér að nota áfram. Þátttakendur, alls ellefu talsins, voru starfandi grunnskólakennarar sem luku námskeiðinu og mátu afrakstur þess. Blönduðum rannsóknaraðferðum var beitt, meðal annars spurningalistum og mati á mætingu og þátttöku. Einnig voru tekin rýnihópaviðtöl við tvo mismunandi undirhópa þátttakenda. Samhljómur var um að það sem þátttakendur lærðu á námskeiðinu hefði borið árangur og að þeir myndu halda áfram að nýta aðferðirnar á vettvangi. Þá töldu þátttakendur þjálfun sem þessa nauðsynlega fyrir kennara, sérstaklega nýliða í stéttinni. Niðurstöður samræmast fyrri íslenskum rannsóknum á þessu sviði og benda til þess að þörf sé fyrir og áhugi á þjálfun í bekkjarstjórnun meðal kennara og starfsfólks skóla hérlendis. Fjallað er almennt um aðferðirnar og mikilvægi þeirra fyrir aðlögun nemenda og kennara.
Article
Full-text available
The present study is a wait-list controlled, randomized study investigating a teacher coaching approach that emphasizes formative assessment and visual performance feedback to enhance elementary school teachers’ classroom practices. The coaching model targeted instructional and behavioral management practices as measured by the Classroom Strategies Assessment System (CSAS) Observer and Teacher Forms. The sample included 89 general education teachers, stratified by grade level, and randomly assigned to 1 of 2 conditions: (a) immediate coaching, or (b) waitlist control. Results indicated that, relative to the waitlist control, teachers in immediate coaching demonstrated significantly greater improvements in observations of behavior management strategy use but not for observations of instructional strategy use. Observer- and teacher-completed ratings of behavioral management strategy use at postassessment were significantly improved by both raters; ratings of instructional strategy use were significantly improved for teacher but not observer ratings. A brief coaching intervention improved teachers’ use of observed behavior management strategies and self-reported use of behavior management and instructional strategies.
Article
Full-text available
Although high levels of intervention implementation are more likely to lead to improved student outcomes, educators struggle to maintain high implementation levels over time. School psychologists might provide research-supported, consequence-oriented supports (e.g., performance feedback) to promote educators' implementation, yet these are reactive and potentially time intensive. This study evaluated whether a proactive, antecedent-oriented support (i.e., daily, preprogrammed e-mailed prompts) could effectively promote educators' implementation. Findings indicate that for 3 of 4 teachers who participated in this multiple baseline single case design study, implementation of the class-wide behavior intervention improved upon receiving e-mailed prompts. In addition, increases in praise, decreases in corrective statements, and corresponding improvements in student outcomes were noted. This initial study suggests that prompts may be a feasible and effective Tier 1 implementation support that can be incorporated by school psychologists to support educators responsible for delivering interventions in the classroom. Additional implications for future research and school-based practice are discussed.
Article
Full-text available
We evaluated the impact of antecedent specificity in goal statements on adherence to positive behavior-management strategies. Teaching staff were recruited from 2 different school settings where there were routine expectations to use behavior-specific praise in the classroom, but adherence was poor. In a concurrent multiple baseline design, the use of behavior-specific praise by 4 participants was found to be unaffected by goal statements that increasingly specified the behavior to be used and the conditions under which the behavior should occur. However, adherence by 3 of the 4 participants did change when goal statements included teacher-specified frequencies with which the behavior should occur. Results were systematically replicated in a second study in which, in a concurrent multiple baseline design, 3 participants showed marked increases in adherence when goal statements specified the target behavior, the conditions under which it should occur, and the frequency with which it should occur.
Article
Teacher praise is an effective classroom management tool. Training teachers to increase their use of praise can improve student disruptive and off-task behavior. The purpose of this article is to examine different characteristics of praise and the training methods used in the literature. Training methods with positive treatment acceptability and demonstrated impact are summarized. Results indicate that most research focuses on behavior-specific, verbal, and contingent praise delivered to individual students. Most training studies used a combination of two or more methods that most commonly included a didactic, feedback, or goal setting component. Only half of the training studies measured treatment acceptability and the majority of these ratings were positive. Most studies training teachers to use praise had positive results. More research focused on infrequently studied praise characteristics (e.g., gestures, physical, and private) and training methods (e.g., in vivo, self-monitoring, and incentives) is needed. Implications for future praise research are presented.
Article
Teachers struggle to maintain high levels of treatment integrity, which are associated with efficient improvements in student outcomes. To address this challenge, school psychologists can provide implementation support, such as prompts or performance feedback, to increase teachers' treatment integrity when it is low. Implementation prompts are an emerging implementation support having been investigated in one previous study, but are feasible and require little time to provide. Performance feedback is an evidence-based practice, but requires more time for school psychologists to coordinate and deliver. The current study sought to compare the emailed delivery of prompts and performance feedback directly. Three elementary school teachers from a diverse setting participated with their students in this experimental multiple baseline single-case design research study. Teachers were trained to implement a classwide group contingency intervention and, when treatment integrity was low, received prompts and then performance feedback. Direct observation of treatment integrity and classwide behavior indicated that performance feedback was slightly more effective at increasing treatment integrity, but implementation prompts were modestly effective, took less time to provide, and were viewed as more acceptable by teachers. Furthermore, student outcomes (academic engagement and disruptive behavior) were relatively stable across the emailed prompts and performance feedback phases, suggesting the supports were similarly effective. Future research might further investigate these findings and continue to build the research base for implementation supports to promote treatment integrity.
Article
Effective classroom instruction is contingent upon successful classroom management. Unfortunately, not all teachers successfully manage classroom behavior and need in-service professional development. In this study, we replicated a targeted professional development approach that included a brief one-on-one training session and emailed visual performance feedback to increase novice teachers’ use of behavior-specific praise, an evidence-based classroom management skill. Dependent variables collected through direct observation included teachers’ behavior-specific praise along with average student engagement and disruptions. Four elementary teachers participated and, based on a multiple-baseline single-case design, we found a functional relationship between the targeted professional development and teachers’ increased use of behavior-specific praise. However, because of variability and one teacher's limited response, effect sizes were small for behavior-specific praise and little change was observed in student behaviors. These findings warrant further research to determine which classroom management skills affect student behaviors overall, as well as continued evaluation of this professional development model and using school-based coaches.
Article
Successful instruction is contingent upon effective classroom management. Unfortunately, not all teachers are effective classroom managers and many require in-service professional development (PD) to increase their use of evidence-based classroom management skills. Although PD models have been developed and evaluated, many are resource-intensive. To address this, we developed a multitiered system for PD (MTS-PD) to provide increased levels of support based on need as measured by teacher behavior. We conducted two studies to examine the effect of Tiers 1 and 2 of the MTS-PD model on elementary school teachers’ use of behavior-specific praise (BSP). Study 1 examined the effect of Tier 1, a single 25-min didactic training, and Study 2 examined the effect of Tier 2, which included regular visual performance feedback delivered via email. The results of Study 1 indicated that teachers did not increase their rates of BSP to a priori defined levels of success. Study 2 found that the Tier 2 PD approach increased teachers’ BSP rates, a functional relationship was established, and the rates maintained 3 months after the Tier 2 PD. Study limitations and future directions are discussed.
Article
Classroom engagement is important to young children’s academic and social development. Accurate methods of capturing this behavior are needed to inform and evaluate intervention efforts. This study compared the accuracy of interval durations (i.e., 5 s, 10 s, 15 s, 20 s, 30 s, and 60 s) of momentary time sampling (MTS) in approximating the duration of classroom engagement as measured by continuous duration recording (CDR). Twenty-four sessions of children in large-group instruction were observed using the Behavioral Observation of Students in School for Early Education (BOSS-EE). In general, shorter intervals produced engagement estimates that more highly correlated with CDR data and had less measurement error relative to estimates from longer intervals. Findings suggest that selection of MTS interval duration may affect the accuracy of estimates for children with low levels of engagement to a greater extent relative to children with high levels of engagement. Implications and future directions are discussed.
Article
Two studies investigated the accuracy of eight different interval-based group observation methods that are commonly used to assess the effects of classwide interventions. In Study 1, a Microsoft Visual Basic program was created to simulate a large set of observational data. Binary data were randomly generated at the student level to represent 30-min observations using a 15-s momentary time sampling procedure for 5, 000 students distributed evenly across 200 classrooms. Additionally, five classroom types were generated to determine if the base rate of behavior affected the accuracy of each method. Each of the eight observation methods were applied to the simulated data and compared to a criterion to determine their accuracy in estimating rates of classroom behavior. A two-way ANOVA identified a significant main effect for observation method, F(3.40, 663.07) = 15,824.22, p,.001, and a significant interaction between coding method and classroom composition, F(13.60, 663.07) = 40.04, p,.001. In Study 2, to replicate Study 1 using authentic observation data, we compared the accuracy of the same eight methods using a small sample of observations collected in an actual classroom. The results of both studies suggest that six of the eight methods (i.e., two Individual methods and four Planned Activity Check methods) are accurate assessments of group behavior. Furthermore, although classroom composition was associated with statistically significant differences between the accurate methods, we do not consider them large enough to be practically relevant.