ArticlePDF Available

Teachers' Perceptions of School ClimateA Validity Study of Scores From the Revised School Level Environment Questionnaire

Authors:

Abstract

Scores from a revised version of the School Level Environment Questionnaire (SLEQ) were validated using a sample of teachers from a large school district. An exploratory factor analysis was used with a randomly selected half of the sample. Five school environment factors emerged. A confirmatory factor analysis was run with the remaining half of the sample. Goodness-of-fit indices indicated that the factor structure fit the data reasonably well. Further analyses using structural equation modeling techniques revealed that the Revised SLEQ worked equally well for all samples. Invariance testing showed that the fitted model and the estimated parameter values were statistically equivalent across all samples. Internal consistency estimates provided further evidence of the reliability of factor scores. In addition, an analysis of variance indicated that the instrument discriminated climate differences between schools. Results suggest that the Revised SLEQ provides a good tool for studying teachers' perceptions of school climate.
http://epm.sagepub.com
Measurement
Educational and Psychological
DOI: 10.1177/0013164406299102
online Jun 6, 2007;
2007; 67; 833 originally publishedEducational and Psychological Measurement
Bruce Johnson, Joseph J. Stevens and Keith Zvoch
From the Revised School Level Environment Questionnaire
Teachers' Perceptions of School Climate: A Validity Study of Scores
http://epm.sagepub.com/cgi/content/abstract/67/5/833
The online version of this article can be found at:
Published by:
http://www.sagepublications.com
at:
can be foundEducational and Psychological Measurement Additional services and information for
http://epm.sagepub.com/cgi/alerts Email Alerts:
http://epm.sagepub.com/subscriptions Subscriptions:
http://www.sagepub.com/journalsReprints.navReprints:
http://www.sagepub.com/journalsPermissions.navPermissions:
http://epm.sagepub.com/cgi/content/refs/67/5/833
SAGE Journals Online and HighWire Press platforms):
(this article cites 20 articles hosted on the Citations
© 2007 SAGE Publications. All rights reserved. Not for commercial use or unauthorized distribution.
at UNIV OF OREGON on January 26, 2008 http://epm.sagepub.comDownloaded from
Teachers’ Perceptions
of School Climate
A Validity Study of Scores From the
Revised School Level Environment Questionnaire
Bruce Johnson
University of Arizona
Joseph J. Stevens
University of Oregon
Keith Zvoch
University of Nevada, Las Vegas
Scores from a revised version of the School Level Environment Questionnaire (SLEQ)
were validated using a sample of teachers from a large school district. An exploratory
factor analysis was used with a randomly selected half of the sample. Five school
environment factors emerged. A confirmatory factor analysis was run with the remain-
ing half of the sample. Goodness-of-fit indices indicated that the factor structure fit the
data reasonably well. Further analyses using structural equation modeling techniques
revealed that the Revised SLEQ worked equally well for all samples. Invariance testing
showed that the fitted model and the estimated parameter values were statistically
equivalent across all samples. Internal consistency estimates provided further evidence
of the reliability of factor scores. In addition, an analysis of variance indicated that the
instrument discriminated climate differences between schools. Results suggest that
the Revised SLEQ provides a good tool for studying teachers’ perceptions of school
climate.
Keywords: confirmatory factor analysis; exploratory factor analysis; school climate;
School Level Environment Questionnaire (SLEQ); structural equation modeling;
teacher perceptions
S
chool climate has a variety of meanings, including the social system of shared
norms and expectations (Brookover et al., 1978), the set of norms and expecta-
tions that others have for students (West, 1985), teachers’ morale (Brown & Henry,
1992), level of teachers’ empowerment (Short & Rinehart, 1992), students’ per-
ceptions of the ‘personality of a school’ (W. L. Johnson, Johnson, & Zimmerman,
1996, p. 64), or the environment for students as indicated by the amount of negative
Educational and
Psychological Measurement
Volume 67 Number 5
October 2007 833-844
Ó 2007 Sage Publications
10.1177/0013164406299102
http://epm.sagepub.com
hosted at
http://online.sagepub.com
Authors’ Note: Please address correspondence to Bruce Johnson, University of Arizona, P. O. Box
210069, Tucson, AZ 85721-0069; e-mail: brucej@email.arizona.edu.
833
© 2007 SAGE Publications. All rights reserved. Not for commercial use or unauthorized distribution.
at UNIV OF OREGON on January 26, 2008 http://epm.sagepub.comDownloaded from
student behavior in the school (Bern stein, 1992). In the present study, past concep-
tions of school climate are integrated with the widely used view of school climate
as the psychosocial context in which teachers work and teach (Fisher & Fraser,
1990a).
One commonly used instrument for measuring teachers’ perceptions is the
School Level Environment Questionnaire (SLEQ). First reported in 1982 (Burden
& Fraser, 1994; Fraser & Rentoul, 1982), the SLEQ has been used to measure
school climate in several studies of schools in Australia (Cresswell & Fisher, 1998;
Fisher & Fraser, 1990b; Fisher & Grady, 1998; Fisher, Grady, & Fraser, 1995;
Rentoul & Fraser, 1983; Williamson, Tobin, & Fraser, 1986), South Africa
(Mailula & Laugksch, 2003), and the United States (Blose & Fisher, 2003; Henson,
2001a; B. Johnson & Stevens, 2000; C. E. Johnson & Templeton, 1998).
The original development of the SLEQ began with a review of existing school
environment instruments (Rentoul & Fraser, 1983). The review identified several
limitations with the school climate measures utilized by researchers and system
stakeholders. First, some of the instruments were developed without a great deal
of awareness of relevant literature about school environments. Second, some were
developed without checking the applicabili ty and importance of the dimensions to
classroom teachers. Third, some were designed for non–school environments and
contained item s not relevant to schools and teachers. Fourth, many instruments
combined school-level and classroom-level environments. Finally, some of the
instruments required too much time for teachers to respond adequately to the items.
Based on these findings, a set of six criteria were followed in constructing the
SLEQ: consistency with literature, coverage of Moos’s 1974 general categories of
environments (discussed below), sal ience to practicing teachers, specific relevance
to schools, minimal overlap with classroom environment instruments, and economy
in administration (Rentoul & Fraser, 1983).
Scales were chosen based on Moos’s three general dimensions for all human
environments—relationships, personal development, and system maintenance and
system change (Rentoul & Fraser, 1983). After initial testing, one of the original
scales, Achievement Orientation, was dropped and another, Work Pressure, was
added. In addition, the names of two scales were changed; Formalization was chan-
ged to Staff Freedom, and Centralization was changed to Participatory Decision
Making. The resulting SLEQ consisted of 56 items arranged in eight scales:
Student Support, Affiliation, Professional Interest, Staff Freedom, Participatory
Decision Making, Innovation, Resource Adequacy, and Work Pressure.
Results associated with the SLEQ in a previous study (B. Johnson & Stevens,
2001) suggested the feasibility of a shortened, revised version of the SLEQ.
Exploratory and confirmatory factor analyses in that study suggested retaining
only five (Student Support, Affiliation, Part icipatory Decision Making, Innovation,
and Resource Adequacy) of the original eight factors. Professional Interest, Staf f
834 Educational and Psychological Measurement
© 2007 SAGE Publications. All rights reserved. Not for commercial use or unauthorized distribution.
at UNIV OF OREGON on January 26, 2008 http://epm.sagepub.comDownloaded from
Freedom, and Work Pressure were dropped from the revised instrument, leaving
35 of the original 56 items. In preparation for the present study, the authors further
modified the instrument by renaming the five scales and eliminating an additional
14 items. Scale names were changed to reflect better the items in each scale. In
addition, because the Revised SLEQ was to be used as part of a longer survey,
items were eliminated to reduce instrument length and minimize item redundancy;
the authors attempted to create a school climate instrument that contained only
those items that clearly reflected the intent of the scale. The resulting Revised
SLEQ consisted of 21 items in five scales: Collabor ation (replacing Affiliation)
with 6 instead of 11 items, Decision Making (formerly called Participatory Deci-
sion Making) with 3 rather than 8 items, Instructional Innovation (formerly called
Innovation) with all 4 items retained, Student Relations (formerly called Student
Support) with 4 instead of 7 items, and School Resources (formerly called
Resource Adequacy) with 4 rather than 5 items. The purpose of the present study
was to validate scores from this revised version of the SLEQ.
Method
Participants
The Revised SLEQ was sent to all 4,920 teachers in a large urban school district
in the southwestern United States as part of a larger survey. The 21 SLEQ items
were interspersed with 21 other items dealing with teachers’ perceptions of aca-
demic press, leadership, job satisfaction, and school quality. Completed surveys
were obtained from 2,558 teachers in 119 schools, a 52% response rate. About half
(49.7%) came from 80 elementary schools, with 25.9% from 26 middle schools
and 24.3% from 13 high schools. The number of completed surveys from each
school ranged from 6 at one small elementary school to 65 from a large high
school. After eliminating 9 cases in which there were large numbers of missing
items, the responses of 2,549 teachers were analyzed. The majority (81.0%) of the
participating teachers were females. Most teachers (72.2%) were Caucasian, while
23.5% were Hispanic, 1.8 % Native American, 1.1% African American, 0.5 % Asian
American, and 3.7% Other.
Analyses
An exploratory factor analysis (EFA) was conducted using teacher respon-
ses from a randomly chosen half of the sample (N ¼ 1; 275), and the remaining
responses were saved for a confirmatory factor analysis (CFA). For the EFA, prin-
cipal axis factoring and oblimin rotation (d ¼ 0) were used. These methods were
chosen because an underlying theoretical structure was hypothesized and because
Johnson et al. / Validity of the Revised SLEQ 835
© 2007 SAGE Publications. All rights reserved. Not for commercial use or unauthorized distribution.
at UNIV OF OREGON on January 26, 2008 http://epm.sagepub.comDownloaded from
it was assumed that the dimensions or factors describing the structure might be
intercorrelated. The CFA was used to determine whether the factor structure
obtained using EFA could be confirmed on teacher responses from the remainder
of the sample. Stru ctural equation modeling methods (Arbuckle, 1997; Bollen,
1989) were used to estimate the CFA models.
Several further analyses were also conducted. Invariance testing was used to
determine if the Revised SLEQ worked equally well for teachers in each of the
three school levels (i.e., elementary, middle, and high school). Internal consistency
of the scores for the entire Revised SLEQ and of each of its factors was investi-
gated through an a reliability analysis. Finally, analyses of variance (ANOVAs)
were run to examine if the instrument as a whole and each of its factors could
discriminate climate score differences between schools.
Results
In the initial EFA, five factors with eigenvalues greater than 1.0 were extracted,
accounting for 63.0% of the variance of the orig inal items. Collaboration accounted
for 33.9% of the variance, Student Relations 10.4%, School Resources 8.0%,
Decision Making 5.9%, and Instructional Innovation 4.8%. Interfactor correlations
ranged from .29 to .63, sufficient to justify using an oblique rotation and analyzing
both pattern and structure matrices (see Tables 1 and 2; Henson & Roberts, 2006).
In addition to an examination of the scree plot and the number of factors meeting
Kaiser’s rule, parallel analysis and Velicer’s minimum average partial (MAP) test
were conducted (O’Connor, 2000). Results of the MAP test sugges ted retention of
three factors, and a parallel analysis using 1,000 replications suggested the use of
six components. Because the MAP test tends to err in the direction of underex-
traction and the parallel analysis tends to err in the direction of overextraction
(O’Connor, 2000), the use of five factors based on Kaiser’s rule and conceptual con-
siderations appeared to be well supported. This solution was consistent with the five
hypothesized SLEQ factors, and all 21 items fit into their hypothesized factors.
The CFA model used was a hierarchical model in which the 21 SLEQ items
were arranged in the five hypothesized factors, each of which was related to an
overall second-order general climate factor (see Figure 1). Results of commonly
used goodness-of-fit indices indicated that the model fit the data reasonably well.
Adjusted goodness-of-fit index (.93) and comparative fit index (CFI; .94) values
were close to the oft-recommended criterion value of .95, and root mean square
error of approximation (.052) was lower than the recommended level of .06 (Hu &
Bentler, 1999). w
2
was statistically significant, indicating that the model did not fit
the data exactly, but with a large sample size as in the present study (N ¼ 1; 274)
even minor differences between the observed and implied covariance matri x may
result in statistical significance (Schumacker & Lomax, 1996).
836 Educational and Psychological Measurement
© 2007 SAGE Publications. All rights reserved. Not for commercial use or unauthorized distribution.
at UNIV OF OREGON on January 26, 2008 http://epm.sagepub.comDownloaded from
Table 1
Exploratory Factor Analysis Results—Pattern Matrix
Factor
No. Item I II III IV V
Collaboration
20. Classroom instruction is rarely coordinated across teachers. .687 .015 .045 .040 .063
11. I have regular opportunities to work with other teachers. .590 .014 .084 .043 .001
6. There is good communication among teachers. .528 .117 .095 .085 .061
21. Good teamwork is not emphasized enough at my school. .513 .050 .068 .127 .153
16. I seldom discuss the needs of individual students with other teachers. .410 .027 .046 .013 .010
1. Teachers design instructional programs together. .388 .072 .022 .258 .194
Student Relations
2. Most students are well mannered or respectful of the school staff. .020 .903 .072 .030 .043
12. Students in this school are well behaved. .062 .822 .013 .067 .010
7. Most students are helpful and cooperative with teachers. .008 .800 .025 .037 .001
17. Most students are motivated to learn. .064 .611 .099 .049 .040
School Resources
18. The supply of equipment and resources is not adequate. .084 .018 .794 .054 .053
3. Instructional equipment is not consistently accessible. .124 .031 .650 .105 .112
13. Video equipment, tapes, and films are readily available. .012 .034 .647 .037 .026
8. The school library has sufficient resources and materials. .100 .002 .551 .063 .161
Decision Making
4. Teachers are frequently asked to participate in decisions. .067 .047 .012 .772 .133
14. I have very little to say in the running of the school. .068 .017 .045 .733 .037
9. Decisions about the school are made by the principal. .023
.013 .019 .613 .039
Instructional Innovation
15. We are willing to try new teaching approaches in my school. .043 .010 .007 .045 .677
5. New and different ideas are always being tried out. .014 .022 .025 .144 .670
19. Teachers in this school are innovative. .118 .122 .070 .081 .527
10. New courses or curriculum materials are seldom implemented. .179 .035 .046 .063 .486
Note: Bold indicates values above .30.
837
© 2007 SAGE Publications. All rights reserved. Not for commercial use or unauthorized distribution.
at UNIV OF OREGON on January 26, 2008 http://epm.sagepub.comDownloaded from
Table 2
Exploratory Factor Analysis Results—Structure Matrix
Factor
No. Item I II III IV V
Collaboration
20. Classroom instruction is rarely coordinated across teachers. .726 .256 .305 .380 .499
11. I have regular opportunities to work with other teachers. .649 .241 .317 .397 .427
6. There is good communication among teachers. .683 .362 .379 .467 .508
21. Good teamwork is not emphasized enough at my school. .718 .325 .371 .513 .575
16. I seldom discuss the needs of individual students with other teachers. .385 .084 .091 .189 .237
1. Teachers design instructional programs together. .665 .329 .307 .569 .574
Student Relations
2. Most students are well mannered or respectful of the school staff. .225 .864 .240 .235 .256
12. Students in this school are well behaved. .241 .830 .313 .280 .299
7. Most students are helpful and cooperative with teachers. .228 .783 .250 .189 .265
17. Most students are motivated to learn. .288 .666 .336 .216 .311
School Resources
18. The supply of equipment and resources is not adequate. .359 .288 .818 .361 .297
3. Instructional equipment is not consistently accessible. .353 .293 .704 .368 .253
13. Video equipment, tapes, and films are readily available. .258 .270 .668 .278 .238
8. The school library has sufficient resources and materials. .165 .204 .548 .157 .263
Decision Making
4. Teachers are frequently asked to participate in decisions. .452 .301 .334 .813 .460
14. I have very little to say in the running of the school. .508 .279 .357 .808 .432
9. Decisions about the school are made by the principal. .332 .164 .234 .611 .254
Instructional Innovation
15. We are willing to try new teaching approaches in my school. .494 .261 .274 .374 .724
5. New and different ideas are always being tried out. .498 .255 .260
.438 .727
19. Teachers in this school are innovative. .470 .349 .312 .282 .633
10. New courses or curriculum materials are seldom implemented. .547 .299 .317 .406 .656
Note: Bold indicates values above .30.
838
© 2007 SAGE Publications. All rights reserved. Not for commercial use or unauthorized distribution.
at UNIV OF OREGON on January 26, 2008 http://epm.sagepub.comDownloaded from
Invariance Testing
To determine if the fitted model worked equally well for each of the three school
levels, a series of invariance hypotheses were tested (see Table 2). The first model
tested applied the same structural form of the CFA model to all three groups but left
all parameters unconstrained so that each group had parameters freely estimated.
This model served as the baseline for comparison with a series of increasingly con-
strained invariance tests. The second model involved imposing the elementary
school regression weights from each first-order latent variable to its respective
items on the middle school and high school samples. These constraints resulted in
Figure 1
Revised School Level Environment Questionnaire
Confirmatory Factor Analysis Model
School
Resources
Student
Relations
Decision
Making
Collaboration
Instructional
Innovation
School Climate
5
6
1
4
9
14
18
13
8
3
12
7
2
.78
.53
.59
.95
.83
.81
.81
.87
.65
.52
.75
.80
.85
.77
.56
.76
.68
.71
.70
.72
.64
.36
.69
.77
17
.66
.65
10
15
19
11
16
20
21
Note: The coefficients are standardized regression weights.
Johnson et al. / Validity of the Revised SLEQ 839
© 2007 SAGE Publications. All rights reserved. Not for commercial use or unauthorized distribution.
at UNIV OF OREGON on January 26, 2008 http://epm.sagepub.comDownloaded from
an increase in w
2
of 47.94, p ¼ :011. Although statistically significant, the change
in fitted variance as indicated by the difference in the CFI index was about .001.
Cheung and Rensvold (2002) recommend a cutoff of 2% (.02) in incremental fit
indices such as the CFI as an indication of the presence of differences between
groups in testing measurement invariance.
To the constra ints imposed in Model 2, Model 3 added constraints on the path
coefficients from the second-order general school climate factor to the five first-
order factors. Model 4 constrained the variance of the second-order factor to be
equal across groups, and Model 5 constrained the residuals of the first-order latent
variables to be equal across groups. Model 6 constrained the residuals of the mea-
sured items to be equal across the three groups. Inspection of the changes in CFI
for each model shows that there were only minor changes in fit across the hierarchy
of invariance tests (see Table 3). For the last model (measurement residuals), the
change in CFI compared to the first model was about a 1.3% increase in unfitted
variance. In addition, the overall CFI value remained at a high level (.937) even
after all parameters were constrained across the three groups. These resu lts indicate
that the CFA model was essentially invariant across elementary, middle, and high
school teachers.
Internal Consistency
Internal consi stency was estimated by calculating a reliability coefficients.
Results are shown in Table 4. Scores for the instrument as a whole, measuring
overall school climate, had a relatively strong reliability coefficient in this sample
(.90; Henson, 2001b; Nunnally & Bernstein, 1994). Scores for each of the five fac-
tors also had acceptable reliability coefficients, from .77 to .86. These coefficients
are in the same range as those reported in previous studies of the SLEQ (Fisher &
Fraser, 1990a; Fraser, Williamson, & Tobin, 1987).
Table 3
Invariance Tests Across Three School Levels
Model w
2
df CFI w
2
df
p CFI
1. Unconstrained 1,248.30 441 .955
2. Measurement weights 47.94 28 .011 .001
3. Latent weights 70.02 36 .001 .002
4. Latent variances 75.75 38 < .001 .002
5. Latent residuals 139.88 48 < .001 .005
6. Measurement residuals 330.61 86 < .001 .013
840 Educational and Psychological Measurement
© 2007 SAGE Publications. All rights reserved. Not for commercial use or unauthorized distribution.
at UNIV OF OREGON on January 26, 2008 http://epm.sagepub.comDownloaded from
Differentiation Between Schools
Following the approach of other researchers using the SLEQ (see Fisher et al.,
1995; Fisher & Fraser, 1990b; Fisher & Grady, 1998), ANOVAs were used to
investigate the ability of the Revised SLEQ to differentiate between schools (see
Table 5). These analyses are done because in order for the SLEQ to be useful for
most applications, it must be able to detect differences between schools. If the
instrument cannot do so, either there are no differences in climate among schools
and teachers’ perceptions of those climates, which is extremely unlikely, or the
instrument is not sensitive enough to pick up those differences. Significant differ-
ences between schools on each of the five climate factor scores as well as on the
overall climate factor score were found (all p values < .001). Strength of asso-
ciation as measured by Z
2
also showed that from 22% to 31% of the variation in
climate factor scor es was associated with school affiliation.
Discussion
Results from the current study demonstrated the factorial validity of the 21-item
Revised SLEQ. Five hypothesized factors emerged in the EFA, and this structure
was supported in the CFA. The factor analyses also confirmed the association of
items with their hypothesized factors. In addition, the structure and measurement
properties of the Revised SLEQ were found to apply equivalently for elementary,
middle, and high school teachers.
There are important limitations to this study. Participants were volunteers, and it
is not known if their perceptions of their schools’ climates were the same as those
of nonrespondents. Although there were no statistically significant differences
Table 4
Internal Consistency (Reliability) Results for the Revised SLEQ
Present Study
95% Confidence Interval Previous Studies
Factor a Lower Upper Factor a
Overall School Climate .90 .894 .905 Overall School Climate .90
Collaboration .82 .807 .829 Affiliation .87, .85, .84, .78
Decision Making .78 .765 .794 Participatory Decision
Making
.80, .69, .82, .78
Instructional Innovation .79 .773 .800 Innovation .84, .78, .81, .68
Student Relations .86 .849 .867 Student Support .70, .79, .85
School Resources .77 .759 .788 Resource Adequacy .81, .80, .65, .68
Note: Coefficients from previous studies are taken from Johnson & Stevens (2001).
Johnson et al. / Validity of the Revised SLEQ 841
© 2007 SAGE Publications. All rights reserved. Not for commercial use or unauthorized distribution.
at UNIV OF OREGON on January 26, 2008 http://epm.sagepub.comDownloaded from
between respondents and nonrespondents in ethnicity, years of teaching experience,
or educational level, it is possible those who responded chose to do so for a particu-
lar reason—that is, they felt particularly strongly about their schools’ climate—that
was different for nonresponde nts. In addition, these results were from one school
district in a southwestern U.S. city. Results may be different for schools in other
places.
The Revised SLEQ can be an important tool for other researchers int erested in
investigating issu es related to teachers’ perceptions of school climate. For those
interested in examining the relationships between this construct and other factors,
it is relatively easy to use with large numbers of teachers. For example, recent work
(Goddard, LoGerfo, & Hoy, 2004) has shown the link between teachers’ perceived
collective efficacy and student achievement. The SLEQ could be used to investi-
gate the relationship between school climate and collective efficacy. For more in-
depth studies of schools, the Revised SLEQ might be used, along with interviews
and observations, to assess how teachers’ perceptions of school climate change
over time. The Revised SLEQ is currently being used by the authors as part of a
longitudinal study of teachers’ perceptions of school climate and other factors such
as job satisfaction, school quality, professional development, and student achieve-
ment. The longitudinal nature of the larger study will provide an opportuni ty to
examine several important questions regarding school climate including the stabi-
lity of teachers’ perceptions of their schools’ climate over time; the relations hips
between school climate and other factors such as satisfaction, school quality, aca-
demic press, and leadership; and the relationship between all of these factors and
student achievement. The instrument can also be useful to those at a particular
school, providing data helpful to the teachers themselves in identifying elements of
school climate they wish to change (Fraser, 1999). The study of school climate is a
complicated endeavor. The Revised SLEQ is a tool that can help us in our attempts
to unravel its mysteries.
Table 5
Analysis of Variance (ANOVA) Tests of Ability
to Discriminate Between Schools
Between-Schools Factor F df MSE p Z
2
Overall School Climate 8.900 118, 2430 56.681 .001 .31
Collaboration 6.497 118, 2430 2.994 .001 .24
Decision Making 5.613 118, 2430 4.040 .001 .22
Instructional Innovation 5.494 118, 2430 2.570 .001 .22
Student Relations 8.004 118, 2430 3.997 .001 .29
School Resources 8.522 118, 2430 5.029 .001 .30
842 Educational and Psychological Measurement
© 2007 SAGE Publications. All rights reserved. Not for commercial use or unauthorized distribution.
at UNIV OF OREGON on January 26, 2008 http://epm.sagepub.comDownloaded from
References
Arbuckle, J. L. (1997). Amos users’ guide (Version 3.6) [Computer manual]. Chicago: SPSS, Inc.
Bernstein, L. (1992). Where is reform taking place? An analysis of policy changes and school climate.
Educational Evaluation and Policy Analysis, 14, 297-302.
Blose, R. J., & Fisher, D. (2003, April). Effects of teachers’ school level environment perceptions on
changing elementary mathematics classroom environments. Paper presented at the annual meeting of
the American Educational Research Association, Chicago, IL.
Bollen, K. (1989). Structural equations with latent variables. New York: John Wiley.
Brookover, W. B., Schweitzer, J. H., Schneider, J. M., Beady, C. H., Flood, P. K., & Wisenbaker, J. M.
(1978). Elementary school social climate and school achievement. American Educational Research
Journal, 15, 301-318.
Brown, G. J., & Henry, D. (1992). Using the climate survey to drive school reform. Contemporary
Education, 63, 277-280.
Burden, R., & Fraser, B. (1994). Examining teachers’ perceptions of their working environments:
Introducing the School Level Environment Questionnaire. Educational Psychology in Practice, 10,
67-71.
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement
invariance. Structural Equation Modeling, 9, 233-255.
Cresswell, J., & Fisher, D. (1998, April). A qualitative description of teachers’ and principals’ percep-
tions of interpersonal behavior and school environment. Paper presented at the annual meeting of
the American Educational Research Association, San Diego, CA.
Fisher, D., & Grady, N. (1998). Teachers’ images of their schools and perceptions of their work environ-
ments. School Effectiveness and School Improvement, 9, 334-348.
Fisher, D., Grady, N., & Fraser, B. (1995). Associations between school-level and classroom-level envir-
onment. International Studies in Educational Administration, 23, 1-15.
Fisher, D. L., & Fraser, B. J. (1990a). School climate: Assessing and improving school environments
(Set: Research Information for Teachers No. 2, Item 4). Melbourne, Australia: Australian Council
for Educational Research.
Fisher, D. L., & Fraser, B. J. (1990b, April). Validity and use of the School-Level Environment Question-
naire. Paper presented at the annual meeting of the American Educational Research Association,
Boston, MA. (ERIC Document Reproduction Service No. ED318757)
Fraser, B. J. (1999). Using learning environment instruments to improve classroom and school climates.
In H. J. Freiberg (Ed.), School climate: Measuring, improving and sustaining healthy learning envir-
onments (pp. 65-83). Philadelphia: Falmer Press.
Fraser, B. J., & Rentoul, A. J. (1982). Relationships between school-level and classroom-level environ-
ment. Alberta Journal of Educational Research, 28, 212-225.
Fraser, B. J., Williamson, J., & Tobin, K. (1987). Use of classroom and school climate scales in evaluat-
ing alternative schools. Teaching and Teacher Education, 3, 219-231.
Goddard, R. D., LoGerfo, L., & Hoy, W. K. (2004). High school accountability: The role of perceived
collective efficacy. Educational Policy, 18, 403-425.
Henson, R. K. (2001a). The effects of participation in teacher research on teacher efficacy. Teaching and
Teacher Education, 17, 819-836.
Henson, R. K. (2001b). Understanding internal consistency reliability estimates: A conceptual primer on
coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177-189.
Henson, R. K., & Roberts, J. K. (2006). Use of exploratory factor analysis in published research:
Common errors and some comments on improved practice. Educational and Psychological Measure-
ment, 66, 393-416.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conven-
tional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
Johnson et al. / Validity of the Revised SLEQ 843
© 2007 SAGE Publications. All rights reserved. Not for commercial use or unauthorized distribution.
at UNIV OF OREGON on January 26, 2008 http://epm.sagepub.comDownloaded from
Johnson, B., & Stevens, J. J. (2000, April). Elementary teachers’ perceptions of school climate and
student achievement. Paper presented at the annual meeting of the American Educational Research
Association, New Orleans, LA.
Johnson, B., & Stevens, J. J. (2001). Exploratory and confirmatory factor analysis of the School Level
Environment Questionnaire (SLEQ). Learning Environments Research, 4, 325-344.
Johnson, C. E., & Templeton, R. A. (1998, April). Promoting peace in a place called school. Paper
presented at the annual meeting of the American Educational Research Association, San Diego, CA.
Johnson, W. L., Johnson, A. M., & Zimmerman, K. (1996). Assessing school climate priorities: A Texas
study. Clearing House, 70, 64-66.
Mailula, E. M., & Laugksch, R. C. (2003, April). School-level environment and the implementation of
outcomes-based education in South Africa. Paper presented at the annual meeting of the American
Educational Research Association, Chicago, IL.
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using
parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers,
32, 396-402.
Rentoul, A. J., & Fraser, B. J. (1983). Development of a school-level environment questionnaire. Journal
of Educational Administration, 21, 21–39.
Schumacker, R. E., & Lomax, R. G. (1996). A beginner’s guide to structural equation modeling.
Mahwah, NJ: Lawrence Erlbaum.
Short, P. M., & Rinehart, J. S. (1992). School Participant Empowerment Scale: Assessment of level
of empowerment within school environment. Educational and Psychological Measurement, 52,
951-960.
West, C. A. (1985). Effects of school climate and school social structure on student academic achieve-
ment in selected urban elementary schools. Journal of Negro Education, 54, 451-461.
Williamson, J. C., Tobin, K. G., & Fraser, B. J. (1986, April). Use of classroom and school environment
scales in evaluating alternative high schools. Paper presented at the annual meeting of the American
Educational Research Association, San Francisco, CA. (ERIC Document Reproduction Service No.
ED274693.
844 Educational and Psychological Measurement
© 2007 SAGE Publications. All rights reserved. Not for commercial use or unauthorized distribution.
at UNIV OF OREGON on January 26, 2008 http://epm.sagepub.comDownloaded from
... Meanwhile, Revised-School Level Environment Questionnaire (R-SLEQ) was adopted in this research to measure teacher's perceptions of their School Climate towards the IE programme (Johnson et al., 2007). R-SLEQ covers five sub-scales and the items from each subscale total up to 21 items: (a) six items in Collaboration sub-scale, (b) three items in Decision Making subscale, (c) four items in Instructional Innovation sub-scale, (d) four items in Student Relations sub-scale, as well as (e) four items in School Resources sub-scale (Johnson et al., 2007). ...
... Meanwhile, Revised-School Level Environment Questionnaire (R-SLEQ) was adopted in this research to measure teacher's perceptions of their School Climate towards the IE programme (Johnson et al., 2007). R-SLEQ covers five sub-scales and the items from each subscale total up to 21 items: (a) six items in Collaboration sub-scale, (b) three items in Decision Making subscale, (c) four items in Instructional Innovation sub-scale, (d) four items in Student Relations sub-scale, as well as (e) four items in School Resources sub-scale (Johnson et al., 2007). Among the 21 items, 8 items were negative worded. ...
... Among the 21 items, 8 items were negative worded. The items are 5-point scale, ranging from "strongly disagree", "disagree", "neither agree or disagree", "agree", as well as "strongly agree" (Johnson et al., 2007). After the negative worded items which were reversed, researcher added all the scores from each item, then divide the sum scores by 21. ...
... When theorising the relevance of school climate for explaining student achievement across different school sectors, we focus on those aspects that are measurable in the data at hand, thereby deriving theoretical propositions that we are able to test empirically. These include safety (physical and emotional) (Thapa et al., 2013), school discipline (Johnson et al., 2007), as well as teachers' selfefficacy, which taps into the academic dimension of school climate (Thapa et al., 2013;Wang & Degol, 2016). ...
... Another important indicator of school safety is school discipline (Johnson et al., 2007), which can be captured by teachers' perception of the consistency and capability of school discipline practices. Studies highlight the important role of consistent and effective school discipline practice in promoting various students' outcomes (Wang & Degol, 2016). ...
Article
Full-text available
Driven by the focus on standardised assessment and performance-driven accountability, a considerable body of literature has documented differences in students’ academic achievement across school sectors, both internationally and in Australia. However, few studies have to date explored the potential mechanisms underlying such differences, particularly through the lens of school climate and student engagement. And despite extensive literature on school climate and student engagement, including their relationships with achievement, the differences in these patterns across school sectors remain under-studied. In this paper, we leverage nationally representative data from a large-scale longitudinal survey in Australia with linked administrative data on student achievement to reveal different patterns of school climate and student engagement across government, Catholic and independent sectors. Employing multivariable regression analyses, we identify unique school climate and student engagement facets that are associated with improved achievement in each of these sectors, offering important pointers for educational policies.
... Developed in the early 80 s on a solid theoretical and rigorously validated, the School Level Environment Questionnaire (SLEQ) is one of the best-known instruments to assess the school-level climate (Rentoul & Fraser, 1983). First based on eight conceptual dimensions of school climate (affiliation, student supportiveness, professional interest, achievement orientation, formalization, centralization, innovativeness, and resources adequacy), five-factor to seven-factor models have been identified in empirical studies (Aldridge & Fraser, 2016;Johnson & Stevens, 2001;Johnson et al., 2007). The SLEQ is a comprehensive and valid tool oriented towards teachers' experience of school climate assessing important aspects of school climate such as how teachers feel supported by colleagues or school administration. ...
... Several recent studies examined the invariance of different school climate instruments (Gálvez-Nieto et al., 2021;Ioverno & Russell, 2022;Johnson et al., 2007;Konold et al., 2021;La Salle et al., 2021;Rifenbark et al., 2021;Schweig et al., 2019;Yang et al., 2013;You et al., 2014). Most of these studies addressed group invariance, evaluating if school climate measures are comparable across different personal characteristics (e.g., gender, socioeconomic status, ethnicity, grade level). ...
Article
Full-text available
School climate is an essential ingredient of student well-being and academic success. Although it has been studied extensively, only a few well-validated instruments are available for the assessment of school climate. The aim of this study was to assess the factor validity and measurement invariance of the Socio-educational Environment Questionnaire (SEQ) using data from a longitudinal cohort of 1036 French-Canadian high school students who were assessed on three occasions. Exploratory structural equation modeling was used to empirically test the factor structure and measurement invariance across time and gender. The results supported the proposed SEQ five-factor model (teacher–student relationship, student relationships, justice climate, academic climate, and safety climate) and its longitudinal invariance across high school years. Gender invariance was also established. Finally, predictive validity was assessed. Among the five school climate dimensions, teacher–student relationships, academic and safety climate were related to subsequent school engagement. School climate was not associated with either boys’ or girls’ academic achievement. Overall, this study suggests that the SEQ is a valid and reliable short tool for the assessment of school climate in high school.
... Les items de ces deux questionnaires étaient accompagnés d'une échelle de fréquence de type Likert 1 (jamais) à 7 (toujours). Enfin, les facteurs contextuels ont été mesuré par la version traduite du « Revised School Level Environment Questionnaire » (Johnson, Stevens, & Zvoch, 2007) (21 items, échelle de réponse en 5 points) : la collaboration entre enseignants (6 items), la relation aux élèves (4 items), les ressources de l'école (4 items), les prises de décision (3 items), les innovations pédagogiques (4 items). ...
Article
Full-text available
Dans une période de confinement à cause de la COVID-19, les enseignants ont dû s’adapter dans l’urgence lors de l’année scolaire 2019-2020. L’objet de cette étude était de comparer l’épuisement professionnel, l’engagement des enseignants, et les facteurs contextuels pouvant influencer l’épuisement professionnel durant une année scolaire traditionnelle et celle de la COVID-19. Des données ont été recueillies auprès de 135 enseignants en 2016-2017 et 73 enseignants en 2019-2020. Les résultats suggèrent que les enseignants d’éducation physique ont mieux vécu cette période de confinement que les enseignants d’autres branches. Comparés aux enseignants d’autres branches, ils ont reporté des scores de burnout moins élevés et des scores d’engagement plus élevés lors de l’année COVID-19. Ces résultats peuvent être reliés au fait que durant cette année 2019-2020, les enseignants d’éducation physique ont mieux collaborés et se sont sentis plus impliqués dans les prises de décision de la direction.
... Classroom emotional climate was measured using a unidimensional six-item questionnaire (Appendix B) developed for this study, referring to both The School-Level Environment Questionnaire (Johnson et al., 2007) and five emotional elements of classroom emotional climate (emotional awareness, relationships, management, and interpersonal beliefs and guidelines) proposed by Harvey et al. (2012). All six items (e.g., Most students react to my emotions) were scored on a five-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree), and the internal consistency analysis showed a Cronbach's alpha of 0.83, indicating good reliability. ...
Article
Full-text available
Introduction Emotions are an integral part of education, and the way teachers manage their emotions is crucial to educational success. This study focuses on teachers’ emotional labor in secondary school classrooms and examined the relationships between emotional labor strategies and display rules, trait emotions, emotional exhaustion, and classroom emotional climate. Methods In the study, 496 secondary school teachers (386 female) aged 21–59 years (mean age = 37.61 ± 8.87 years) completed five self-reported questionnaires. Data were analyzed using structural equation model in AMOS. Results The results showed that (1) display rules provide positive situations to deep acting and the expression of naturally felt emotions and mediate teachers’ positive emotions and strategies; (2) positive trait emotions increase the expression of naturally felt emotions and negative trait emotions increase surface acting; (3) surface acting results in emotional exhaustion and has an adverse impact on classroom emotional climate; and (4) deep acting and the expression of naturally felt emotions positively affect classroom emotional climate. Discussion These findings revealed that deep acting and the expression of naturally felt emotions are positively related to positive emotions and the classroom setting, whereas surface acting plays a negative role in the emotional states of individuals and the classroom. The study gives the centrality of teacher emotions in the teaching and learning process, clarifies some antecedents and consequences related to emotional labor strategies in a classroom setting, and provides some ideas to optimize educational outcomes. The five variables presented in the study are good examples that can contribute to protecting teachers’ wellbeing and improving the psychosociological environment.
... School Level Environment Questionnaire: Thi scale, developed by Johnson, Stevens, and Zvoch (2007) and adapted to Turkish by Doğan and Strohmeier (2016), measures teachers' perceptions of the existing school climate. The response format was a 5-point Likert type scale consisting of 21 items (1-Strongly Disagree, 5-Strongly Agree). ...
... The school climate was measured using the Revised School Level Environment Questionnaire (R-SLEQ; Johnson et al., 2007), which was translated into Finnish (α = .81). The measurement consisted of 17 items that covered four elements: collaboration, student relations, decision making, and instructional innovation. ...
Article
The importance of collective teacher efficacy (CTE) has been increasingly emphasised, but few studies have focused on how it can be enhanced. Since CTE is assumed to be related to factors that differ between schools, the belief-shaping sources of CTE could be related to principals’ beliefs of their efficacy. Moreover, a school climate that centralises teachers’ attempts to improve student learning could enhance CTE. This paper examines a proposed analytical model that links principal self-efficacy (PSE) to CTE, as mediated by the school climate. The model is tested via a multilevel analysis with data from 70 Finnish schools and 767 educators. The analysis revealed that PSE is partially and indirectly related to CTE via the school climate at the school level. Based on these results, theoretical and practical implications for future research and teaching development efforts are discussed.
... The data in the present study is based on questionnaire responses from a sample of 973 teachers. The SWPBS Questionnaire consisted of 50 questions, built upon several instruments: Teacher's evaluation of Classroom behavioural climate (Närhi et al., 2015), Teacher evaluations on behavioural problems in school (Grey & Sime, 1989), Organisational health and school climate and Revised School Level Environment Questionnaire (R-SLEQ) (Johnson et al., 2007), and Teacher Collective effi cacy (Tschannen- Moran & Barr, 2004). The Teacher Questionnaire was designed to measure several factors: Problematic behaviours in school (Factor I), Classroom behavioural climate (Factor II), School climate (Factor III) and Teacher collective effi cacy: Collective teacher Beliefs Scale (Factor IV). ...
Article
Full-text available
Disruptive behaviours negatively interfere with learning outcomes, forcing schools to identify effective preventive and intervention strategies in order to improve behavioural school climate. An extensive body of research promotes School-Wide Positive Behaviour Support (SWPBS) as an effective preventive framework to foster prosocial behaviours and simultaneously reduce disruptive behaviours. This paper presents the findings from a study that aimed at investigating problematic behaviours during primary education among typically developing children and to examine subgroup differences in the effectiveness of the SWPBS framework in Romania. Participants in our study were a sample of 973 teachers teaching in 30 schools from the Arges county schools. A descriptive statistical analysis was undertaken (a) to identify the type and intensity of disruptive behaviours, (b) to analyse the characteristics of schools with a high frequency of problematic behaviours and (c) to test if school-related variables (such as school size and location) can be linked with students’ disruptive behaviours. Results indicated that higher rates of disruptive behaviours identified by teachers from our research sample were noisiness while entering the school, running in hallways. Problematic behaviours are more likely to be identified and defined by more experienced teachers, although the correlation proved to be small. Problematic behaviours correlated positively with school size and location. The bigger the school, the more disruptive behaviours were present. The current study adds to the evidence that schools are unique organizations and a school-wide prevention model should be developed considering the school characteristics and their specific context. Research limitations and implications for policies are also discussed in this paper.
Article
Full-text available
Purpose: Study aims to determine how transformational leadership styles of head teachers' affect the job satisfaction of teachers. It also yearns to uncover whether school climate intervene amongst the transformational leadership style adopted by head teacher and job satisfaction of teachers. Research Design/ Methodology: Data has been collected by using an online questionnaire survey. Convenient sampling technique has been utilized for collecting data from education sector of Pakistan. 295 valid responses have been taken for analysis. Data analysis has been done by using SPSS and AMOS 21. Findings: The outcomes of the current study unveiled that there is full mediation of school climate among transformational leadership style and job satisfaction. It also revealed a significant positive relationship between transformational leadership style and job satisfaction. The results also showed a positive and significant relationship between transformational leadership style and school climate.
Article
Early externalizing and internalizing problems undermine children's school success and long-term well-being. Leveraging a large, U.S.-representative dataset (N ≈ 14,810), we examined how kindergarten teachers' self-efficacy and school climate perceptions were linked to students' behavior problems in kindergarten and first grade. Teachers' self-efficacy and school climate perceptions were uniquely linked to kindergarteners' externalizing and internalizing behaviors, after controlling for demographic covariates and children's executive functions. Kindergarten teachers' higher self-efficacy predicted lower levels of children's externalizing problems in first grade, while teachers' positive school climate perceptions predicted children's lower internalizing problems in first grade. Longitudinal models demonstrated that teachers' perceived school climate and self-efficacy were uniquely associated with decreases in children's externalizing and internalizing behaviors from kindergarten to first grade. Findings highlight the importance of teachers' self-efficacy and school climate for children's socio-emotional development and underscore an urgent need to determine how best to support teacher well-being to optimize children's outcomes.
Article
Full-text available
Given the proliferation of factor analysis applications in the literature, the present article examines the use of factor analysis in current published research across four psychological journals. Notwithstanding ease of analysis due to computers, the appropriate use of factor analysis requires a series of thoughtful researcher judgments. These judgments directly affect results and interpretations. The authors examine across studies (a) the decisions made while conducting exploratory factor analyses (N = 60) and (b) the information reported from the analyses. In doing so, they present a review of the current status of factor analytic practice, including comment on common errors in use and reporting. Recommendations are proffered for future practice as regards analytic decisions and reporting in empirical research.
Article
The present study investigates the relationships among a variety of school-level climate variables and mean school achievement in a random, sample of Michigan elementary schools. School-level SES, racial composition and climate were each highly related to mean school achievement; only a small proportion of the between-school variance in achievement is explained by SES and racial composition after the effect of school climate is removed. The climate variable we have called Student Sense of Academic Futility had the largest correlation with achievement. An observational study of four schools with similar SES and racial composition but different achievement tended to support the more analytical findings and suggest the processes by which climate affects achievement.
Article
This study examined the relationship between collective efficacy and high school student achievement in a state with an accountability system heavily focused on achievement, measured by mandatory assessments in multiple content areas. Using social cognitive theory, a theoretical model was developed linking school context and collective efficacy to differences among schools in 12th grader student achievement. Structural equation modeling was used to test the fit of the model to data drawn from students and teachers in 96 state high schools. Collective efficacy was positively influenced by past mastery experience and negatively related to school socioeconomic disadvantage. Additionally, after accounting for the influence of several aspects of school context, collective efficacy remained a significant positive predictor of student performance across all content areas tested by the state. The authors discuss the implications of these findings for social cognitive theory and school improvement in an era of school accountability for student performance on subject-specific achievement assessments.
Article
Two hundred eleven teachers in public schools rated 68 beliefs about what makes them feel empowered in schools. The items were factor analyzed revealing six dimensions or subscales: (a) Decision Making, (b) Professional Growth, (c) Status, (d) Self-Efficacy, (e) Autonomy, and (f) Impact. A 38-item School Participant Empowerment Scale (SPES) was constructed by selecting marker items for each of the six dimensions. Obtained internal consistency estimates of reliability for the total scale was .94, and ranged from .81 to .89 for the six factor scales. Evidence of discriminant validity also was discussed.