Sam Sims’s research while affiliated with University College London and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (53)


Teaching for near transfer: Is maths instruction aimed at schema formation and abstraction associated with pupils' ability to answer unfamiliar maths questions?
  • Article

December 2024

·

12 Reads

Learning and Individual Differences

·

·

Sam Sims

·

There has long been interest in education on the issue of “transfer” – the extent to which students can apply what they have been taught in school to solve related but novel problems or tasks. More recently, attention in this literature has turned to understanding whether certain teaching approaches are more likely to lead to transfer, such as integrating new learning with existing knowledge and comparing multiple cases with the same underlying structure. Using data on 280,000 students in the 2019 TIMMS study, we investigate whether maths teaching that uses this approach is associated with primary students being able to solve mathematics problems that are not included on their country's national curriculum. We find no evidence that it does, which underlines the challenges involved in teaching for near, let alone far, transfer of academic skills.



Testing for sequential bias in school inspections

October 2024

·

9 Reads


Do schools that employ an inspector get better inspection grades?
  • Article
  • Full-text available

May 2024

·

35 Reads

In England, a substantial proportion of school inspections are conducted by current school leaders. This may lead to concerns that this gives their school (about 2% of schools) an advantage in the inspection process when it is their turn to be inspected. Yet scant evidence exists on this issue. This paper thus presents the first evidence on this matter, using data obtained via a freedom of information request and linking this with other publicly available information about England's schools. We find that schools where a member of staff also works for Ofsted receive better inspection outcomes than schools without an inspector on their payroll. Our findings nevertheless suggest that other schools may benefit from having access to the training material and professional development opportunities Ofsted provides to its inspectors.

Download



Do inspection reports change over time?

March 2024

·

8 Reads

School inspections are a common feature of education systems across the world. In these inspections, trained professionals visit schools and reach a high-stakes judgement about the quality of education they provide. School inspections rely upon professional judgement, and are meant to reflect the quality of the provision of a school. There is currently little academic evidence investigating these reports at scale, including how they vary over time. We make use of two cut-off moments in the inspection process in the last two decades: (1) a document dispelling myths about what inspectors in England are looking for and (2) the introduction of the 2019 Education Inspection Framework (EIF). We present new empirical evidence on this matter, drawing upon data from more than 60,000 inspection reports for primary and secondary schools in England between 1997 and 2022. Several computational techniques show that themes in the reports did not change much after the myths document, while after the framework change reports put more emphasis on leadership, subject specialism and the curriculum.


Testing for sequential bias in school inspections

March 2024

·

19 Reads

Inspectors are tasked with judging the quality of provision based on visits to schools. They conduct these inspections sequentially, completing one before moving on to the next. However, empirical research in a range of settings outside education suggest that prior judgements in a sequence can influence subsequent judgements, despite being logically irrelevant. We investigate whether school inspectors in England display such sequential bias by testing whether they judge similar schools differently, depending on the judgements they reached in prior inspections. We find only limited evidence of sequential bias in primary school inspections. In particular, an inspector reaching an ‘Inadequate’ judgement in their previous inspection is associated with a 42% reduction in the odds of reaching another ‘Inadequate’ judgement in their next inspection. Only around 5% of inspection judgements result in an ‘Inadequate’ and we do not find consistent evidence of sequential bias at other grades, meaning this bias only affects a small minority of judgements. We also do not find the same results for secondary schools, albeit in a much smaller sample.



Effective Teacher Professional Development: New Theory and a Meta-Analytic Test

December 2023

·

116 Reads

·

61 Citations

Review of Educational Research

Sam Sims

·

·

·

[...]

·

Jake Anders

Multiple meta-analyses have now documented small positive effects of teacher professional development (PD) on pupil test scores. However, the field lacks any validated explanatory account of what differentiates more from less effective in-service training. As a result, researchers have little in the way of advice for those tasked with designing or commissioning better PD. We set out to remedy this by developing a new theory of effective PD based on combinations of causally active components targeted at developing teachers’ insights, motivating change, developing teaching techniques, and then embedding these changes in teachers’ practice. We test two important implications of the theory using data identified through a systematic review and meta-analysis of 104 randomized controlled trials, finding qualified empirical support for the theory. The main contribution of the article is to provide a testable theory of what makes PD more effective, which can be used to guide future empirical research on this topic.


Citations (29)


... Recent efforts have aimed to enhance AI literacy among educators through structured training programs to support effective AI integration in teaching (Wang et al., 2024). However, significant gaps remain in preparing educators for the practical implementation of AI tools, and the success of AI in language education depends on model accuracy and reliability (Sims et al., 2023). ...

Reference:

Secondary School Teachers’ Experiences with Generative AI in Maltese Language Teaching
Effective Teacher Professional Development: New Theory and a Meta-Analytic Test
  • Citing Article
  • December 2023

Review of Educational Research

... The (poor) performance of their students on external assessments makes teachers feel anxious, under pressure, guilty and sometimes even embarrassed (Jerrim et al., 2024;Smith, 1991;Vértiz-Osores et al., 2019). Even teachers whose students are successful on external assessments feel anxious because they feel pressure from the principal to maintain high results or increase them compared to the previous year (Smith, 1991) or their salary partly depends on it (Hatch, 2013 in Werler andKlepstad Faerevaag, 2017). ...

High Stakes Assessments in Primary Schools and Teachers’ Anxiety About Work
  • Citing Article
  • May 2024

Educational Assessment

... In addition, teacher well-being is associated with important outcomes, including how long teachers persist in the profession, how effective they are, how often they are absent, and their willingness to help with school reform efforts (Duckworth et al., 2009;UNESCO, 2023). There is evidence that teacher well-being was low in the U.S. before 2020 and that the stressors introduced by the COVID-19 pandemic have exacerbated the stress and burnout teachers experience (Jerrim et al., 2024;Ma et al., 2022). ...

How did the COVID-19 pandemic affect the anxiety of teachers at work?
  • Citing Article
  • February 2024

... Even though anxiety over a test could boost motivation, concentration, and effort, which would result in better grades (Kader 2016), a meta-analysis on test anxiety showed that regardless of testing format, a high level of test anxiety was associated with low performance for students (von der Embse et al. 2018). On the other side, Jerrim et al. (2023) found that test anxiety-whether very high, very low, or moderate-does not seem to have a strong relationship with performance. The results suggest that the common belief that high anxiety negatively affects grades might not always hold true, as the differences were small and did not change based on factors like past performance or socioeconomic status. ...

Teacher autonomy: Good for pupils? Good for teachers?

... Self-esteem is a critical quality that enables teachers to deliver lessons effectively, manage classrooms efficiently, and inspire students (Omodan et al., 2022). Teachers with high self-esteem are more likely to experiment with innovative teaching methods, fostering a dynamic learning environment (Jerrim et al., 2023). The importance of these qualities cannot be overstated, as they enhance student learning, resulting in better academic outcomes and personal growth (Day et al., 2016). ...

Teacher self-efficacy and pupil achievement: much ado about nothing? International evidence from TIMSS

... It seems likely that waiting list and "as usual" controls will continue to be preferred by schools and trialists Wheatley et al., 2020). As such, trialists might consider reporting downweighted or adjusted results from waiting list-controlled studies alongside main effects (Hafliðadóttir et al., 2021;Sims et al., 2023). As well as contributing to the evidence base about control group moderation effects, this could be important information for school leaders and policymakers when commissioning mental health services in educational settings. ...

Quantifying “Promising Trials Bias” in Randomized Controlled Trials in Education

Journal of Research on Educational Effectiveness

... The literature is almost in consensus with the features of effective PD based on the relevant literature on PD design (Desimone 2009, Darling-Hammond et al. 2017, effectiveness studies of PD on fostering teacher change (i.e. Timperley et al. 2007), and recent systematic reviews and metaanalysis (Sims et al. 2021, Cirkony et al. 2024. Similar features are consistent and hold promise for online (Bragg et al. 2021), blended (Mouza et al. 2022), and bichronous PD studies (Martin et al. 2023aNalbantoglu et al. 2024) and outlined in systematic reviews (e.g. ...

What are the characteristics of teacher professional development that increase pupil achievement? Protocol for a systematic review
  • Citing Article
  • October 2021

... As a solution, researchers propose using aggregate school-level datasets to carry out program evaluation in valid, nonintrusive, and cost-effective ways (Jacob et al., 2014;Hallberg et al., 2018;Stuart, 2007). A number of within-study comparisons demonstrate that quasi-experimental designs can produce valid estimates that are similar to experimental designs when the comparison group is carefully selected and the pre-intervention trend is adequately modeled (e.g., Hallberg et al., 2020;Jacob et al., 2016;Sims et al., 2022;St. Clair et al., 2016). ...

The Internal Validity of the School-Level Comparative Interrupted Time Series Design: Evidence From Four New Within-Study Comparisons

Journal of Research on Educational Effectiveness

... The field is clouded by definitional problems (Macdonald, 1999;Rinke, 2007;Weldon, 2018) as past research has not used consistent nomenclature for the variety of behaviours related to the change in the number of teachers from one year to the next in a school and/or the profession. Terms such as 'turnover ', 'attrition', 'movement', 'churn', 'leaving', 'continuing', and 'wastage' are used inconsistently across the body of research (Atteberry et al., 2017;Brantlinger, 2021;Menzies, 2023;Plunkett & Dyson, 2011;Quartz et al., 2008;Rinke & Mawhinney, 2017;Sims, 2021;Worth & De Lazzari, 2017). We use 'turnover' to describe all teacher departures from a school (Sorensen & Ladd, 2020) and distinguish within the concept of 'turnover' that 'migration' is when teachers move schools but stay in teaching, and 'attrition' is when teachers leave the profession altogether (Ryan et al., 2017). ...

Why do some schools struggle to retain staff? Development and validation of the Teachers' Working Environment Scale (TWES)