ArticlePDF Available

John Hattie: Visible learning: A synthesis of over 800 meta-analyses relating to achievement

Authors:
BOOK REVIEW
John Hattie: Visible learning: A synthesis of over 800
meta-analyses relating to achievement
Routledge, Abingdon, 2008, 392 pp, ISBN 978-0-415-47618-8
(pbk)
Ivo Arnold
Published online: 2 May 2011
ÓThe Author(s) 2011. This article is published with open access at Springerlink.com
This book by John Hattie – Professor of Education at the University of Auckland –
is the culmination of more than a decade of research during which he and his team
have set out to summarise and synthesise the empirical research on the effects of
various educational influences and interventions on student achievement. Probably
due to the huge scope of this project – comprising 800 meta-analyses, more than
50,000 smaller studies and more than 80 million pupils – this study has been widely
acclaimed. According to a review in the Times Educational Supplement, Hattie’s
work ‘‘reveals teaching’s Holy Grail’’.
Hattie starts from the observation that in education ‘‘everything seems to work’’,
as educational interventions of almost any kind seem to have a positive effect on
student achievement. He then proposes to move beyond ‘‘everything goes’’, towards
the development of a barometer of ‘‘what works best’’. To this end he applies the
tools of meta-analysis to a huge body of empirical research and calculates effect
sizes (denoted d) for 138 influences in the following domains: student, home,
school, teacher, curricula and teaching approaches. Hattie neatly presents the effect
sizes in a graphical barometer and convincingly argues that only effect sizes higher
than 0.4 are in the so-called zone of desired effects (in other words, are worth the
effort). Prior to presenting the barometers and effect size rankings, Hattie develops
his visible learning story, which is summarised in the following quote: ‘‘Visible
teaching and learning occurs when learning is the explicit goal, when it is
appropriately challenging, when the teacher and student both seek to ascertain
whether and to what degree the challenging goal is attained, when there is deliberate
practice aimed at attaining mastery of the goal, when there is feedback given and
sought, and when there are active, passionate and engaging people participating in
the act of learning’’ (p. 22). The visible learning story is illustrated using the
example of outdoor training. An instructor teaching rock-climbing will have
I. Arnold (&)
Erasmus University Rotterdam, Rotterdam, The Netherlands
e-mail: arnold@ese.eur.nl
123
Int Rev Educ (2011) 57:219–221
DOI 10.1007/s11159-011-9198-8
continuous visual feedback on the success of his teaching efforts (pupils climbing
high or falling down) and be able to adjust his teaching accordingly.
I find the visible learning story a convincing story. I believe most teachers will
agree with the book’s main message that effective instruction cannot take place
without proper feedback from student to teacher on the effectiveness of the
instruction. Hattie also convincingly argues that the effectiveness of teaching
increases when teachers act as activator instead of as facilitator, a view which I find
refreshing in a time when teaching approaches such as problem-based learning have
the effect of sidelining the instructor. My problem with the book is, however, that I
would have been convinced even without the empirical analysis. If anything,
Hattie’s meta-meta-analysis casts a few doubts on the validity of his research, as I
will explain below.
My first comment, however, relates to Hattie’s goal in writing this book. He
states that his aim is ‘‘to develop an explanatory story about key influences on
student learning’’, not to build another ‘‘what works recipe’’. Yet this aim fits
uneasily with the barometers and rankings which are scattered across the book. By
presenting these measures so prominently, the author automatically invites the
reader to make a clear distinction between what works and what doesn’t work. If
Hattie doesn’t want us to draw such conclusions, he should not have presented the
material in this way. Related to this is the tension between story-telling and ranking
influences. The visible learning story is told in Chapter 3 and naturally refers to
some of the effect sizes calculated in the remainder of the book. Yet the relationship
between story and effect sizes remains implicit and qualitative. The reader has no
indication or test result of how well the effect sizes fit the visible learning story.
I next turn to the way in which the meta-meta-analysis has been conducted.
Hattie discusses the various pros and cons of meta-analysis extensively and
concludes that this is a valid research methodology. I will not take issue with this
point, as meta-analysis is a generally accepted tool of academic research. As a
general statistical point, however, I was surprised that Hattie has chosen to
summarise the effect sizes of the 800 meta-analyses using unweighted averages.
Small and large meta-analyses have equal weight, while I would assume that the
number of studies on which a meta-analysis is based indicates its validity and
importance. Instead I would have opted for weighted averaging by number of
studies, students or effect sizes. At a minimum, it would be interesting to see
whether the results are robust to the choice of averaging.
A great asset of Hattie’s book is the reference list, which allows the inquisitive
reader to dig a little bit deeper, by moving from the rankings to the underlying
meta-studies. I have done this for the top-ranking influence, which is ‘‘self-
reported grades’’ (d=1.44). This result is dominated by the Kuncel et al. (2005)
meta-analysis (d=3.1) (Kuncel et al. 2005). This paper is about the validity of
ex-post self-reported grades (due to imperfect storage and retrieval from memory
or intentional deception), not about students’ expectations or their predictive
power of their own study performance, as Hattie claims. The paper thus should
not have been included in the analysis. My N=1 sampling obviously has its
limits, but this example does raise questions regarding the remaining average
effect sizes.
220 I. Arnold
123
Two final comments relate to the application of Hattie’s work. While it is
certainly valuable to know ‘‘what works best’’ in education, educational institutions
will need to know not just the benefit of educational interventions, but also their
cost. So the question which really needs to be answered is ‘‘what works best per
monetary unit spent’’. On the cost side, however, Hattie’s book is silent. Also, given
the importance of two-way feedback in teaching, a major challenge for large-
scale educational institutions (such as universities) is to organise feedback in a
cost-effective manner.
Visible learning should be lauded for emphasising the importance of the student–
teacher relationship and of adequate feedback, but at the same time presents
managers with the challenge of organising this feedback in large scale educational
settings.
Open Access This article is distributed under the terms of the Creative Commons Attribution
Noncommercial License which permits any noncommercial use, distribution, and reproduction in any
medium, provided the original author(s) and source are credited.
Reference
Kuncel, N. R., Crede, M., & Thomas, L. L. (2005). The validity of self-reported grade point averages,
class ranks and test scores: A meta-analysis and review of the literature. Review of Educational
Research, 75(1), 63–82.
Book Review 221
123
... Ефикасна настава математике је заснована на решавању проблема и истраживању математичких појмова, изграђена на претходном математичком знању и разумевању ученика и релевантна за живот ученика, диференцирана како би се задовољиле различите потребе ученика за учењем и заснована на уверењу да сваки ученик мора да изгради своје знање и разумевање. Наставу математике треба доживети као процес, односно стваралачку делатност у којој ће ученици активно да учествују, истражују, изводе закључке, размењују искуства, мишљења и ставове, дискутују (Hattie, 2009). С тим у вези мишљења смо да је потребно редефинисање циља научног образовања у правцу разумевања кључних идеја значајних за живот ученика у савременом друштву, где стечена знања нису циљ већ средство у процесу развоја способности примене тих знања. ...
... Ово подржавају и ПИСА и ТИМСС истраживања која су показала да ученици у Србији највише потешкоћа имају са задацима који захтевају размишљање изван устаљених оквира (Gašić Pavišić i Stanković, 2012;Pavlović Babić i Baucal, 2013). Поступним увођењем научног приступа путем истраживачки засноване наставе математике максимално се стимулише развој мисаоних операција/компоненти, анализе, апстракције, индукције, дедукције, генерализације и аналогије, чиме се повећава капацитет ученика за критичко промишљање (Hattie, 2009). ...
... Учење засновано на истраживању усмерено је на ученике који развијају осећај радозналости за свет око себе и упознају се са научним и математичким начинима размишљања. Овај креативни концепт наставе подразумева рад ученика у тиму, подстиче вршњачко, сарадничко учење и индивидуализован приступ настави (Bell et al., 2005;Rezba et al., 1999;Hattie, 2009). ...
Full-text available
Conference Paper
Many studies have been conducted in the field of research on the stimulating domestic music environment, which show that the decision to engage children in music, in addition to internal factors in the family, can be influenced by external factors, such as the environment in which families live, too. Active inclusion of Slovenes in choirs is one of the most widespread free activities in the Republic of Slovenia, because according to the Public Fund of the Republic of Slovenia for Culture, more than 64.000 people sing in choirs. However, given that Slovenia is a very diverse country, especially in geographical terms, the mentality of people in different environments is very different, although in Slovenia creative people live in both rural and urban areas. Since in the article we discover, whether singing activity is higher in rural than in urban areas, we will define what both is and what are the characteristics of choirs in Slovenia, and then explore the differences between the above activities of parents and children in both areas. In this paper, we find that there are more active singing groups in urban areas, which include families, where both – children and parents – sing in a choir, than in rural areas, which we attribute to “rurbanization”, which blurs the boundaries between rural and urban settlements and their functions. The paper also confirms the assumption that the stimulating domestic music environment (singing at home, attending concerts with parents and parents' opinion that the stimulating musical environment offered to children at home strongly influences their participation in choirs) is related children's singing in choirs.
... Ефикасна настава математике је заснована на решавању проблема и истраживању математичких појмова, изграђена на претходном математичком знању и разумевању ученика и релевантна за живот ученика, диференцирана како би се задовољиле различите потребе ученика за учењем и заснована на уверењу да сваки ученик мора да изгради своје знање и разумевање. Наставу математике треба доживети као процес, односно стваралачку делатност у којој ће ученици активно да учествују, истражују, изводе закључке, размењују искуства, мишљења и ставове, дискутују (Hattie, 2009). С тим у вези мишљења смо да је потребно редефинисање циља научног образовања у правцу разумевања кључних идеја значајних за живот ученика у савременом друштву, где стечена знања нису циљ већ средство у процесу развоја способности примене тих знања. ...
... Ово подржавају и ПИСА и ТИМСС истраживања која су показала да ученици у Србији највише потешкоћа имају са задацима који захтевају размишљање изван устаљених оквира (Gašić Pavišić i Stanković, 2012;Pavlović Babić i Baucal, 2013). Поступним увођењем научног приступа путем истраживачки засноване наставе математике максимално се стимулише развој мисаоних операција/компоненти, анализе, апстракције, индукције, дедукције, генерализације и аналогије, чиме се повећава капацитет ученика за критичко промишљање (Hattie, 2009). ...
... Учење засновано на истраживању усмерено је на ученике који развијају осећај радозналости за свет око себе и упознају се са научним и математичким начинима размишљања. Овај креативни концепт наставе подразумева рад ученика у тиму, подстиче вршњачко, сарадничко учење и индивидуализован приступ настави (Bell et al., 2005;Rezba et al., 1999;Hattie, 2009). ...
Full-text available
Conference Paper
In the introduction of this paper, the concept of Methodology of teaching visual arts at the Teacher Education Faculty in Belgrade will be presented, as well as the challenges we faced as teachers of this subject due to the new epidemiological situation caused by coronavirus (SARS-Cov-2). The changes that have taken place in a global field, changed the way of life, communication, and schooling at all levels, have influenced us to adapt our teaching at the faculty to current epidemiological measures and possibilities in order to better prepare students for successful teaching of visual arts. This research aims to examine the students' attitudes about their experience during the methodological practice at the end of the fourth year of undergraduate studies, to determine the extent to which we managed to educate them for efficient realization of visual arts classes. Students of Teacher Education Faculty in Belgrade, who realized the final methodical practice following the current epidemiological measures participated in this examination. The results of the research will provide guidelines for future reflections and improvements in the conception of our subject.
... Another way to understand integration is to combine parts that are related to each other in an overall relationship. According to the Encyclopedia of Educational Sciences of the Federal Republic of Germany (Enzyklopadie Erziehungswissienscheft, Bd.2, Stuttgart 1984), the general meaning of the word "integration" is expressed in two aspects: (1) The process of re-establishing the general, the whole, the unified from the individual; (2) The state in which there is the common, the whole being made of the individual. According to the 2018 General Education Program, integration is the fusion/unification of different parts to bring up a new object as a unified whole based on the essential features of the object components. ...
... Most of the studies on integrated teaching point to the important role of integrated teaching in forming students' competencies, making learning meaningful and aiming to meet the goals of world education in the 21st century (Arnold, 2011;Lorenzo et al., 2010;Petkovska et al., 2010;Whetten & Clark, 1996). Students in the 21st century, in addition to being equipped with basic knowledge and skills as the foundation for human scientific knowledge, also need to be trained and developed their ability to practice and apply scientific knowledge to solve practical problems of daily life as well as at work. ...
Full-text available
Article
Integrated teaching is a modern educational trend that has been implemented in many countries around the world (Desyandri et al., 2019; Lorenzo et al., 2010; Mirascieva, 2010; Petkovska et al., 2010). Integrated teaching plays an important role in educating, training and developing thinking skills, synthesizing, analyzing, generalizing, and abstracting for learners (Aziz Hussin, 2018; Bonfield et al., 2020). The rapid development of science and technology in the current period is demanding a radical and comprehensive change in the content, methods, and organization of educational and teaching activities. The concept of integrated teaching is an orientation in the fundamental and comprehensive innovation of education, a step from an approach to educational content to an approach to quality and competence, associated with solving problems in practical life. In Vietnam, the General Education Program 2018 was officially issued and implemented in December 2018 (Ministry of Education and Training, 2018a), in which integrated teaching is one of the emphasized points of view at the primary level. It serves as a legal basis for implementation in schools. The article approaches the analysis of the 2018 Primary Education Program at primary schools in Vietnam and the integrated teaching perspective, from which it proposes to develop goals and solutions to implement integrated teaching in primary schools.
... Positive student outcomes have been attributed to teachers who practice highimpact strategies (Hattie, 2008;Arnold, 2011). Sanders and colleagues (1997) examined the significance of the teacher's influence and found that teachers make a difference. ...
Article
Middle school students often lack the motivation to read, and middle school reading teachers often complain of this lack of motivation. Students’ lack of motivation to read seriously affects students’ ability to achieve in their academic classes at the secondary level. This study was based on surveys and interviews from 310 middle school students and their six ELA teachers to explore the relationship between teacher and student motivation to read at the middle school level as well as surveying how do teachers and students at the middle school level describe their motivation to read. Based on the relationship between teacher and student motivation to read and the descriptions of their motivation, how does teacher motivation to read affect student motivation to read? The results of the quantitative study were statistically significant and revealed a weak relationship between teacher motivation and student motivation. The results of the interviews revealed that teachers motivate their students to read by guiding them to literature that interests them and reading aloud or helping them comprehend texts. Qualitative data suggests that teacher leaders who continue professional learning are more effective at motivating students than those who do not. These findings can help those who strive to meet the evolving educational needs of teachers and students in the 21st century classroom.
... Statistical significance was determined at the confidence level of 0.05. In order to describe the strength of the relevant magnitude, effect size was determined by Cohen's d [21,22]. Table 1 shows the abundances of fungal ITS gene in all the soil samples. ...
Full-text available
Article
The exploitation of ion-absorbed rare earth elements (REEs) has caused serious ecological destruction and environmental pollution. Effects on soil fungal structure and diversity exerted by mining activities are usually ignored, although fungus is one of the most important components in soil ecosystems. In the present research, quantitative polymerase chain reaction (qPCR) and high-throughput Illumina MiSeq sequencing were conducted to characterize fungal community composition and structure in soil of a rare earth mining area after in situ leaching. Statistical analyses, network, and FUNGuild were used to conduct in-depth analyses. Ascomycota, Basidiomycota, and Glomeromycota were the most abundant phyla in the mining soils. Fungal community structures were stable after leaching practice, but nutrition contents (organic matter, TC, and TN) significantly and positively contributed to fungal abundances and diversities. Saprotrophs in phyla Ascomycota and Basidiomycota were the dominant fungal trophic mode, and they played critical roles in nutrient cycling, transformation processes, and reducing REE toxicity. Symbiotrophs of phyla Glomeromycota contributed to soil aggregation and slowing down nutrient losses after in situ leaching practice. In addition, fungi could regulate the interactions between species to resist the harsh environment of REE toxicity or ammonium caused by in situ leaching practice.
Full-text available
Preprint
Metacognition is a complex cognitive function that is considered to be one of the most important goals of education. One of the most effective ways to enhance metacognition suggested in the literature is using graphic organisers. However, it is unclear how graphic organisers can facilitate metacognition and what the relationship between them is. The present study is a scoping review that fills this gap and maps the current literature regarding metacognition, graphic organisers and their relationship. Online databases were used to identify papers, from which 25 of them were selected. The results of the review show that there are three types of graphic organisers-metacognition relationship: (1) graphic organisers are used in interventions to enhance metacognition, (2) a combination of graphic organisers and metacognition activities is used in interventions to enhance learning outcomes, and (3) graphic organisers are used to evaluate metacognition. The review also highlights the need for further studies in the field that use experimental design and include younger learners, and diverse subjects, learning domains and contexts. The present study concludes by offering instructional insights for designing metacognition interventions by utilising graphic organisers as aids.
Full-text available
Article
Background: Practice-oriented phases, such as the mandatory clinical traineeships and the final clinical internship, are of great importance in the teaching curriculum and skilful learning of medical students. Aim: With respect to the practical phases, such as clinical clerkship and medical internship, the concept of two innovative courses to prepare and evaluate these crucial training sections is presented including initial experiences from teaching practice. Method: A narrative review is given. Results: A common aim of facultatively initiated lectures is a better qualification of medical students to fulfil the requirements of clerkship and the last practical year of the study of human medicine to facilitate taking first steps towards professional work as a clinical physician, in particular, the self-confidence of the medical students is to be substantially increased. The experiences obtained during clerkship and the last practical year influence interest, motivation and final choice for a certain medical speciality. In that respect, this period is of great importance for the whole professional career. The content of the preparation courses for the first medical clerkships and the final clinical internship provide a valuable contribution to prepare for challenging clinical work as a physician with sole responsibility. In particular, they aim to introduce students to the concept of a multiprofessional and extensive patient care. Taking into account the different practical experiences obtained in previous study sections, students are taught according to the overall aim to achieve an interdisciplinary competence in clinical care. Conclusion: The improvement of teaching and optimized preparation for practical phases in medical studies promotes a more successful learning process during the clerkship and last practical year.
Full-text available
Article
One shared goal of classroom instruction is to support students’ reading competence as a key skill of school success and participation in daily life. Yet, teaching that addresses multilingual students’ language-related resources to support reading is rare. In this study, we enriched reciprocal teaching with elements of linguistically responsive teaching (labelled LRRT) and conducted an intervention study in German primary schools (38 classes and 684 students) to examine its effects on reading competence. To assess reading competence, we used reading comprehension and reading strategy tests. Findings demonstrate the feasibility of our approach in regular primary school classes. Teachers and students highly valued the teaching unit as well. Results of latent mean difference score analysis confirmed the effectiveness of LRRT with respect to students’ reading strategy use but not with respect to their reading comprehension. Moreover, multilingual and monolingual students did not differ in their gains in reading competence. However, multilingual students’ different language use was of particular importance for gains in reading comprehension. The study thus provides further research on multilingualism as well as various stimuli for teachers of today’s heterogenous primary school classes.
Article
Active learning strategies and information technology-based pedagogies are perceived as beneficial and their use and development in academic courses is fast increasing. Faculties can use them to design courses that are challenging and fresher, creative, and meaningful for students, to meet students’ needs and to promote the learning of contents in a social environment, fostering cooperation and the exchange of ideas among peers. Among the active learning strategies recently developed, the peer-instruction and the flipped classroom are prominent in this field. It has been shown that these practices help students in their understanding of contents and consequently in reaching better results in final exam scores. The Covid-19 pandemic in 2020 and 2021 has forced classes in many academic institutions to move to remote teaching under emergency conditions and has deprived students of much of their social interactions. We show here an experience on applying online learning mediated by social teaching platforms and flipped classroom concepts to an undergraduate course on renewable energies provided amid the Covid-19 pandemic at the Physics Department of the University of Cagliari (Italy) in 2020. The constraints of forced distance learning have been turned into an opportunity to test an alternate course format in a complete online environment. An analysis on students’ feedback about our learning method has been performed by a post-diagnostic satisfaction questionnaire, indicating an overall positive effects of active learning strategies in the students’ learning experience. The analysis of their achievements during the course provides confirmation for the positive outcome and shows that the flipped classroom architecture is as robust as the traditional methods when facing the constraints of remote learning.
Full-text available
Chapter
The aim of this volume was to give a comprehensive overview of the current state of the research on student perceptions of and student feedback on teaching. This chapter provides a resume of the important theoretical considerations and empirical evidence the authors contributed to this volume. First, evidence concerning the validity of student perceptions of teaching quality is discussed, highlighting the quality of the questionnaires used and accompanying materials provided by their authors. In the next step, empirical findings are summarized on student and teacher characteristics that can influence important processes within the feedback cycle. Subsequently, it is emphasized that the effectiveness of student feedback on teaching is significantly related to the nature of the individual school’s feedback culture. Furthermore, it is argued that the efficacy of student feedback depends on whether teachers are provided with a high level of support, when making use of the feedback information to improve their teaching practices. As the literature review impressively documents‚ teachers, teaching, and ultimately students can benefit substantially from student feedback on teaching in schools.
Full-text available
Article
Self-reported grades are heavily used in research and applied settings because of the importance of grades and the convenience of obtaining self-reports. This study reviews and meta-analytically summarizes the literature on the accuracy of self-reported grades, class ranks, and test scores. Results based on a pairwise sample of 60,926 subjects indicate that self-reported grades are less construct valid than many scholars believe. Furthermore, self-reported grade validity was strongly moderated by actual levels of school performance and cognitive ability. These findings suggest that self-reported grades should be used with caution. Situations in which self-reported grades can be employed more safely are identified, and suggestions for their use in research are discussed.