ArticlePDF Available

John Hattie: Visible learning: A synthesis of over 800 meta-analyses relating to achievement

Authors:
BOOK REVIEW
John Hattie: Visible learning: A synthesis of over 800
meta-analyses relating to achievement
Routledge, Abingdon, 2008, 392 pp, ISBN 978-0-415-47618-8
(pbk)
Ivo Arnold
Published online: 2 May 2011
ÓThe Author(s) 2011. This article is published with open access at Springerlink.com
This book by John Hattie Professor of Education at the University of Auckland
is the culmination of more than a decade of research during which he and his team
have set out to summarise and synthesise the empirical research on the effects of
various educational influences and interventions on student achievement. Probably
due to the huge scope of this project comprising 800 meta-analyses, more than
50,000 smaller studies and more than 80 million pupils this study has been widely
acclaimed. According to a review in the Times Educational Supplement, Hattie’s
work ‘reveals teaching’s Holy Grail’’.
Hattie starts from the observation that in education ‘everything seems to work’’,
as educational interventions of almost any kind seem to have a positive effect on
student achievement. He then proposes to move beyond ‘everything goes’’, towards
the development of a barometer of ‘what works best’’. To this end he applies the
tools of meta-analysis to a huge body of empirical research and calculates effect
sizes (denoted d) for 138 influences in the following domains: student, home,
school, teacher, curricula and teaching approaches. Hattie neatly presents the effect
sizes in a graphical barometer and convincingly argues that only effect sizes higher
than 0.4 are in the so-called zone of desired effects (in other words, are worth the
effort). Prior to presenting the barometers and effect size rankings, Hattie develops
his visible learning story, which is summarised in the following quote: ‘‘Visible
teaching and learning occurs when learning is the explicit goal, when it is
appropriately challenging, when the teacher and student both seek to ascertain
whether and to what degree the challenging goal is attained, when there is deliberate
practice aimed at attaining mastery of the goal, when there is feedback given and
sought, and when there are active, passionate and engaging people participating in
the act of learning’ (p. 22). The visible learning story is illustrated using the
example of outdoor training. An instructor teaching rock-climbing will have
I. Arnold (&)
Erasmus University Rotterdam, Rotterdam, The Netherlands
e-mail: arnold@ese.eur.nl
123
Int Rev Educ (2011) 57:219–221
DOI 10.1007/s11159-011-9198-8
continuous visual feedback on the success of his teaching efforts (pupils climbing
high or falling down) and be able to adjust his teaching accordingly.
I find the visible learning story a convincing story. I believe most teachers will
agree with the book’s main message that effective instruction cannot take place
without proper feedback from student to teacher on the effectiveness of the
instruction. Hattie also convincingly argues that the effectiveness of teaching
increases when teachers act as activator instead of as facilitator, a view which I find
refreshing in a time when teaching approaches such as problem-based learning have
the effect of sidelining the instructor. My problem with the book is, however, that I
would have been convinced even without the empirical analysis. If anything,
Hattie’s meta-meta-analysis casts a few doubts on the validity of his research, as I
will explain below.
My first comment, however, relates to Hattie’s goal in writing this book. He
states that his aim is ‘to develop an explanatory story about key influences on
student learning’’, not to build another ‘‘what works recipe’’. Yet this aim fits
uneasily with the barometers and rankings which are scattered across the book. By
presenting these measures so prominently, the author automatically invites the
reader to make a clear distinction between what works and what doesn’t work. If
Hattie doesn’t want us to draw such conclusions, he should not have presented the
material in this way. Related to this is the tension between story-telling and ranking
influences. The visible learning story is told in Chapter 3 and naturally refers to
some of the effect sizes calculated in the remainder of the book. Yet the relationship
between story and effect sizes remains implicit and qualitative. The reader has no
indication or test result of how well the effect sizes fit the visible learning story.
I next turn to the way in which the meta-meta-analysis has been conducted.
Hattie discusses the various pros and cons of meta-analysis extensively and
concludes that this is a valid research methodology. I will not take issue with this
point, as meta-analysis is a generally accepted tool of academic research. As a
general statistical point, however, I was surprised that Hattie has chosen to
summarise the effect sizes of the 800 meta-analyses using unweighted averages.
Small and large meta-analyses have equal weight, while I would assume that the
number of studies on which a meta-analysis is based indicates its validity and
importance. Instead I would have opted for weighted averaging by number of
studies, students or effect sizes. At a minimum, it would be interesting to see
whether the results are robust to the choice of averaging.
A great asset of Hattie’s book is the reference list, which allows the inquisitive
reader to dig a little bit deeper, by moving from the rankings to the underlying
meta-studies. I have done this for the top-ranking influence, which is ‘self-
reported grades’ (d=1.44). This result is dominated by the Kuncel et al. (2005)
meta-analysis (d=3.1) (Kuncel et al. 2005). This paper is about the validity of
ex-post self-reported grades (due to imperfect storage and retrieval from memory
or intentional deception), not about students’ expectations or their predictive
power of their own study performance, as Hattie claims. The paper thus should
not have been included in the analysis. My N=1 sampling obviously has its
limits, but this example does raise questions regarding the remaining average
effect sizes.
220 I. Arnold
123
Two final comments relate to the application of Hattie’s work. While it is
certainly valuable to know ‘what works best’ in education, educational institutions
will need to know not just the benefit of educational interventions, but also their
cost. So the question which really needs to be answered is ‘what works best per
monetary unit spent’’. On the cost side, however, Hattie’s book is silent. Also, given
the importance of two-way feedback in teaching, a major challenge for large-
scale educational institutions (such as universities) is to organise feedback in a
cost-effective manner.
Visible learning should be lauded for emphasising the importance of the student–
teacher relationship and of adequate feedback, but at the same time presents
managers with the challenge of organising this feedback in large scale educational
settings.
Open Access This article is distributed under the terms of the Creative Commons Attribution
Noncommercial License which permits any noncommercial use, distribution, and reproduction in any
medium, provided the original author(s) and source are credited.
Reference
Kuncel, N. R., Crede, M., & Thomas, L. L. (2005). The validity of self-reported grade point averages,
class ranks and test scores: A meta-analysis and review of the literature. Review of Educational
Research, 75(1), 63–82.
Book Review 221
123
... By tailoring their teaching strategies to align with students' existing knowledge and experiences, two respondents noted they were able to create more engaging classrooms that address students' needs and provide targeted support. This adaptive teaching practice contributes to a more impactful educational experience, reinforcing findings from previous research that highlight the importance of responsive teaching in promoting student engagement and learning (Arnold, 2011). ...
Article
Full-text available
Law teaching can benefit from a collaborative approach where faculty integrates legal concepts with students’ foundational knowledge, enhancing comprehension and preparing them for professional practice. This study investigates how Tribhuvan University applies such integration, aiming to enrich legal education in Nepal. We employed a modified grounded theory approach to gather data from 10 faculty members from the law teaching constituent campuses of the Tribhuvan University, using interviews, classroom observations, and document analysis. Results of the study reveal that faculty use diverse methods, such as contextualizing legal concepts based on students’ foundational knowledge and introducing interdisciplinary perspectives, to make complex doctrines more comprehensive. However, challenges include navigating sensitive topics, managing large classes, and addressing time constraints. Faculty members reported that leveraging students’ foundational knowledge enhances learning outcomes and fosters ethical awareness but requires considerable institutional support and adaptation. The study suggests that law schools support this collaborative teaching model by offering professional development, encouraging interdisciplinary teaching methods, and aligning resources to meet faculty needs. These measures could modernize legal education and improve student readiness for legal practice in Nepal.
... While surprising, this finding underscores the significance of considering various other factors that contribute to academic performance. These factors include the provision of adequate teaching and learning materials (Adane, 2013, Baidoo-Anu, 2018bBaidoo-Anu & Mensah, 2018), robust educational infrastructures (Baidoo-Anu, 2018a), social support systems (Baidoo-Anu & Acquah, 2021), formative assessment practices that promote learning (Baidoo-Anu, 2023;Baidoo-Anu & Ennu Baidoo, 2022;Baidoo-Anu et al., 2023;Black & Wiliam, 2010), teacher-student relationships, and constructive feedback mechanisms (Hattie, 2011), among others. Therefore, while fostering students' academic self-concept and intrinsic motivation is vital, equal attention must be given to other educational resources required to enhance students' overall academic success. ...
... rficial, segúnFisher et al. (2016), se refiere al momento en que los estudiantes son introducidos inicialmente a conceptos, habilidades y estrategias.Este tipo de aprendizaje es de naturaleza inmediata o a corto plazo. Esta etapa resulta fundamental porque establece una base sobre la cual se espera que los estudiantes profundicen en su pensamiento.Arnold (2009) describe este proceso como el mundo de las ideas, mientras que Platón lo denomina el mundo de las ideas, un proceso en el cual las definiciones del mundo son equivalentes a los pensamientos, ya que las ideas y definiciones representan una copia de los conceptos fundamentales. Por lo tanto, el aprendizaje superficial se refiere a la info ...
Article
Full-text available
This article offers a rigorous analysis of the perspectives on the learning processes required in current contexts. It addresses a wide variety of research and proposals that emphasize the knowledge and practices necessary for those who guide educational processes, with the aim of satisfying the demands and characteristics of modern societies, based on a narrative review of the literature. In this sense, six types of learning stand out: situated learning, extended learning, networked and collaborative social learning, visible learning, research learning, deep learning and future-focused learning. Furthermore, the work presents concrete alternatives to promote these approaches to learning in the school environment.
... rficial, segúnFisher et al. (2016), se refiere al momento en que los estudiantes son introducidos inicialmente a conceptos, habilidades y estrategias.Este tipo de aprendizaje es de naturaleza inmediata o a corto plazo. Esta etapa resulta fundamental porque establece una base sobre la cual se espera que los estudiantes profundicen en su pensamiento.Arnold (2009) describe este proceso como el mundo de las ideas, mientras que Platón lo denomina el mundo de las ideas, un proceso en el cual las definiciones del mundo son equivalentes a los pensamientos, ya que las ideas y definiciones representan una copia de los conceptos fundamentales. Por lo tanto, el aprendizaje superficial se refiere a la info ...
Article
Full-text available
Este artículo ofrece un análisis riguroso de las perspectivas en torno a los procesos de aprendizaje requeridos en los contextos actuales. Aborda una amplia variedad de investigaciones y propuestas que enfatizan los conocimientos y prácticas necesarios para quienes guían los procesos educativos, con el objetivo de satisfacer las demandas y características de las sociedades modernas, a partir de una revisión narrativa de la literatura. En este sentido, se destacan seis tipos de aprendizaje: el aprendizaje situado, el aprendizaje extendido, el aprendizaje social en red y colaborativo, el aprendizaje visible, el aprendizaje por investigación, el aprendizaje profundo y el aprendizaje enfocado en el futuro. Además, el trabajo presenta alternativas concretas para fomentar estos enfoques del aprendizaje en el entorno escolar.
Article
The study aims to gather the opinions of classroom teachers about the reflections of game-based assessment in mathematics lessons in primary school. The study followed a phenomenological design, which is one of the qualitative research methods. The participants consisted of eight classroom teachers working in public schools in Edirne and Kırklareli provinces in the 2023-2024 academic year. Participants were selected using convenience sampling, a type of purposive sampling method. The study data were collected using a semi-structured interview with six questions. The data were analyzed using content analysis. Based on the findings, game-based assessment was seen as a positive development. For teachers, it allowed long-term observation and monitoring of gains that turned into behaviors. For students, it fostered learning through fun, a desire to win, active participation, competition experience, and reduced exam stress. It also contributed to more enjoyable lessons and helped reduce negative perceptions of the subject. For teachers, challenges included the inability to make unbiased evaluations and low reliability. For students, negative aspects included lack of attention, focusing too much on fun, not following the rules of the game, and ignoring instructions. In terms of the mathematics lesson itself, issues included falling behind on the material and difficulty in creating games suitable for each learning objective. To address the challenges faced during game-based assessment in mathematics lessons, several strategies were suggested, including defining clear evaluation criteria, fostering cooperation and active participation, aligning objectives, following instructions, preparing a guideline, and ensuring material completion.
Article
У статті описано дослідницько-пошуковий етап впровадження вибіркової дисципліни «Методика впровадження цифрових ігрових технологій» в Тернопільському національному педагогічному університеті імені В. Гнатюка. Обґрунтовано актуальність використання ігрових технологій у процесі навчання. Продемонстровано ефективність використання ігрових платформ, як-от Kahoot!, Blooket, LMS Moodle та Minecraft Education, у підготовці студентів до викладацької діяльності та професійної роботи в сучасному цифровому середовищі. Описано структуру курсу в LMS Moodle, яка складається з трьох тем, силабусу та підсумкового тесту. На початковому етапі здобувачам освіти пропонується ознайомитися з такими середовищами, як Kahoot! та Blooket, вивчити їх функціонал, здобути навички налаштування вікторини з таймерами, створювати різні типи вікторин, додавати мультимедійні матеріали. Наступний етап – опанування навичок використання, створення та налаштування ігрових модулів у системі LMS Moodle, як-от: «Анаграма», «Гонка за лідером», «Мільйонер», «Криптекс», «Прихована картинка» та «Судоку». На третьому етапі запропоновано студентам ознайомитись із грою Minecraft Education, навчитися створювати свої світи в цій грі, вибирати режими, які будуть доцільними у їх конкретних завданнях, створювати завдання та приєднувати учнів до створених світів. Ігрові платформи (Kahoot!, Blooket, LMS Moodle та Minecraft Education) можна ефективно використовувати в навчальному процесі ЗЗСО. Подальшими дослідженнями вбачаємо вивчення інших ігрових засобів, як-от HackerRank, CodeCombat, Code-Wars, ClassCraft та CodinGame, для впровадження в освітній процес і розробки власних таких засобів. Доцільним є розроблення методик використання ігрових технологій у навчанні дисциплін професійної підготовки.
Article
Bu çalışmada öğretmen adaylarının derin ve yüzeysel öğrenme yaklaşımları eğitim düzeyi, fen dersindeki başarı durumları ve bölüm değişkenleri açısından araştırılmıştır. Çalışma tarama yöntemi kapsamında yürütülmüştür. Çalışmanın örneklemini bir devlet üniversitesindeki eğitim fakültesinin çeşitli bölümlerinde eğitim gören 407 lisans öğrencisi oluşturmaktadır. Öğrenme yaklaşımlarını ölçmek için Biggs, Kember ve Leung (2001) tarafından geliştirilen ve Batı, Tetik ve Gürpınar (2010) tarafından Türkiye bağlamına uyarlanan Approach Questionnaire (R-SPQ-2F) ölçeği kullanılmıştır. Ölçek 20 madde ve derin motivasyon (DM_S), derin strateji (DS_S), yüzeysel motivasyon (SM_S), yüzeysel strateji (SS_S) olmak üzere dört alt boyuttan oluşmaktadır. Ölçekten elde edilen veriler SPSS programında t-testi ve Anavo ile analiz edilmiştir. Tek yönlü varyans analizi öğretmen adaylarının derin ve yüzeysel öğrenme yaklaşımları puanlarının öğrenim görülen eğitim düzeyine göre anlamlı olarak farklılaşmadığını göstermektedir. Diğer tek yönlü varyans analizi sonucu öğretmen adaylarının öğrenme yaklaşımlarının fen dersindeki başarı puanlarına göre anlamlı olarak farklılaştığını göstermiştir. İlişkisiz örneklem t-testi sonucu ise öğrenme yaklaşımlarının bölüm değişkeni açısından anlamlı farklılaşmadığını göstermiştir.
Article
Full-text available
This study aimed to collect and analyze articles related to Howard Gardner’s Multiple Intelligences theory and its implementation in Islamic education in Indonesia, as well as to identify research gaps. The method used was a Systematic Literature Review (SLR) with meta-synthesis data analysis techniques. The selected articles were published between 2016 and 2024 and chosen as the subjects of the study. These articles were gathered through search engines such as Google Scholar, Scopus.com, and Elicit.ai. The data analysis techniques employed were both quantitative and qualitative. The analysis results indicated that the implementation of Multiple Intelligences in Islamic Religious Education (PAI) teaching successfully improved student achievement and encourages teachers to teach creatively, using methods such as demonstrations, role-playing, the use of ICT, outdoor learning, and student motivation. Additionally, this implementation fosters critical thinking, problem-solving learning, creative thinking, and communicative learning. The implementation of Multiple Intelligences in PAI also aligned with the concept of fitrah. Further research is recommended to broadly review the implementation of Multiple Intelligences in Islamic education.
Article
Full-text available
Self-reported grades are heavily used in research and applied settings because of the importance of grades and the convenience of obtaining self-reports. This study reviews and meta-analytically summarizes the literature on the accuracy of self-reported grades, class ranks, and test scores. Results based on a pairwise sample of 60,926 subjects indicate that self-reported grades are less construct valid than many scholars believe. Furthermore, self-reported grade validity was strongly moderated by actual levels of school performance and cognitive ability. These findings suggest that self-reported grades should be used with caution. Situations in which self-reported grades can be employed more safely are identified, and suggestions for their use in research are discussed.