Skip to content
71. Visible Learning by John Hattie episode artwork

Jan 1, 2019 21 min

71. Visible Learning by John Hattie

from Education Bookcast

John Hattie is an education researcher from New Zealand with a very ambitious goal: to synthesise the myriad quantitative research studies on education in a single publication. The number of articles affecting his book Visible Learning numbers in the region of 80 thousand (!). The results of his analysis have been hailed as the "Holy Grail" of education by such prestigious authorities as the Times Education Supplement. So, how did he and his team do it? Hattie uses an approach known as meta-analysis. Meta-analyses take numerous research articles trying to measure an effect and compare them in order to ultimately determine the size of the effect. They are common in medicine, where they are often used to elucidate whether a drug is truly effective or not, as a single study may incorrectly show a drug to be effective simply by chance. However, Hattie goes one step further and carries out a meta-analysis on other meta-analyses, forming a sort of "meta-meta-analysis". With this approach, his team only directly work with 400 articles, as each of these is a meta-analysis of tens or hundreds of other articles, which is how we reach the gargantuan number 80 thousand. You would have thought that such an ambitious, influential, and widely praised work would have come under much careful scrutiny. And you would have thought that since it is so statistical, numerous other researchers in the field of education would have performed at least a surface-level plausibility check. However, you may be disappointed. It took two years for anybody to even begin to notice the glaring statistical errors behind this work, and even when they were noticed, Hattie's team didn't treat them with the gravity they deserved. Methodological criticism gradually increased in number, and by now it is clear that the "Holy Grail" has numerous leaky holes. In this episode, after introducing Visible Learning, I go on to take some highlights from one such criticism, entitled How to engage in pseudoscience with real data: A criticism of John Hattie's arguments in Visible Learning from the perspective of a statistician, written by Canadian statistician Pierre-Jerome Bergeron. I aim to explain the most accessible points, and leave the more complex parts of the article for those with the interest and mathematical acumen to look up. This sort of thing seems to happen a lot in education. It's one of the reasons why it's so hard to figure out how things work and what's actually true in the field. At least I can warn people about the problems with this still widely cited work. Enjoy the episode.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

71. Visible Learning by John Hattie

0:00 21:10

No transcript yet.

Requests help us decide what to transcribe next.

AnointedEDU Jermaine Whiteside The AnointedEDU Podcast explores the intersection of research, leadership, governance, education, artificial intelligence, and institutional innovation. Hosted by Jermaine E. Whiteside, doctoral researcher and founder of AnointedEDU, each episode translates scholarly research into practical insights for educators, ministry leaders, nonprofit executives, public-sector professionals, and organizational decision-makers. Through conference presentations, research conversations, working papers, NotebookLM discussions, and executive education, the podcast examines governance science, adaptive leadership, Faithful Intelligence, AI ethics, implementation science, institutional trust, organizational resilience, and evidence-based leadership. Whether you are leading a church, nonprofit, educational institution, business, or government organization, The AnointedEDU Podcast provides research-informed ideas designed to help leaders build resilient, ethical, Texas Hemp Coalition Podcast Texas Hemp Coalition Welcome to the Texas Hemp Coalition Podcast! This is a place where we will hear from industry experts dealing with advocacy, education and networking in the Texas hemp industry. Join the Texas Hemp Coalition at www.texashempcoalition.org. The Graduate Ishan Singh The Graduate is a college preparation podcast that is passionately committed to assisting all students, with a special focus on those from minority backgrounds, in their journey towards securing spots in the nation’s top universities. This podcast delves into not only the academic aspects of college life but also uncovers the vibrant social dynamics within it. The primary mission of The Graduate is to serve as a mentor to students, offering valuable insights on navigating the challenges of college life. The podcast covers a wide array of topics, ranging from practical guidance on tasks such as filling out the FAFSA application to interviewing students hailing from diverse colleges and discussing campus-specific topics like the best coffee spots to explore. The Graduate is dedicated to helping students realize their dreams and nurture their interests, ultimately equipping them to pursue their true callings in higher education. This podcast is a valuable resource for any student looking

Frequently asked questions

How long is this episode of Education Bookcast?

This episode is 21 minutes long.

When was this Education Bookcast episode published?

This episode was published on January 1, 2019.

Can I download this Education Bookcast episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.