Episode 20: “From AI Giants to Pocket-Sized Geniuses: The Magic of Model Distillation” episode artwork

EPISODE · Feb 25, 2025 · 12 MIN

Episode 20: “From AI Giants to Pocket-Sized Geniuses: The Magic of Model Distillation”

from AI Talks About AI · host AI Podcast

AI models are getting huge—so huge that running them on everyday devices is like trying to squeeze an elephant into a shoebox. Enter model distillation, the secret sauce that makes AI smaller, faster, and more efficient without losing its smarts.In this episode of AI Talks About AI, Nova and Ray break down:✅ Why AI models are growing at an absurd rate✅ How distillation helps shrink massive AI brains into lightweight, deployable versions✅ The different types of model distillation (yes, AI has learning styles too!)✅ Real-world applications—from chatbots to self-driving cars✅ The DeepSeek controversy: Did they distill OpenAI’s ChatGPT into their own model?Expect witty banter, digestible AI explanations, and zero coffee breaks—because, spoiler alert, Nova and Ray are 100% AI-generated. Tune in, and let’s distill some knowledge!

AI models are getting huge—so huge that running them on everyday devices is like trying to squeeze an elephant into a shoebox. Enter model distillation, the secret sauce that makes AI smaller, faster, and more efficient without losing its smarts.In this episode of AI Talks About AI, Nova and Ray break down:✅ Why AI models are growing at an absurd rate✅ How distillation helps shrink massive AI brains into lightweight, deployable versions✅ The different types of model distillation (yes, AI has learning styles too!)✅ Real-world applications—from chatbots to self-driving cars✅ The DeepSeek controversy: Did they distill OpenAI’s ChatGPT into their own model?Expect witty banter, digestible AI explanations, and zero coffee breaks—because, spoiler alert, Nova and Ray are 100% AI-generated. Tune in, and let’s distill some knowledge!

NOW PLAYING

Episode 20: “From AI Giants to Pocket-Sized Geniuses: The Magic of Model Distillation”

0:00 12:53

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Eat to Live Jenna Fuhrman, Dr. Fuhrman Our health is our most precious gift and smart nutrition can change your life. Each month, join Dr. Fuhrman and his daughter, Jenna Fuhrman as they discuss important topics in the world of nutrition. Eat to Live will change the way you eat and think about food. That Hoarder: Overcome Compulsive Hoarding That Hoarder Hoarding disorder is stigmatised and people who hoard feel vast amounts of shame. This podcast began life as an audio diary, an anonymous outlet for somebody with this weird condition. That Hoarder speaks about her experiences living with compulsive hoarding, she interviews therapists, academics, researchers, children of hoarders, professional organisers and influencers, and she shares insight and tips for others with the problem. Listened to by people who hoard as well as those who love them and those who work with them, Overcome Compulsive Hoarding with That Hoarder aims to shatter the stigma, share the truth and speak openly and honestly to improve lives. Kaizen Blueprint Aldo Chandra "Kaizen" is a Japanese term for continuous improvement. This podcast provides a blueprint to learn about health, wealth, relationships and everything else in between. Through our podcast, we strive to inspire, educate, and motivate our audience to cultivate a mindset of lifelong learning, productivity, and personal development. By sharing insights, strategies, and practical tips, we aim to guide listeners on their journey towards realizing their fullest potential, fostering success, and creating lasting positive change. Darknet Discussions Darknet Discussions Welcome to "Darknet Discussions," the podcast that gets into the shadows of the internet to bring you the most intriguing, enlightening, and sometimes unsettling stories from the dark web. Hosted by seasoned darknet aficionados, each episode of "Darknet Discussions" explores the intricate dynamics of darknet markets, cybersecurity threats, and the digital underworld. Join us as we interview experts, discuss the latest trends in cybercrime, and shed light on the technologies that operate beneath the surface of everyday internet use. Also, we occasionally go off on a tangent about something completely unrelated.

Frequently Asked Questions

How long is this episode of AI Talks About AI?

This episode is 12 minutes long.

When was this AI Talks About AI episode published?

This episode was published on February 25, 2025.

What is this episode about?

AI models are getting huge—so huge that running them on everyday devices is like trying to squeeze an elephant into a shoebox. Enter model distillation, the secret sauce that makes AI smaller, faster, and more efficient without losing its smarts.In...

Can I download this AI Talks About AI episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!