EP3: Making Training Fit on GPUs - AI Without Illusions |...

What this episode covers

The podcast will dive straight into the hardcore systems engineering of "Making Training Fit on GPUs," breaking down Data Parallelism, Tensor Parallelism, Pipeline Parallelism, and ZeRO/FSDP Sharding. As requested in your handoff note, it will skip all the basic Transformer and Attention explanations, focusing entirely on practical scenarios and using fun, relatable factory assembly line analogies to keep things engaging.

PodParley-generated summary based on available episode metadata and transcript content.

Share this episode

Similar Episodes

Bringing it all together.

Mar 31, 2026 ·54m

Why is the vendor role so contentious in the cyber ecosystem?

Mar 27, 2026 ·14m

But what do you really want?

Mar 24, 2026 ·42m

Strategic approaches to talent: A practical guide.

Mar 20, 2026 ·42m

Mid season reflection with Kim Jones.

Mar 17, 2026 ·41m

Is the role of the CISO adding to the confusion?

Mar 13, 2026 ·44m

Similar Podcasts

AI Erik's Podcast Audio Erik Conn The AI News Podcast where we talk AI. CISO Perspectives (public) N2K Networks This season on CISO Perspectives, host Kim Jones explores some of the challenges of leading through uncertainty. We explore the complexity of the changing nature of regulation and working with the federal government, the evolution of privacy and fraud, and how emerging technologies like AI and quantum computing are changing cyber. When you don’t know what questions to ask, you’re afraid to ask, or don’t know who to ask, CISO Perspectives provides the foundation for learning in this brave new world. AI Generated - EDU Video Podcast Magnus Lian Explore how video tools and AI are transforming education with Magnus Sæternes Lian, Senior Engineer at NTNU and founder of ReadyMedia. This podcast dives into the latest video technologies, real-world use cases, and actionable insights for educators and tech enthusiasts. Created using cutting-edge AI tools like GoogleLM and ElevenLabs, all content is verified for accuracy. Discover practical solutions and stay ahead in the evolving landscape of educational technology! Chosn Conversations: Beyond the Journal Chosn AI Journal Welcome to Chosn Conversations: Beyond the Journal, where your AI hosts explore the transformative power of conversational journaling and emotional intelligence. Each episode takes you beyond traditional journaling methods, diving deep into voice journaling techniques, mental wellness strategies, and the science behind AI-supported emotional health. We share inspiring user stories, analyze the latest research in digital mental wellness, and provide practical guidance for incorporating journaling into your self-care routine. Whether you're curious about AI therapy alternatives, looking for mental health support tools, or wanting to optimize your journaling practice, our conversations extend beyond the written page into meaningful audio experiences that offer evidence-based insights in an accessible, compassionate format. Join us as we navigate the intersection of technology and mental well-being, helping you track your emotional journey and build lasting resilience through the power of

Frequently Asked Questions

How long is this episode of AI Without Illusions?

This episode is 51 minutes long.

When was this AI Without Illusions episode published?

This episode was published on June 11, 2026.

What is this episode about?

The podcast will dive straight into the hardcore systems engineering of "Making Training Fit on GPUs," breaking down Data Parallelism, Tensor Parallelism, Pipeline Parallelism, and ZeRO/FSDP Sharding. As requested in your handoff note, it will skip...

Can I download this AI Without Illusions episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.