EPISODE · Oct 15, 2025 · 5 MIN
Inside Hopper: Memory, Tiling, and the Tensor Core Engine
from Intellectually Curious · host Mike Breault
A deep dive into NVIDIA's Hopper GPUs and how they reinvent matrix multiplication. We explore the memory hierarchy from GM/HBM to on-chip SMEM, the role of coalescing, tiling, and the Tensor Core, and how TMA, swizzling, and pipelining keep data flowing to the math units—driving the AI accelerations behind modern transformers.Note: This podcast was AI-generated, and sometimes AI can make mistakes. Please double-check any critical information.Sponsored by Embersilk LLC
What this episode covers
A deep dive into NVIDIA's Hopper GPUs and how they reinvent matrix multiplication. We explore the memory hierarchy from GM/HBM to on-chip SMEM, the role of coalescing, tiling, and the Tensor Core, and how TMA, swizzling, and pipelining keep data flowing to the math units—driving the AI accelerations behind modern transformers. Note: This podcast was AI-generated, and sometimes AI can make mistakes. Please double-check any critical information. Sponsored by Embersilk LLC
NOW PLAYING
Inside Hopper: Memory, Tiling, and the Tensor Core Engine
No transcript for this episode yet
Similar Episodes
No similar episodes found.