Are Megakernels Dead? Mixture of Kittens Says No

This episode explores why giant fused GPU kernels have become a maintenance and scaling headache for production inference, especially when tensor parallelism forces real communication boundaries. It then pivots to Mixture of Kittens, a new MoE training megakernel that delivered a reported 41% throughput boost and shows why low-level optimization still matters at frontier-lab scale.