Episode 70!!! NPUs!!!!!!!!

With Special guests, Austin Lyons and Paul Karazuba! The conversation covers the topic of NPUs (Neural Processing Units) and delves into their architecture, performance, and relevance in the semiconductor industry. The discussion also addresses the use of tops per watt as a metric for NPU performance and the design origins of NPUs, including the use of licensed IP and the evolution from DSPs to NPUs. The conversation delves into the topic of NPUs (Neural Processing Units) and their integration into various devices. The speakers discuss the origins of NPUs, their design philosophy, and the potential impact on consumer devices. They also explore the role of NPUs in edge devices, AI PCs, and the future of consumer use cases for AI. The conversation concludes with predictions about the widespread adoption of NPUs and their potential impact on the market.