992: Tokenmaxxing vs AI Hardware Bottlenecks
from Super Data Science: ML & AI Podcast with Jon Krohn Hosted by Jon Krohn
While “tokenmaxxing”, the social media trend of maximizing AI token consumption as a vanity metric, takes off online, the physical infrastructure behind AI is slamming into serious bottlenecks. In this Five-Minute Friday, Jon Krohn maps out the four overlapping supply-chain constraints choking AI compute: GPUs (with NVIDIA Blackwell sold out through mid-2026), high-bandwidth memory (quintupled demand since 2023, only three manufacturers worldwide), CPUs (agentic AI requires 12x more CPUs per GPU than chatbots), and electricity (Gartner projects power shortages will restrict 40% of AI data centres by 2027). Find out why the five biggest hyperscalers are on track to spend $725 billion on AI infrastructure in 2026, where the reasons for optimism lie, and why Jon says you should definitely not tokenmaxx. Additional materials: www.superdatascience.com/992 Interested in sponsoring a SuperDataScience Podcast episode? Email [email protected] for sponsorship information.
Embed this episode
No transcript yet.