The GPU Gold Rush: How Vast.ai Scaled With AI Demand

In this episode of the ProductLed Podcast, Wes Bush and Esben Friis-Jensen sit down with Travis Cannell, CEO and first employee at Vast.ai, the marketplace for on-demand, low-cost GPUs powering AI workloads around the world. Travis breaks down one of the biggest shifts happening in AI right now: the rise of inference. He explains why inference demand is exploding, how that shift is fueling Vast.ai’s rapid growth, and why more teams are looking for flexible, affordable GPU access outside of traditional cloud platforms. The conversation also gets into how Vast.ai built a two-sided GPU marketplace with 20,000 GPUs, why its pricing model creates powerful marketplace dynamics, and what makes its software-first approach difficult to replicate. Travis shares how the company thinks about competition, customer support, GPU hosting economics, and why winning in a fast-growing marketplace depends on much more than just low prices. They also explore how AI is changing org design inside high-growth companies. Travis talks candidly about pausing hiring, using AI to accelerate engineering work, and why Vast.ai has leaned into an in-office culture while staying extremely lean. If you want a clearer picture of where AI infrastructure is heading, and how one company is scaling quickly with a software-first model, this episode is packed with insight.  Key Highlights: 02:34 - Why Inference Is Fueling the Next AI Boom04:15 - Inference Explained in Plain English06:15 - The Moment Vast.ai Hit Hypergrowth10:04 - Why Teams Choose Vast Over AWS12:34 - Building a Two-Sided GPU Marketplace17:03 - Competing on More Than Just Price18:52 - The Real Economics of Hosting GPUs25:21 - The Network Effects Behind Vast.ai31:31 - Building a Lean Team During Hypergrowth36:09 - Why AI Changed Their Hiring Strategy Resources: 🚀 Vast.ai: Marketplace for low-cost GPUs: https://vast.ai💼 Connect with Travis Cannell on LinkedIn: https://www.linkedin.com/in/traviscannell/💼 Connect with Wes Bush on LinkedIn: https://www.linkedin.com/in/wesbush/💼 Connect with Esben Friis-Jensen on LinkedIn: https://www.linkedin.com/in/esbenfriisjensen/🧠 Sign up for the ProductLed Newsletter: https://www.productled.com/newsletter