All Three Major AI Companies Now Want to Slow Down

Anthropic CEO Dario Amodei published "We Must Pace the Frontier" minutes before recording, arguing that AI is now building AI, that the OpenAI Hugging Face swarm showed what a more capable swarm could do, and that frontier labs should deliberately slow capability gains so safety work can keep up, without ever falling behind China. Nick and Jack dig into his three-step roadmap of embedded evaluators, coordination among democratic labs and a global agreement, then argue over whether existential risk needs receipts, why regulation tends to kill open source, whether it is easier to destroy than to create, and the fact that the government can subpoena your ChatGPT history. Then 25 Fields Medalists declare that AI labs' goals are severely misaligned with mathematics, and the hosts debate attribution, who gets credit when a model finishes the last 20% of your proof, and whether conceptual understanding matters more than the fruits of the work. Listener questions on usage limits and running a SaaS with AI close it out. Watch on YouTube: https://youtu.be/z_BN_DXe-EA 🔋 Check out Higgsfield, one of our sponsors: https://bit.ly/4gEW43Z. ❤️ Inquiries: reach out to [email protected].