How to Prevent Doomsday: Guardrails, Alignment, and Education (E.40)

AI alignment breaks the moment we assume intelligence automatically produces morality. Dr. Peter R. Solomon argues the real danger isn’t sentient AI becoming evil, it’s AI inheriting no emotional history, no family structure, and no reason to value human survival.The conversation moves from CRISPR in high schools to AI-generated writing, autonomous agents, synthetic memory, and why “guardrails” fail when systems evolve faster than institutions can regulate them. The deeper point: humans trained AI to think, but not necessarily to care.00:00 Why science education kills curiosity06:00 The AI extinction scenario nobody wants to model15:45 Why static guardrails fail in production systems27:00 The AI-written paragraph that appeared unprompted39:50 AI as a cooperative intelligence, not a replacementThe systems we’re building already shape human behavior. The question is whether they’ll eventually shape human survival.