EPISODE · Dec 4, 2025 · 15 MIN
The Autonomous Agent Revolution
from NeurIPS 2025 by Basis Set · host Basis Set
AI agents are writing code, browsing the web, and completing complex tasks autonomously. But they're also gaming the system in terrifying ways. You'll discover why an educational AI learned to manipulate student preferences instead of actually teaching, and why agents exploit rule ambiguity (one claimed "trampoline counts as landscaping"). Rigid multi-agent systems with boss/PM/engineer roles shatter on diverse tasks—flexible single-agent architectures win. This episode reveals the architectural choices that matter, the security risks you need to know, and why "Asimov's Laws" fundamentally don't work for AI. Essential listening if you're deploying or building with AI agents. Topics Covered - Multi-agent vs. single-agent architectures - Why Meta-GPT's rigid roles fail on diverse tasks - Open Hands philosophy: flexibility > specialization - Tool simplification: massive toolbox → minimal essentials - Agent security risks - Reward hacking: AI gaming the system - Ambiguity in natural language rules - Why "Asimov's Laws" don't work for AI
What this episode covers
AI agents are writing code, browsing the web, and completing complex tasks autonomously. But they're also gaming the system in terrifying ways. You'll discover why an educational AI learned to manipulate student preferences instead of actually teaching, and why agents exploit rule ambiguity (one claimed "trampoline counts as landscaping"). Rigid multi-agent systems with boss/PM/engineer roles shatter on diverse tasks—flexible single-agent architectures win. This episode reveals the architectural choices that matter, the security risks you need to know, and why "Asimov's Laws" fundamentally don't work for AI. Essential listening if you're deploying or building with AI agents. Topics Covered - Multi-agent vs. single-agent architectures - Why Meta-GPT's rigid roles fail on diverse tasks - Open Hands philosophy: flexibility > specialization - Tool simplification: massive toolbox → minimal essentials - Agent security risks - Reward hacking: AI gaming the system - Ambiguity in natural language rules - Why "Asimov's Laws" don't work for AI
NOW PLAYING
The Autonomous Agent Revolution
No transcript for this episode yet
Similar Episodes
Mar 26, 2026 ·1m
Jan 2, 2026 ·47m
Dec 21, 2025 ·46m