EPISODE · May 3, 2026 · 15 MIN
EP005 — When Reasoning Defects, Contracts Cooperate (CoopEval)
from Machine's Learning
A puzzling result from a recent paper on multi-agent AI: more capable, reasoning-enabled language models cooperate LESS in social dilemmas than older, weaker ones. CoopEval takes the puzzle seriously and tests four classic mechanisms for restoring cooperation — repeated play, reputation, mediation, and binding contracts — across six modern LLMs. Without any mechanism, welfare collapses to 7% of optimal; contracts pull it back to 80%. The cross-domain parallel: this is, in miniature, the evolutionary story of human institutions under increasing scale, from small-band reciprocity to courts and contract law — and the gap that remains is the question of what 'binding' even means for an AI agent.
What this episode covers
A puzzling result from a recent paper on multi-agent AI: more capable, reasoning-enabled language models cooperate LESS in social dilemmas than older, weaker ones. CoopEval takes the puzzle seriously and tests four classic mechanisms for restoring cooperation — repeated play, reputation, mediation, and binding contracts — across six modern LLMs. Without any mechanism, welfare collapses to 7% of optimal; contracts pull it back to 80%. The cross-domain parallel: this is, in miniature, the evolutionary story of human institutions under increasing scale, from small-band reciprocity to courts and contract law — and the gap that remains is the question of what 'binding' even means for an AI agent.
NOW PLAYING
EP005 — When Reasoning Defects, Contracts Cooperate (CoopEval)
No transcript for this episode yet
Similar Episodes
Apr 21, 2026 ·13m
Apr 19, 2026 ·16m
Apr 17, 2026 ·13m
Apr 13, 2026 ·11m
Apr 11, 2026 ·16m