Skip to content
Evals-Driven Development: Your Test Suite Is the Moat episode artwork

Oct 13, 2026 20 min

Evals-Driven Development: Your Test Suite Is the Moat

from Frontier AI Architect Hosted by Amar

One instruction in a system prompt measurably degraded a coding product at the company that built the model. This episode explains how to build the test suite that catches that kind of change, and why that suite is the asset competitors cannot copy. In this episode: - What three public postmortems from Anthropic and OpenAI have in common - The four layers: code checks, a calibrated judge, a regression suite, a gate on every change - Why a model judge has to be measured before it is trusted - How a suite turns a forced model migration from weeks into days - The honest caveat: every one of those incidents passed the evals that existed Read the full article with all sources: https://frontieraiarchitect.substack.com/p/evals-driven-development-your-test?utm_source=share&utm_medium=android&r=978zej Frontier AI Architect is written by David Amar. LinkedIn: https://www.linkedin.com/in/david-amar-575192441 Newsletter: https://frontieraiarchitect.substack.com Contact: [email protected] This episode's audio is AI-generated, based on an article written by David Amar.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Evals-Driven Development: Your Test Suite Is the Moat

0:00 20:43

No transcript yet.

Requests help us decide what to transcribe next.

Share this episode

Similar podcasts

CISO Perspectives (public) N2K Networks This season on CISO Perspectives, host Kim Jones explores some of the challenges of leading through uncertainty. We explore the complexity of the changing nature of regulation and working with the federal government, the evolution of privacy and fraud, and how emerging technologies like AI and quantum computing are changing cyber. When you don’t know what questions to ask, you’re afraid to ask, or don’t know who to ask, CISO Perspectives provides the foundation for learning in this brave new world.

Frequently asked questions

How long is this episode of Frontier AI Architect?

This episode is 20 minutes long.

When was this Frontier AI Architect episode published?

This episode was published on October 13, 2026.

Can I download this Frontier AI Architect episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.