Skip to content
Google Agentic Architect - Subconcept 5.1: Pre-Production Continuous Evaluation Gates (CI/CD) episode artwork

Aug 31, 2026 42 min

Google Agentic Architect - Subconcept 5.1: Pre-Production Continuous Evaluation Gates (CI/CD)

from AI Intuition Hosted by Dan Sarmiento

Detail how to construct automated pre-production evaluation pipelines for non-deterministic agents. Walk through building an evaluation harness (e.g., tests/eval_agent_trajectory.py using pytest and Cloud Build) executed against static "golden datasets." Contrast three evaluation types: Pointwise (single-turn metric checks), Pairwise (using gemini-2.5-pro as a Model-as-a-Judge), and Trajectory Evaluation (auditing tool invocation sequences using graph edit distance). Focus on the exact mathematical thresholds required to block releases in CI/CD: tool_call_accuracy >= 0.95, trajectory_match_score >= 0.90, and groundedness_score >= 0.90.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Google Agentic Architect - Subconcept 5.1: Pre-Production Continuous Evaluation Gates (CI/CD)

0:00 42:47

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of AI Intuition?

This episode is 42 minutes long.

When was this AI Intuition episode published?

This episode was published on August 31, 2026.

Can I download this AI Intuition episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.