AI Testing: How to Ensure Quality in Non-Deterministic Systems with Adam Sandman episode artwork

EPISODE · Mar 10, 2026 · 43 MIN

AI Testing: How to Ensure Quality in Non-Deterministic Systems with Adam Sandman

from TestGuild Automation Podcast · host Joe Colantonio | TestGuild

How do you ensure software quality when the system you're testing doesn't give the same output twice? Go to https://links.testguild.com/inflectra and start your free 30-day trial, no credit card, no contract required. That's the core challenge facing every QA team building or testing AI-powered applications today and it's breaking all the rules we've relied on for decades. In this episode of the TestGuild Automation Podcast, I sit down with Adam Sandman, co-founder of Inflectra, to get into what non-deterministic AI testing actually means in practice, why traditional pass/fail testing no longer cuts it, and what quality professionals need to do differently right now. We cover: Why AI-generated code is raising the stakes for QA teams while budgets stay flat The fundamental difference between deterministic and non-deterministic systems — and why it changes everything about how you test How to set acceptable risk thresholds for AI systems (hint: it depends on whether you're building an e-commerce chatbot or an air traffic control system) Why testers who embrace AI as a tool — not a threat — will be the ones leading their organizations forward How a live demo failure at a conference inspired Inflectra's new non-deterministic testing tool, SureWire If you're a tester, QA manager, or automation engineer trying to figure out how to keep up with AI-driven development without losing your mind — or your job — this one's for you.

Episode metadata supplied by the publisher feed · Published Mar 10, 2026

Embed this episode

Ready to play

AI Testing: How to Ensure Quality in Non-Deterministic Systems with Adam Sandman

0:00 43:20

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

No similar episodes found.

No similar podcasts found.

Frequently Asked Questions

How long is this episode of TestGuild Automation Podcast?

This episode is 43 minutes long.

When was this TestGuild Automation Podcast episode published?

This episode was published on March 10, 2026.

Can I download this TestGuild Automation Podcast episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.
URL copied to clipboard!