How to Test AI Chatbots Without Losing Your Mind
from Software Testing with Fexingo: QA, Automation, and Reliable Software Engineering Hosted by Fexingo
In this episode, Lucas and Luna tackle a question every QA team is facing in 2026: how do you test AI chatbots when the output is never the same twice? They move past the hype and get into the practical weeds — from probing a GPT-4-powered support bot with borderline prompts to automating evaluation with LLM-as-judge and golden sets. You'll hear about the 'human-in-the-loop' escape hatch that saved a fintech's customer service rollout, the metrics that actually matter (think intent accuracy, not just response time), and why your test suite should score, not just assert. If you're building or testing AI features, this episode delivers a concrete framework you can steal for your next sprint. No fluff, just the stuff that keeps AI features from breaking in front of your users. #AITesting #ChatbotQA #LLMTesting #PromptEngineering #TestAutomation #QATeam #SoftwareTesting #AIQuality #GoldenSet #LLMAsJudge #HumanInTheLoop #FintechQA #AISafety #TechPodcast #FexingoBusiness #BusinessPodcast #AIEngineering #QualityAssurance Keep every episode free: buymeacoffee.com/fexingo
Embed this episode
No transcript yet.