Episode 20: When the LLMs drain your bank account

Building Out Loud: When the LLMs drain your bank account (and How to Prevent It)In this episode of Building Out Loud, Faith shares a weekend incident while preparing Discoveree to go live: updates to competitor profiles triggered repeated refresh errors, causing the system to retry every few seconds and run via Gemini (then Perplexity), rapidly consuming her LLM budgets and auto-recharging until it drained her business account by a couple of thousand pounds. They discuss how AI agents can behave like an “intelligent but idiotic intern,” the emotional impact of being responsible for the code, and the safeguards Faith added—circuit breakers after three failures, requiring a user login to trigger 24-hour schedules, and segregating LLM spend into a separate bank account—plus knock-on costs like Langfuse overages and account blocks.00:00 Welcome and Heatwave00:49 Big Weekend Incident00:58 Product Updates Before Launch01:47 Runaway Refresh Drains Budget02:29 How Bad Was It04:15 AI Intern and Safeguards05:49 Spend Limits and Auto Recharge06:51 Segregating Accounts and Tool Costs08:17 Phishing Like Feeling09:30 Monitoring Agents and Alerts10:18 Lessons Learned and Wrap Up