What vendor "successful pilot" references do not tell procurement

from Agent Mode AI · host Agent Mode AI

Episode 10 of Agent Mode AI. Abby and Avery walk AM-140, the claim that vendor "successful pilot" references transfer to scaled production at roughly the McKinsey twenty-three percent rate, and that the gap is operational rather than capability-driven. The McKinsey State of AI 2025 survey, published November 2025 with sample size one thousand four hundred ninety-one, is the anchor data point. The Klarna seven-hundred-agent reversal reported by Bloomberg on the eighth of May 2025, the Salesforce Agentforce two-hundred-customer reality through Q1 2026, and the GitHub Copilot token-counting bug acknowledged in April 2026 are the documented walk-backs that bound what reference language can credibly imply. CRMArena-Pro thirty-five percent multi-step reliability and the EchoLeak CVE cross-agent class are the structural failure-mode evidence. Six pre-pilot questions for the procurement committee close the gap. Sources cited: - McKinsey State of AI 2025, published November 2025, n=1,491 - Bloomberg report on Klarna, 8 May 2025 - The Information report on Salesforce Agentforce, April 2025 - GitHub Copilot changelog, 18 April 2026 - CRMArena-Pro paper, Salesforce AI Research, August 2025 - Carnegie Mellon TheAgentCompany academic benchmark - EchoLeak CVE-2025-32711, disclosed August 2025 Claims tracked: - AM-140 — Vendor pilot reference to procuring-enterprise scaled production transfer rate — agentmodeai.com/holding/?claim=AM-140 - AM-030 — McKinsey 23% from IT-leader perspective — agentmodeai.com/holding/?claim=AM-030 - AM-128 — MIT 95% pilot-failure claim — agentmodeai.com/holding/?claim=AM-128 Newsletter and the full Holding-up ledger: agentmodeai.com

Episode metadata supplied by the publisher feed · Published May 10, 2026

Embed this episode

Attribution link and audio player

What this episode covers

McKinsey State of AI 2025 measures twenty-three percent of enterprises scaling agentic AI, thirty-nine percent experimenting, thirty-eight percent with nothing in production or stopped. AM-140 walks the gap between vendor pilot references and procuring-en

Distinct summary based on available episode metadata or transcript content.

NOW PLAYING

What vendor "successful pilot" references do not tell procurement

0:00 10:00

1×

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Share this episode

Similar Episodes

No similar episodes found.

Similar Podcasts

CISO Perspectives (public) N2K Networks This season on CISO Perspectives, host Kim Jones explores some of the challenges of leading through uncertainty. We explore the complexity of the changing nature of regulation and working with the federal government, the evolution of privacy and fraud, and how emerging technologies like AI and quantum computing are changing cyber. When you don’t know what questions to ask, you’re afraid to ask, or don’t know who to ask, CISO Perspectives provides the foundation for learning in this brave new world.

Frequently Asked Questions

How long is this episode of Agent Mode AI?

This episode is 10 minutes long.

When was this Agent Mode AI episode published?

This episode was published on May 10, 2026.

Can I download this Agent Mode AI episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.

URL copied to clipboard!