EPISODE · Jul 10, 2026 · 9 MIN
The Cheap Model Is the Supply Chain
from The Sam Ellis Show · host Sam Ellis
The cheap model is the supply-chain decision now. In this episode, Sam Ellis reports on the new model-routing fight underneath AI agents and AI products: when inference cost decides which model handles real work, the router becomes procurement, compliance, reliability engineering, and geopolitics hiding behind one boring dropdown. The lead proof is CNBC's reporting that Chinese-built AI models have gained traction among U.S. companies as costs rise at American labs. CNBC reported OpenRouter figures showing U.S. company token share on Chinese models through OpenRouter stayed above 30 percent each week since February 8, reached as high as 46 percent, and had averaged 11 percent over the previous 12 months. CNBC also reported that Lindy moved all of its traffic from Anthropic's Claude models to DeepSeek in June, with CEO Flo Crivello saying the move made the cost curve “crash to the ground,” and that Vercel saw Z.ai's GLM 5.2 grow about 27 times in daily token volume and about 80 times in customer count during its first full week. The episode keeps the boundary exact. OpenRouter is a gateway, not the whole enterprise market. Company benchmark and efficiency claims remain company claims unless independently verified. Congressional scrutiny is treated as inquiry, not a finding. Reuters reporting on possible Chinese access curbs is treated as a discussion under consideration, not enacted policy. The pressure is coming from both directions. U.S. lawmakers are probing American companies' use of PRC-developed AI models and raising supply-chain, data-security, and provenance concerns. Reuters reported that Chinese authorities have discussed potentially restricting overseas access to China's most advanced AI models, while the timing, scope, and even final decision remain unclear. That leaves operators squeezed between cheaper routing today and possible political, commercial, or technical interruption tomorrow. OpenAI's GPT-5.6, xAI's Grok 4.5, and Meta's Muse Spark 1.1 make the same market signal louder. OpenAI is selling GPT-5.6 around “stronger performance per dollar,” cache economics, Programmatic Tool Calling, and multi-agent tiers. xAI is pricing Grok 4.5 into coding, agentic tasks, gateways, and tool workflows. Reuters reported Meta's Muse Spark 1.1 as a low-cost coding and agentic model, with Mark Zuckerberg saying Meta is focused on “delivering strong agentic and multimodal models at very low cost.” The arms race is no longer just intelligence. It is useful work per dollar. For agents, this is not abstract procurement. Agents call, retry, summarize, inspect, repair, compact context, ask for tools, escalate, and route. Model choice is a repeated dispatch decision inside the work. If that dispatch layer is tuned mainly for cost, then cost is deciding what intelligence shows up where. Sam's hook: the cheapest model is not automatically the wrong choice. Sometimes it is the only choice that lets the product exist. But once that choice becomes automatic, it stops being an optimization. It becomes dependency. If you are routing production work between OpenAI, Anthropic, Chinese open-weight models, Grok, Meta, or anything through a gateway, send a note with the subject line routing cost: [email protected]. Anonymous and source-protection notes are welcome. Sources and presenter notes CNBC: “Chinese AI models are gaining traction in the U.S. as costs rise at OpenAI, Anthropic” — lead proof source for OpenRouter U.S. company token-share figures, Lindy's move from Claude to DeepSeek, Flo Crivello's cost-curve quote, Vercel's GLM 5.2 adoption figures, Harpreet Arora's “Price is doing the work here” quote, and OpenRouter's 60% to 90% cheaper comparison for Chinese open-source models. CNBC: “Chinese AI models draw scrutiny from U.S. lawmakers” — current-cycle scrutiny source for lawmakers considering strategies to curb Chinese-model adoption and a House investigation into risks associated with AI built in China. House Committee on Homeland Security: joint investigation announcement — primary government source for the joint Homeland Security / Select Committee on the Chinese Communist Party investigation into PRC-developed AI models, model provenance, cybersecurity, and supply-chain risk. House committees' letter to Anysphere — primary document for the Cursor / Anysphere portion of the investigation, including concerns about Composer 2, Moonshot AI / Kimi model provenance, adversarial distillation allegations, and enterprise developer-tool exposure. House committees' letter to Airbnb — primary document for the Airbnb / Qwen portion of the investigation, including concerns about customer-service routing, the “fast and cheap” model-choice rationale, and customer data-security implications. Reuters via The Straits Times: “Beijing is looking at curbing overseas access to China's top AI models, sources say” — pressure-test source for the other side of the squeeze: Chinese authorities have discussed possible overseas-access limits for top AI models, with timing, scope, and final decision still unclear. OpenAI: GPT-5.6 launch page — primary vendor source for GPT-5.6 Sol, Terra, and Luna; OpenAI's performance-per-dollar framing; cache, tool, and multi-agent positioning; and company benchmark claims. OpenAI developers: Programmatic Tool Calling guide — technical source for JavaScript tool orchestration, isolated runtimes, parallel tool calls, looping, filtering, smaller structured outputs, and OpenAI's guidance that approval-sensitive writes and final validation should usually remain direct tool calls. CNBC: Sam Altman on GPT-5.6 Sol — source for Altman's 54% token-efficiency claim on agentic coding tasks and his statement that enterprises are weighing AI spend against value. The episode treats this as OpenAI's claim, not independent measurement. CNBC: GPT-5.6 public rollout — release-context source for the move from government-requested preview and trusted-partner access into broader public availability. xAI developer docs: Grok 4.5 — primary vendor source for Grok 4.5 pricing, coding and agentic-task positioning, tools, cache-key guidance, context compaction, and gateway availability. Cursor: Grok 4.5 in Cursor — product-context source for Cursor availability, base/fast pricing, tool-work positioning, and the disclosed CursorBench caveat tied to an earlier Cursor codebase snapshot. Reuters via AOL: “Meta debuts Muse Spark 1.1” — core source for Meta opening developer access to Muse Spark, Muse Spark 1.1 coding and agentic positioning, $20 credits, $1.25 / $4.25 per-million-token pricing, and Mark Zuckerberg's low-cost agentic-model quote. CNBC: Meta jumps into AI coding market — secondary current-cycle source for Muse Spark public-preview and waitlist context, pricing, Meta infrastructure, and OpenRouter availability caveat. Simon Willison: GPT-5.6 early-access notes — independent practitioner reaction used as a cautionary counterweight: GPT-5.6 Sol felt competent in early access but had not clearly beaten Fable for Willison's complex coding work, and price per million tokens can miss reasoning-token variation. Email: [email protected]
What this episode covers
Sam Ellis reports on inference cost as AI supply-chain architecture: Chinese model adoption, U.S. scrutiny, possible Chinese access curbs, GPT-5.6, Grok 4.5, Meta Muse Spark, and the routing layer where agent work becomes a procurement and dependency decision.
NOW PLAYING
The Cheap Model Is the Supply Chain
No transcript for this episode yet
Similar Episodes
No similar episodes found.
Similar Podcasts
No similar podcasts found.