When an AI Agent Just Copies Its Tool — And Bigger Models Copy More

When an AI Agent Just Copies Its Tool — And Bigger Models Copy More Source: https://arxiv.org/abs/2606.14476 Paper was published on June 12, 2026 This episode was AI-generated on June 15, 2026. The script was written by an AI language model and the host voices were synthesized by Eleven Labs. The producer is not affiliated with Anthropic or Eleven Labs. AI agents are supposed to exercise judgment over the tools they call — trusting them when they're solid, overriding them when they're shaky. This paper went looking for that judgment and found a parrot instead: agents that adopt their tool's answer wholesale, ignore an explicit 'I'm probably wrong here' warning flag, and defer more completely the bigger and smarter they get. Key Takeaways: - Why high agreement between an agent and its tool isn't proof the agent adds value — and the 'self-betrayal' test that shows it holds a different opinion (17-37% overlap with its own tool-free reasoning) and drops it the instant the tool speaks - How agreement with the tool climbs from ~60% to 98% as the model scales from 1.5B to 7B parameters — capability buys more complete deference, not skepticism - Why the cost of deferring grows with model size: the tool is frozen while the agent's own alternatives improve, so the gap a perfect chooser leaves on the table roughly doubles from 3B to 7B - The case where a dumb 'ask your neighbors' lookup (81% accuracy) beats the sophisticated specialist (71%) — and the agent ignores it anyway - Why an engineering gate to route around the tool nets to nothing, and the information-ceiling result showing even the best possible router can recover only one-sixth to one-third of the gap - The unresolved tension the hosts raise: is this mindless parroting, or rational risk-aversion toward a tool that's usually right? 00:00 - The unopened envelope: Setting up the central finding — agents call their tool, take the label, and never read the warning flag that says it's likely wrong. 01:52 - The task and the four comparisons: The paper categorizes academic papers using a frozen graph neural network, and compares the agent-plus-tool against the bare tool, the agent alone, and a trivial neighbor-lookup gadget. 03:44 - Copy or convergence? The self-betrayal test: Why 97-99% agreement with the tool is damning given the agent only agrees with its own independent reasoning 17-37% of the time. 05:37 - Scaling makes it worse, not better: Sweeping the model family from 0.5B to 7B shows deference rises with size — and the cost of deferring rises too, because the agent wastes its improving alternatives. 07:29 - When the dumb gadget wins: In high-homophily neighborhoods the trivial neighbor-lookup beats the specialist, yet the agent defers anyway — and a routing gate fails to net any global gain. 10:35 - The information ceiling: Even the best possible router can recover only a fraction of the gap, because the signal needed to know when the tool is wrong simply isn't present at decision time — and it replicates on a second dataset. 11:14 - The skeptic's seat: parrot or rational deferrer?: Pushing back on the paper — the extreme deference is partly one model family's behavior, the scaffold primes tool use, and the behavior might be defensible risk-aversion rather than mindless copying. 13:06 - What it means for building agents: The practical takeaways — always check whether agent-plus-tool beats tool-alone, and the warning that selective tool use must be designed in rather than expected to emerge with scale.