EP344: AI predicts tool calls to skip waiting

Title: SPORK: Self-Speculative Forking to Accelerate Agentic LLM InferenceSource: http://arxiv.org/abs/2607.03333v1Summary:This paper addresses the system-level execution bottleneck of LLM agents by introducing Self-Speculative Forking (SPORK), a training-free controller that enables speculative tool execution. By using the model as its own predictor to dispatch tool calls early and overlap execution with the remaining chain-of-thought decoding, it establishes a foundational efficiency primitive for agentic runtime loops.