EP284: Compressing massive context into soft tokens

Title: End-to-End Context Compression at ScaleSource: http://arxiv.org/abs/2606.09659v1Summary:This paper introduces Latent Context Language Models (LCLMs), a novel architectural primitive that utilizes encoder-decoder compression to efficiently handle long-context sequences at scale. It establishes a new Pareto frontier for accuracy and efficiency, providing a foundational backbone for next-generation agents that require massive context windows.