Recursive LM - model solves context rot
An episode of the Build Wiz AI Show podcast, hosted by Build Wiz AI, titled "Recursive LM - model solves context rot" was published on January 19, 2026 and runs 14 minutes.
January 19, 2026 ·14m · Build Wiz AI Show
Summary
This episode explores Recursive Language Models (RLMs), a groundbreaking inference strategy that enables large language models to process prompts two orders of magnitude beyond their standard context windows. We discuss how RLMs treat long inputs as part of an external environment, using a Python REPL to programmatically decompose data and recursively call the model over specific snippets. Learn how this approach effectively overcomes "context rot" to significantly outperform base models and existing scaffolds on complex, information-dense tasks.
Episode Description
This episode explores Recursive Language Models (RLMs), a groundbreaking inference strategy that enables large language models to process prompts two orders of magnitude beyond their standard context windows. We discuss how RLMs treat long inputs as part of an external environment, using a Python REPL to programmatically decompose data and recursively call the model over specific snippets. Learn how this approach effectively overcomes "context rot" to significantly outperform base models and existing scaffolds on complex, information-dense tasks.
Similar Episodes
Dec 4, 2025 ·37m
Dec 8, 2023 ·25m
Dec 1, 2023 ·24m
Nov 25, 2023 ·25m
Nov 24, 2023 ·22m