Position: Modular Memory is the Key to Continual Learning Agents

This paper introduces a framework for modular memory as the essential solution for creating continual learning agents that adapt without forgetting. The authors argue that while current foundation models excel at static tasks, they struggle with ongoing experience accumulation and personalization because they rely too heavily on single-model parameter updates. To solve this, the framework integrates In-Context Learning (ICL) for rapid, short-term adaptation with In-Weight Learning (IWL) for stable, long-term knowledge consolidation. The proposed architecture consists of three distinct components: a core model for general reasoning, a working memory for immediate context, and a long-term memory for persistent storage. Inspired by both human neuroscience and computer architecture, this system allows agents to interact with the world in real-time while refining their core capabilities during internal "consolidation" periods. By separating fast adaptation from slow integration, the researchers aim to overcome the stability-plasticity trade-off that has long hindered artificial intelligence. Ultimately, this approach provides a roadmap for developing self-evolving agents capable of operating in dynamic, open-world environments.