EP144: [Evo-Memory] Building AI agents with self-evolving memory.

The paper, titled "Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memory," introduces a comprehensive framework and benchmark designed to move Large Language Model (LLM) memory beyond static factual recall toward continual experience reuse.The authors argue that existing LLM memory systems are largely passive, meaning they can remember what was said but fail to learn from interactions to improve future decision-making. Current benchmarks often overlook this "test-time evolution," where an agent should refine its strategies as it encounters a continuous stream of tasks.Evo-Memory Benchmark: A unified streaming benchmark that restructures static datasets into sequential task streams. It evaluates agents across 10 diverse datasets, including single-turn reasoning (mathematics, QA, tool use) and multi-turn goal-oriented tasks (embodied agents, navigation).Unified Formulation: The paper formalizes a general memory-augmented agent through a cycle of search, synthesis, and evolution, providing a standard way to evaluate how memory is retrieved, integrated, and updated.New Methodologies: ExpRAG: A task-level retrieval-augmented baseline for reusing prior experiences. ReMem: An advanced framework that unifies reasoning, action, and memory refinement in a single decision loop, allowing agents to actively prune and reorganize their memory during problem-solvingSignificant FindingsThe research demonstrates that self-evolving memory architectures provide consistent performance gains, especially in complex multi-turn interactive environments. Notably, these methods help smaller models close the capability gap, suggesting that test-time refinement is a practical path to enhancing lighter LLMs. Additionally, evolving-memory agents like ReMem were found to be more step-efficient, requiring fewer actions to complete goals by building on past successes and failures.