How This Agentic Memory Research Unifies Long Term and Short Term Memory for LLM Agents

Agentic Memory: Unifying Long Term and Short Term Memory

Researchers from Alibaba Group and Wuhan University introduced Agentic Memory (AgeMem), a framework enabling LLM agents to learn to manage both long-term and short-term memory as a unified policy. This approach eliminates the need for hand-tuned heuristics or external controllers, allowing the agent to autonomously decide what to store, retrieve, summarize, and discard.

Most current agent frameworks treat long-term and short-term memory as separate systems, leading to inefficiencies and brittle heuristics for interaction; this separation can result in increased costs and system complexity, especially when dealing with complex tasks requiring long-horizon reasoning.

Key Insights

• AgeMem Framework, 2026: Introduces a system where memory operations are exposed as tools within the agent’s action space.
• Reinforcement Learning for Memory: Demonstrates the effectiveness of training long-term and short-term memory behavior jointly using a three-stage reinforcement learning approach.
• Performance Gains: AgeMem consistently outperforms existing memory baselines (LangMem, A Mem, Mem0) on benchmarks like ALFWorld, SciWorld, BabyAI, PDDL tasks, and HotpotQA, achieving up to a 21.7% improvement on SciWorld.

Working Example

# Example tool call format within the agent's action space
tool_call = {
    "tool": "ADD",
    "content": "The capital of France is Paris.",
    "metadata": {"source": "Wikipedia", "date": "2026-01-12"}
}

# Example of a retrieval call
retrieval_call = {
    "tool": "RETRIEVE",
    "query": "capital of France"
}

Practical Applications

• Customer Service Bots: An agent utilizing AgeMem could learn to retain customer preferences (long-term memory) while dynamically adjusting responses based on the current conversation (short-term memory).
• Pitfall: Relying solely on long-term memory without effective short-term context filtering can lead to irrelevant information being retrieved, degrading performance and increasing computational cost.

References:

• https://www.marktechpost.com/2026/01/12/how-this-agentic-memory-research-unifies-long-term-and-short-term-memory-for-llm-agents/