Letta (MemGPT) vs Alchemyst: OS-Style Memory vs Context Layer
Letta (formerly MemGPT) implements OS-style tiered memory: core (RAM), archival (disk), and recall (history). Alchemyst AI provides context arithmetic over an institutional knowledge graph. Both solve memory for long-running agents, but with fundamentally different architectures.
Last updated: June 2026
What is Letta's OS-inspired memory model?
Letta treats the LLM like an operating system managing its own memory:
- Core memory (RAM): Always in-context, always visible to agent.
- Archival memory (disk): External vector store, agent decides when to retrieve.
- Recall memory: Conversation history, searchable on demand.
The agent actively manages its own memory through function calls—`archival_memory_search`, `core_memory_append`, etc. This is excellent for agents that run for weeks or months without human intervention.
What is Alchemyst's context arithmetic?
Alchemyst AI provides a single API for institutional context:
- Context arithmetic: Set operations (intersect, union, subtract) over meaning at query time.
- Semantic consensus: Prevent ambiguity before it reaches the model.
- Context traces: Every retrieval is fully auditable.
When to choose which architecture?
| Use Case | Alchemyst AI | Letta |
|---|---|---|
| Multi-agent coordination | ✅ Shared context layer | ⚠️ Separate memory per agent |
| Long-running research | ✅ Good | ✅ Excellent |
| Semantic consensus | ✅ Built-in ontology | ⚠️ Agent-managed |
| Model choice | ✅ Any via API/MCP | ✅ Any via endpoints |
| Audit requirements | ✅ Retrieval traces | ⚠️ Function call logs |
Architectural trade-offs
Letta places memory management inside the agent's reasoning loop. The agent decides what to remember, what to archive, and what to recall. This gives agents autonomy but means they must be taught good memory hygiene.
Alchemyst places memory management outside the agent. Context is scoped at write time through explicit APIs. This removes burden from agents but requires deliberate context structuring.
The hybrid approach
Many teams use Letta for long-running research agents (coding, documentation, analysis) and Alchemyst for production workflows requiring semantic consensus and audit trails. Both are open-source, self-hostable, and model-agnostic.
The key is matching architecture to use case: Letta when agents should manage their own memory, Alchemyst when institutional reliability matters more than agent autonomy.