Why AI apps need a real memory layer
June 7, 2026·6 min read·The Nubase team
Most “AI memory” is a prompt-stuffing trick: cram recent messages into the context window and hope. That breaks the moment a conversation ends, a session rotates, or a user comes back next week.
Memory is a backend primitive, not a prompt
Durable memory means turning conversation into structured, retrievable knowledge: extract the facts, resolve entities, store history, and recall the right thing at the right time — across sessions and devices.
How Nubase models it
- Extraction: an LLM decides to ADD, UPDATE, DELETE or do NOTHING with each fact.
- Entity store: facts link to people, places and things for better recall.
- Hybrid retrieval: pgvector cosine similarity + Postgres full-text + entity boost.
- Append-only history: every change is auditable and reversible.
A single API call
POST /mem/v1/memories
{ "userId": "user-42", "messages": [ ... ] }The result is extracted, embedded and searchable forever — owned by you, on your own infrastructure.