mrkeyoor.com_
Sat 05 Sept 14:43 UTC
LLM Toolsevaluationupdated 05 Sept 2026

supermemory review

Supermemory stores facts and documents for AI applications, then retrieves relevant history and maintains a changing user profile across conversations. Developers can use its hosted API, connect AI clients through MCP, or run a smaller single-machine server with their own language model.

trackingstars / 7d
Verdict

Our bun install pulled 3,015 packages and used 3,212 MB, then the 98-second build failed because its postbuild required a Sentry auth token. Supermemory is a sensible trial for an agent product that needs profiles plus document retrieval, especially if the hosted connectors remove work you already planned to do. Self-hosters should treat v0.0.8 as young infrastructure: pin the binary, fix the data path, back it up, and test memory recovery before trusting it with user history.

We ran it

Lab card: what happened when we ran supermemoryScreenshot of supermemory (supermemory.ai/docs)
Install✓ · 75s3015 packages · 3212 MB
Build✗ · 98s
Testsn/ano test script
Repo1192 files~140,914 lines of source · 119.1 MB · 12 CI workflows

Answers from our run

Does supermemory build from source?

Dependencies installed in 75 seconds (3015 packages), and the build failed. We cloned commit 4d8a4eb into a clean Debian container with 3 CPUs and no project-specific setup.

Does supermemory have tests you can run?

Not through a standard command: the project exposes no test script or target that our harness could run.

Who should not use supermemory?

Contributors who need a credential-free root build: our run finished all 8 Turbo tasks, then failed when the automatic postbuild tried to create a Sentry release without an auth token.

What are the alternatives to supermemory?

Mem0, Graphiti, Letta. Our bun install pulled 3,015 packages and used 3,212 MB, then the 98-second build failed because its postbuild required a Sentry auth token.

Setup2/53,212 MB install; root build fails without a Sentry token
Docs4/5Hosted and local boundaries, providers, storage, and upgrades are clear
Community4/529,233 stars with 39 open issues and 73 open pull requests
Maturity3/5Active project, but local server 0.0.8 repaired an upgrade failure

Who it’s for

Agent developers who need persistent user facts alongside document search.
Teams that want hosted connectors for Gmail, Google Drive, Notion, OneDrive, or GitHub.
Individual developers willing to run a single-machine memory service with their own model provider.
MCP and Claude Code users who want memory shared across supported AI clients.

Who it’s NOT for

Contributors who need a credential-free root build: our run finished all 8 Turbo tasks, then failed when the automatic postbuild tried to create a Sentry release without an auth token.
Self-hosters expecting the hosted feature set: the local-vs-Enterprise guide reserves managed MCP, connectors, team roles, scoped keys, and the control dashboard for the platform.
Offline users without a suitable local language model: local embeddings need no key, but memory extraction still requires a model through Ollama or another supported endpoint.
Operators unwilling to pin releases and back up state before upgrades: server v0.0.8 is an emergency repair for stores whose vectors were removed during a 0.0.7 release-candidate upgrade path.
Services that can start from arbitrary working directories without fixed storage configuration: the default is ./.supermemory, and open issue 1420 reports new empty stores when the launch directory changes.

Setup reality

Our bun install succeeded in 75 seconds, adding 3,015 packages and using 3,212 MB. The build failed with exit 1 after 98 seconds. Turbo reported all 8 tasks successful, then postbuild ran a Sentry sourcemap command that stopped because an auth token was required. No test target existed, so tests were skipped.

The local server still needs one LLM provider key or an OpenAI-compatible local endpoint; embeddings default to a local model. First boot generates an API key. Hosted connectors and managed MCP use platform accounts instead of the local binary.

Local state defaults to ./.supermemory, while saved provider keys live under ~/.supermemory/env; set an absolute data directory for a service. Local is one process and one organization. Image, video, and higher-fidelity PDF understanding require Gemini or Vertex AI according to the configuration guide.

Four jobs share one memory API

Supermemory combines 4 related jobs: ingesting documents, extracting memories, maintaining user profiles, and searching both facts and source material. An application assigns content to a container tag, then asks for a profile or query result later. The README says the engine handles changing facts, contradictions, and expiration. That is more useful than a plain vector search when an assistant needs to remember that a user's current employer or location replaced an older value.

The project reaches users through several surfaces. TypeScript and Python clients call the hosted or local API. A managed MCP endpoint supplies memory, recall, and context tools, while separate plugins cover Claude Code, OpenCode, OpenClaw, and Hermes. The hosted side can sync Gmail, Google Drive, Notion, OneDrive, and GitHub. This breadth is attractive, but it makes the boundary between open local code and platform service worth reading carefully.

What happened when we ran it

Our sandbox installed the bun workspace in 75 seconds, adding 3,015 packages and consuming 3,212 MB on disk. The build ran for 98 seconds and exited with code 1. Turbo's summary said all 8 tasks had succeeded. Immediately afterward, postbuild invoked sentry-cli to create a release and upload source maps, then stopped with the plain error that an auth token was required.

There was no test script or target, so our harness skipped tests. The commit 4d8a4eb checkout contained 1,192 files, about 140,914 source lines, and 119.1 MB before the 3,212 MB install. Our scan found 12 CI workflow files, no Dockerfile, no tests directory, and monorepo workspaces. The measurement setup was an unprivileged Debian container with 3 CPUs, 8 GB of RAM, and no secrets.

All 8 build tasks pass before the release hook fails

The failed command is a packaging decision rather than a compiler error in the log we received. The root build runs Turbo, and the automatic postbuild runs sentry:sourcemaps. Open issue 1444 identifies the same coupling and asks that release upload become an explicit deployment step. We cannot call the repository build successful because the command returned exit 1, even though the build-task summary itself reported 8 successful tasks.

That distinction matters to contributors and downstream packagers. A normal checkout should not need a production monitoring credential merely to prove it builds. Workarounds may exist, but the supplied log does not document one, so we will not prescribe an unverified flag. The 75-second install also produced a very large development tree. Anyone changing this monorepo should budget for 3,015 packages and create a separate validation path that never publishes a Sentry release.

The 3,212 MB workspace differs from the local binary

The README's one-binary self-hosting path is a released server, while our lab exercised the repository's bun monorepo. Running npx supermemory local or the install script downloads that server. First boot creates an embedded graph store, prepares the default local embedding model, generates an API bearer token, and listens on port 6767. No external database is required for this local edition.

Memory extraction still needs a language model. Operators can provide OpenAI, Anthropic, Gemini, Groq, Vertex AI, Workers AI, or an OpenAI-compatible endpoint such as Ollama. The default embedding model is Xenova/bge-base-en-v1.5 with 768 dimensions and no API key. The configuration guide says image, video, and higher-fidelity PDF understanding require Gemini or Vertex. Fully offline use therefore needs local model capacity as well as the downloaded server.

Local v0.0.8 has one process and one generated key

The local edition is designed for one organization on one machine. It provides server logs, one generated API key, environment-variable configuration, and disk storage under ./.supermemory by default. The hosted platform adds member roles, scoped keys, a dashboard, managed scaling, connectors, and its managed MCP service. A team evaluating self-hosting should use the local feature table, rather than assuming every README feature runs in the binary.

Set SUPERMEMORY_DATA_DIR to an absolute, persistent location before putting v0.0.8 under a process manager. Open issue 1420 reports that the default relative path follows the current working directory, so a different launch directory can create a fresh empty store and API key. The quickstart also warns operators to back up the data directory before a rollback because older servers may not understand newer schema changes.

Server v0.0.8 repairs a vector-loss upgrade

The latest server release, published August 17, 2026, is an emergency patch. Its notes say stores moved from a 0.0.7 release candidate to 0.0.7 could retain document records while silently losing search vectors. Version 0.0.8 detects affected rows at boot and re-embeds them in the background. The release also adds migration fixtures with real vectors so future upgrade tests can check preservation.

That repair is a good response to a serious failure, and it is evidence that the local server still needs cautious operations. Back up before every version change, record the server version with the data, and verify that old documents remain searchable after restart. The repository had 39 open issues and 73 open pull requests when fetched, so GitHub's combined count of 112 is not a bug count.

September activity supports a trial, with recovery tests attached

GitHub recorded the last push on September 2, 2026, and 29,233 stars. Issue activity continued into September, while the latest server tag remained v0.0.8 from August 17. Those signals describe an active project, though the version number and emergency migration fix argue against hands-off operation. The absence of a root test target in our run leaves another gap between active development and repeatable outside verification.

For a hosted product, Supermemory can remove the work of building connectors, profile extraction, and a cross-client MCP service. For local use, it gives an unusually direct API over one machine, but the operator owns model behavior, storage durability, backups, and upgrade checks. Start with disposable data, replay a fixed set of contradictory and expiring memories, restart the server, then confirm that search and profiles still return the expected history.

Alternatives

ProjectWhat it isPick it when
Mem0 gh↗A memory layer for agents with managed and open-source deployment paths.pick this instead when you want a narrower memory API and a different set of framework integrations.
Graphiti gh↗A temporal knowledge-graph framework for facts that change over time.pick this instead when graph construction and temporal relationships matter more than a bundled app, connectors, and user profiles.
LettaA platform for stateful agents with memory managed inside the agent runtime.pick this instead when you want the agent runtime and memory system from one project.

What people are saying

  1. [velocity-scout] supermemoryai/supermemory

Sources

  1. Supermemory README
  2. Supermemory repository
  3. Supermemory self-hosting configuration
  4. Supermemory local versus Enterprise
  5. Supermemory server v0.0.8 release
  6. Root postbuild Sentry issue 1444
  7. Relative data directory issue 1420

More llm tools reviews

book-to-skill · OB1 · LlamaFactory · verl · skills-hub · aidlc-workflows · the whole board →