mrkeyoor.com_
Sat 17 Oct 13:31 UTC
LLM Toolsevaluationupdated 10 Oct 2026

billion-context review

Billion-context is a proxy and plugin system that shortens a coding agent's conversation history into summaries and lets it retrieve earlier details. It helps long coding sessions fit inside the model's context limit, with English and Chinese documentation available.

+639stars / 7d
Verdict

Our billion-context run built in 26 seconds, but its tests timed out at 900 seconds and npm audit reported 22 known vulnerabilities. I'd trial it for supervised terminal coding sessions where retrieving old conversation details matters enough to justify a proxy. Skip it if you depend on the unsupported Claude Desktop route or need a completed test suite before adoption.

We ran it

Lab card: what happened when we ran billion-contextScreenshot of billion-context (github.com/ranxianglei/billion-context)
Install✓ · 13s419 packages · 380 MB
Build✓ · 26s
Tests✗ timed out · 900sran, no count parsed
Known vulns221 critical · 12 high · 8 moderate · 1 low (npm audit)
Repo1234 files~325,249 lines of source · 21.9 MB · 25 CI workflows · tests dir

Answers from our run

Does billion-context build from source?

Dependencies installed in 13 seconds (419 packages), and the build succeeded in 26 seconds. We cloned commit 7c993f9 into a clean Debian container with 3 CPUs and no project-specific setup.

Do billion-context's tests pass?

We could not finish them: the suite was still running after 15 minutes in our container.

Does billion-context have known vulnerabilities in its dependencies?

npm audit flagged 22 known advisories in the dependency tree, including 1 critical at the time of our run.

Who should not use billion-context?

Claude Desktop Code-tab users: the README says its URL override bypasses the native proxy while native automatic compaction can remain disabled.

What are the alternatives to billion-context?

Context Mode, RTK, Aider. Our billion-context run built in 26 seconds, but its tests timed out at 900 seconds and npm audit reported 22 known vulnerabilities.

Setup3/513-second install; client routing and certificates need care
Docs4/5Detailed client limitations, configuration, and update controls
Community3/5October 10 push and active routing and compaction discussions
Maturity2/5Build passed; suite timed out and client boundaries remain

Who it’s for

Terminal coding-agent users who repeatedly lose useful history during long debugging sessions.
Developers willing to check the routing instructions for their specific client and verify that compression happens.
Teams that can supervise a local proxy, protect stored conversation data, and choose an update policy.

Who it’s NOT for

Claude Desktop Code-tab users: the README says its URL override bypasses the native proxy while native automatic compaction can remain disabled.
Codex users expecting the MCP plugin alone to route model traffic: the README requires a running proxy and separate routing or the launcher.
Workstations that prohibit certificate-based interception when the required client launcher uses that route.
Teams requiring only unmodified standard licenses: LICENSE adds product-surface attribution to MIT's terms.
Operators who expect disabling ordinary auto-update to freeze the package: critical-defect advisories have a separate control.

Setup reality

Our run installed commit 7c993f9 in 13 seconds: 419 packages and 380 MB on disk. The build passed in 26 seconds, but tests timed out at 900 seconds. Npm audit reported 22 known vulnerabilities, including 1 critical and 12 high. The last visible checks passed and the log retired a stale usage reference after input fell from 261206 to 1000; it doesn't explain the timeout.

Useful operation needs an installed coding client and its provider login or API credentials. Choose its documented launcher, native plugin, or URL route. The Codex MCP companion needs an already running proxy and doesn't route model traffic itself. Session history persists locally.

The package specifies Node 20 or newer. Some launchers use certificate-based interception. Claude Desktop's embedded Code tab has a documented routing limitation, and native plugins must not run alongside legacy compression extensions. Critical-defect advisory updates have a separate opt-out from ordinary auto-update.

Your client's routing decides whether compression happens

Billion-context built in 26 seconds in our sandbox, but choosing the right connection matters more than compiling it. The proxy sits between a coding agent and its model provider, replaces older conversation ranges with summaries, and gives the agent tools to retrieve details later. I'd try it when repeated context loss interrupts a long debugging job. I'd first check the exact client path in the integration guide.

The tools explain the attraction. compress folds a range, decompress restores it, and search_context looks through summaries and visible messages. You can revisit an earlier error instead of relying entirely on the latest summary. Retrieval still depends on the agent asking for the right material. Our 900-second test timeout leaves us without a completed suite, and the supplied run doesn't establish whether a long session remembers every consequential detail.

What happened when we ran it

Our run installed billion-context commit 7c993f9 in 13 seconds, adding 419 packages and using 380 MB on disk. The build passed in 26 seconds. We ran it on October 10, 2026, in a fresh Debian container with 3 CPUs, 8 GB of RAM, and image lab-node:22, without secrets or elevated privileges. These measurements cover repository setup and checks, not live model performance or token savings.

Tests timed out at 900 seconds. The last visible checks passed: an emergency context trigger without the beta header, followed by a check that the effective limit honors the Anthropic extended-context header per request. Between them, the log records input usage falling from 261206 to 1000 and retiring a stale high reference. The tail contains no explanation for the timeout. It doesn't justify calling those checks failed or claiming the complete suite passed.

Npm audit reported 22 known vulnerabilities: 1 critical, 12 high, 8 moderate, and 1 low. That is reason to inspect the dependency paths before putting model credentials through this proxy, although the supplied summary doesn't identify an exploitable request path. The checkout contained 1234 files, roughly 325249 source lines, and occupied 21.9 MB. The scan found 25 CI workflow files and a tests directory, with no Dockerfile.

The Codex MCP companion needs a running proxy

The English README distinguishes launcher, native plugin, and URL-rewrite routes. bili plugin install codex supplies context tools through MCP, but doesn't start the proxy or route Codex's model traffic. For that client, the documented launcher is the simpler complete route. A visible MCP connection alone would be a poor acceptance check: you need evidence that the actual conversation passes through the compressor.

Installation itself was straightforward in our run: 13 seconds and 380 MB. Using it still requires an installed coding client and that client's provider login or API credential. Some launchers decrypt selected model traffic locally using a certificate, while others rewrite the provider URL. If your workstation policy forbids that interception, the launcher you need may be unsuitable. The configuration reference also documents persisted session data, which deserves the same care as your coding history.

Claude Desktop's Code tab can bypass the proxy

The README documents a concrete Claude Desktop limitation: its embedded Code tab overrides the managed provider URL. The native configuration can still disable the client's own automatic compaction, leaving that route with neither compression mechanism. Terminal Claude Code follows a different path. Desktop-only users should avoid this integration until their route is supported, rather than assume that the Claude name on the compatibility list covers every app.

Native plugins and the older standalone extensions must also stay separate because enabling both can compress the same conversation twice. The installer replaces legacy configuration entries, but the README says project-local entries need manual removal. Our successful 26-second build doesn't verify those settings on your workstation. Check the repository's client instructions against both your user configuration and the project's configuration before trusting a resumed conversation with important debugging evidence.

Automatic updates and attribution need explicit decisions

The update documentation says critical-defect advisories can force a package change even when ordinary automatic updates are off. It provides a separate advisory opt-out. That's inconvenient for a team that freezes tool versions during an incident investigation: pinning the usual update setting is insufficient. With 419 packages in our measured installation, I'd make the update policy part of the deployment record, alongside the selected client route.

The license file adds a product-surface attribution requirement to MIT's terms. GitHub reports its license identifier as NOASSERTION. Teams restricted to unmodified standard licenses should examine that file before adoption. RTK is a narrower alternative when command output is the main source of context bloat, while Context Mode concentrates on handling tool output and session memory. Neither choice should be treated as a verified substitute for every client integration here.

October activity shows maintenance alongside compatibility work

The repository's last push was October 10, 2026. GitHub returned 748 stars and 193 open issues and PRs, and release v0.1.191 shipped that day. Recent threads include client-routing and compaction fixes, so this is active maintenance with moving integration boundaries. Use it for a supervised terminal workflow where retained history matters enough to justify the proxy. Before making it your default, require a completed suite beyond our 900-second cap and confirm compression on the client you actually use.

Alternatives

ProjectWhat it isPick it when
Context Mode gh↗An MCP and hook system for managing coding-agent tool output and session memory.pick this instead when tool-output handling is your main problem and you prefer its supported client integrations.
RTK gh↗A command-line proxy that filters common developer-command output before an agent reads it.pick this instead when verbose terminal commands cause context bloat and you want a narrower intervention.
Aider gh↗A terminal coding assistant that works directly with a Git repository.pick this instead when you can change coding clients and prefer one assistant workflow over adding a proxy to several clients.

What people are saying

  1. [github-trending] ranxianglei/billion-context

Sources

  1. English README and client compatibility
  2. Client integration guide
  3. Configuration and session storage
  4. License and additional attribution term
  5. Release v0.1.191
  6. Repository facts and activity
  7. Context Mode
  8. RTK

More llm tools reviews

GLM-5.3-Flash-EXL3-2x-DGX-Sparks-TensorFold · livenerf · scion · opencode2api · IQuest-Q1 · iCode · the whole board →