mrkeyoor.com_
Mon 21 Sept 17:45 UTC
LLM Toolsevaluationupdated 26 Aug 2026

prime-agent review

Prime Agent is a terminal coding and research agent built for jobs that continue across long sessions. It gives the model a persistent Python environment, real subagents, background execution, schedules, and a supplemental memory and skill system that can be refined and rolled back.

+248stars / 7d
Verdict

Our Prime Agent test command ran for 567 seconds and exited 1 despite reporting 750 passed and 0 failed, while npm audit found 2 high and 2 moderate vulnerabilities. That is too ambiguous for unattended rollout, but the 13-second build and unusually explicit trust warning make a controlled research trial reasonable. Choose it for persistent, recursive, long-running agent work under a disposable checkout; choose a more bounded coding agent when every command needs a stronger containment story.

We ran it

Lab card: what happened when we ran prime-agentScreenshot of prime-agent (github.com/PrimeIntellect-ai/prime-agent)
Install✓ · 23s372 packages · 434 MB
Build✓ · 13s
Tests✗ · 567s750 passed · 0 failed of 750 (node:test)
Known vulns40 critical · 2 high · 2 moderate · 0 low (npm audit)
Repo1194 files~375,941 lines of source · 20.8 MB · 6 CI workflows

Answers from our run

Does prime-agent build from source?

Dependencies installed in 23 seconds (372 packages), and the build succeeded in 13 seconds. We cloned commit e319a66 into a clean Debian container with 3 CPUs and no project-specific setup.

Do prime-agent's tests pass?

Yes: 750 of 750 passed when we ran the project's own test command (node:test). Some failures need services or credentials a bare container does not have.

Does prime-agent have known vulnerabilities in its dependencies?

npm audit flagged 4 known advisories in the dependency tree at the time of our run.

Who should not use prime-agent?

Anyone who needs the agent itself to be a security boundary: the README says generated Python and commands run with the user's permissions and explicitly says the worker and kernel are not a sandbox.

What are the alternatives to prime-agent?

Codex, Claude Code, Goose. Our Prime Agent test command ran for 567 seconds and exited 1 despite reporting 750 passed and 0 failed, while npm audit found 2 high and 2 moderate vulnerabilities.

Setup3/523-second install, but tests exited 1 and the runtime adds state
Docs5/5Trust, persistence, autonomy, providers, and recovery are explicit
Community5/518,565 stars and active work on August 26, 2026
Maturity3/5v0.8.1 is active; audit findings and test exit need review

Discussed on

  1. hnPrime Agent: A Self-Improving RLM Agent4 points
  2. hnPrime Agent: A Self-Improving RLM Agent4 points
  3. hnA self-improving RLM agent for coding workflows and long-running autonomous task3 points

Who it’s for

Researchers running long evaluations that need agents to detach, resume, schedule work, and retain subagents.
Developers comfortable letting a model write Python, run project commands, and edit the current repository.
Teams interested in recursive subagent calls and programmatic context handling inside a persistent REPL.
Users on macOS or Linux who can authenticate with a supported subscription or API-key provider.

Who it’s NOT for

Anyone who needs the agent itself to be a security boundary: the README says generated Python and commands run with the user's permissions and explicitly says the worker and kernel are not a sandbox.
Teams that cannot accept the 4 advisories found in our installed tree, including 2 high-severity and 2 moderate findings.
Users seeking a simple request-and-exit coding assistant: daemons, retained sessions, heartbeats, schedules, skills, and harness refinements add persistent state to inspect.
Organizations unwilling to review executable skills or learned supplemental instructions: the harness can preserve both across work, and imported skills are Python packages.
Windows-only developers: the documented stable installer supports macOS and Linux.

Setup reality

Our sandbox installed 372 npm packages in 23 seconds and used 434 MB. The build passed in 13 seconds. The test command exited 1 after 567 seconds even though its final Node test summary reported 750 passed and 0 failed across 126 suites. The tail did not show why the surrounding command failed. Npm audit found 4 vulnerabilities: 2 high and 2 moderate.

First launch needs /login and either a supported subscription or API-key provider. The installer can prepare the IPython runtime; source work uses the npm monorepo.

Prime Agent runs generated Python and shell commands with the user's permissions. A disposable clone, clean worktree, restore point, and external sandbox for untrusted material are operational requirements, not optional polish.

Prime Agent keeps Python, subagents, and goals alive between turns

Prime Agent approaches coding work as a persistent program rather than a sequence of isolated prompts. Its built-in model tool is an IPython environment. File operations, shell commands, subagent calls, tool use, and context handling all happen through code in that environment. An rlm(...) call can start a child agent and return its result to the parent program, which suits research jobs that divide into independent experiments or code inspections.

Sessions can detach from the terminal while the daemon, worker, kernel, schedules, and retained subagents continue. Goals survive turns, heartbeats re-enter work, and bounded autonomous mode can run under token, time, and turn budgets. The README correctly says that hitting a budget is not proof of completion, and a passed quality gate proves only what that gate checks. Those caveats matter for any agent expected to work without someone watching every message.

The installer is short, while provider login and Python state remain

The stable path is a shell installer for macOS or Linux. It downloads a versioned release, checks its SHA-256 digest, installs the command, and can prepare the IPython runtime. The first session then uses /login to select a subscription or API-key provider. Prime Agent starts in the current directory, which becomes the scope for its file and command work.

That convenience should not blur the persistent parts. Background services keep agents alive after a terminal disconnect, and prime-agent doctor can inspect or repair them. Saved sessions can be resumed by path or ID. A clean worktree and a checkpoint are sensible defaults because the model can change files while the user is away. The README itself recommends a disposable clone, clean worktree, or another restore point.

What happened when we ran it

Our unprivileged Node 22 sandbox installed 372 npm packages in 23 seconds and consumed 434 MB on disk. The monorepo build succeeded in 13 seconds. Npm audit reported 4 known vulnerabilities: 0 critical, 2 high, 2 moderate, and 0 low. Those findings need package-level review before a team permits long-lived background processes on developer machines.

The test command ran for 567 seconds and exited with code 1. Its final Node test output said 750 tests passed, 0 failed, 0 cancelled, 0 skipped, and 0 todo across 126 suites. The summary's own duration was about 8.2 seconds, while the outer measured step lasted much longer. The supplied tail contains no error after that summary, so it does not identify which surrounding check or process caused exit 1.

That mismatch is a finding, not a license to call the suite green. commit e319a66 installed and built, and the visible Node tests all passed, yet the command our harness invoked failed. The checkout had 1,194 files, about 375,941 source lines, and used 20.8 MB before dependencies. It included 6 CI workflow files, no Dockerfile, no top-level tests directory, and npm workspaces.

Model-generated Python runs with the user's permissions

Prime Agent's most important documentation is its warning. Model-generated Python and project commands execute with the user's permissions. Worker and kernel processes improve lifecycle isolation and recovery, but they are not a security sandbox. Untrusted repositories, instructions, skills, or extensions can therefore reach whatever the user account and surrounding environment permit.

The persistent REPL raises the stakes because state can outlive one exchange. Imported skills are executable Python packages. Agents can communicate directly, schedules can restart work later, and autonomous mode can continue without a fresh prompt. Use an external sandbox or restricted environment for unknown code, keep credentials out of the workspace, and inspect the process after detaching. A daemon is useful continuity, not containment.

Refinement changes supplemental state and preserves rollback snapshots

The continual harness can store prompts, memories, skill descriptions, and reusable subagent specifications. /refine reviews a trajectory and may make focused updates to that supplemental state. The immutable base system prompt stays fixed, and recorded snapshots allow rollback. That is a better design than silently rewriting the entire instruction stack, but teams still need to review what changed.

A successful local trick can be too specific for later tasks. A remembered instruction may also preserve a mistaken assumption or an unsafe command pattern. Refinement history should be treated like configuration history: small diffs, named evidence, and a clear reason to keep each item. Packaging a new executable skill remains a separate act, according to the README, which is the right distinction between remembering guidance and installing code.

Version 0.8.1 is active and the runtime is still changing

GitHub recorded 18,565 stars, 92 combined issues and pull requests, and a last push on August 26, 2026. Version 0.8.1 was released the same day. It raised the default maximum RLM recursion depth for new sessions from 1 to 2, adjusted ACP behavior around subagent completion, and changed one gateway's default model after its catalog shifted.

Open pull requests on August 26 included a proposed move away from IPython and ZMQ toward a smaller CPython REPL runtime. That work shows active engineering, but it also touches the central execution model described by the current README. Users building extensions around kernel behavior should pin a release and read upgrade notes rather than tracking main casually.

Prime Agent has a specific advantage for long research jobs: subagents, state, schedules, and goals are part of one programmable harness. Our 750 passing Node tests show substantial covered behavior, while exit 1 and 4 audit findings block an easy production recommendation. Run it in a disposable environment, start with narrow provider credentials, and prove detach, resume, cancellation, and rollback before trusting a week-long autonomous task.

Alternatives

ProjectWhat it isPick it when
Codex gh↗A terminal coding agent with repository editing, command execution, and sandbox controls.pick this instead when coding work and explicit execution controls matter more than Prime Agent's persistent RLM harness.
Claude Code gh↗Anthropic's terminal agent for codebase work, hooks, skills, and automation.pick this instead when your team already uses Claude and wants its established coding-agent workflow rather than recursive Python orchestration.
Goose gh↗An extensible local agent that works with several model providers and developer tools.pick this instead when provider choice and an extension-based coding assistant are enough without a self-refining harness.

What people are saying

  1. [github-trending] PrimeIntellect-ai/prime-agent

Sources

  1. Prime Agent README
  2. Prime Agent v0.8.1 release
  3. Prime Agent architecture documentation
  4. Prime Agent long-running agents guide

More llm tools reviews

train-llm-from-scratch · mistral.rs · flue · TensorRT-LLM · pydantic-ai · cc-haha · the whole board →